ROMPER (RAND/USC OPTIC Method for Policy Expert Ratings)
A validated, open-access approach specifically designed to elicit and summarize expert views on the effectiveness and implementability of population-level interventions. It provides a replicable framework for translating expert consensus into actionable policy data.
When you can't tell if your sessions are actually working
You need to measure impact beyond satisfaction surveys and understand if learning is actually being applied.
When needing to prioritize multiple intervention options based on their likelihood of success and ease of implementation.
Identification of Policy/Intervention Options
Online Expert Rating (Effectiveness and Implementability)
Consensus Summarization
Policy Recommendation Reporting
Shows real ROI and helps you continuously improve your sessions.
Instructional designers can use this method to evaluate the potential impact and feasibility of various training interventions by having subject matter experts rate proposed solutions before full-scale development.
- 1Define success metrics before the session
- 2Build in micro-assessments throughout
- 3Follow up after to measure behavior change
- 4Use data to iterate on your design
- Impact evaluation
- Feasibility studies
- Prioritizing organizational interventions
- Validated rating scales
- Dual-focus on effectiveness and implementability
- Replicable and transparent methodology
- Expert elicitation
- Requires clearly defined intervention options to be rated
- Success depends on the diversity and expertise of the rating panel