Standard Setting & Review Panel

We rely on our standard setting panel—a group of experts, including subject matter experts (SMEs)—to determine cut scores that define performance levels on a test, such as pass or fail. Together, we define what a proficient candidate should know by reviewing assessment items and judging how a minimally competent candidate would perform. Our panel applies established standard setting methods like Angoff or P value to recommend cut scores that ensure fairness and consistency across different test versions or forms. Additionally, we have a dedicated review panel that evaluates and validates these decisions throughout the standard-setting process, helping us maintain the quality, fairness, and accuracy of the cut scores and performance level definitions before finalization.

We ensure our cut scores are credible, defensible, and aligned with learning goals by promoting transparency and fairness in how performance levels are set. Our appointed review panels, composed of subject matter experts, play a vital role in this process. They recommend cut scores and performance level descriptions for clarity and appropriateness, check for consistency across items, test forms, and standards, and identify any biases or errors. By providing feedback and suggesting adjustments, our panels help us improve the validity and fairness of the cut scores while confirming that final standards align with intended learning outcomes and assessment goals. Through their expertise, we add an extra layer of quality control that strengthens the defensibility, credibility, and trustworthiness of our assessment standards for all stakeholders.

In conclusion, we empower expert-driven reviews by providing role-based access, real-time commenting, and built-in scoring and voting features that streamline collaboration. Our platform supports seamless execution of Angoff and Modified Angoff methods through custom panelist workflows, score calibration tools, and moderator controls, ensuring a structured, transparent, and efficient standard-setting process.