How are Certifying Exam Cases Developed?
A look behind the scenes of the new Certifying Exam
The Case Developers
Case development is a collaborative process. Clinically active, ABEM-certified emergency physicians, including volunteers and ABEM directors, develop cases, but standardized patient actors, public members, and ABEM staff also help.
The Development Process
Teams of clinically active, ABEM-certified physicians from different geographic locations and practice settings work collaboratively to develop topics and testing points for each of the case types that have been shared with the community. Fundamentally, the cases and testing points are based on the EM Model and supported by best practices found in the reference list for each case type on ABEM’s website. Each team has a lead author assigned to selected topics. Authors work independently on their cases and then further collaborate with other case developers between and during in-person meetings. For cases involving a standardized patient actor, the patient actors are actively involved in script development throughout the process to ensure there is a consistent and standardized format. Patient centered and public input is also sought from the public members sitting on case development teams.
Quality Assurance and Relevance
ABEM Directors, exam developers, and staff undergo bias training, and exam cases undergo bias review. Cases are thoroughly vetted by ABEM-certified physicians. Each case is mock administered, further edited to incorporate the feedback received, and then re-administered as needed. If a case is not accepted during review, it is returned to the developers for refinement. Cases will be reviewed on an ongoing basis for continued relevance, fairness and validity. If a case is deemed outdated or flawed, it will be removed from the pool of available cases.
Scoring
Candidates are evaluated based on their responses and actions. All examiners are evaluated during every exam for case administration and score accuracy. The scoring and equating process adjusts for variance in scoring stringency. ABEM will conduct standard-setting studies during the initial roll out of the Certifying Exam. This process study involves gathering a diverse group of ABEM-certified physicians who evaluate and recommend what level of performance on the Certifying Exam will constitute passing, which is then approved by the Board of Directors.
Interested in learning more?
We are committed to keeping you informed about the new Certifying Exam launching in 2026. Stay in the know by reviewing the available resources on the ABEM website.
Request an ABEM speaker to share the latest updates on the Certifying Exam with your residency program or at an upcoming conference. Sign up here.
Current ABEM-certified physicians can volunteer to be an item writer or examiner, or sign up to participate in our upcoming practice administration as a volunteer mock examinee.