All Readers receive the same, consistent, required training for each question before they begin scoring. Readers can repeat any portion of training as needed throughout the Reading.
System and content training occur at the beginning of the first day of the Reading. Depending on the subject, initial training may take a full day and can be either self-paced or conducted via teleconference or online seminar by a Scoring Leader. All Reader training is conducted using online documents and sample student responses.
During the learning process, Readers:
- become familiar with the exam task
- learn the question and scoring guidelines
- complete self-paced training modules
- review rubrics and exemplar benchmark items
- practice scoring with annotated feedback, including rationale from the subject’s scoring leadership
- score pre-scored student responses, known as a calibration set, to ensure they are consistently applying the rubric to student responses
- receive individualized coaching from their Scoring Leader based on reviews of practice and calibration results, comparing Reader scores to the correct scores