A Study of the Alignment of the NWEA RIT Scale with the New England Common Assessments Program (NECAP) March, 2010 January, 2016 (Revised)

Transcription

1 A Study of the Alignment of the NWEA RIT Scale with the New England Common Assessments Program (NECAP) March, 2010 January, 2016 (Revised)

2 Copyright 2015 Northwest Evaluation Association All rights reserved. No part of this document may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage and retrieval system, without written permission from NWEA. Northwest Evaluation Association 121 NW Everett St. Portland, OR Tel Fax

3 A Study of the Alignment of the NWEA RIT Scale with the New England Common Assessments Program Northwest Evaluation Association March, 2010 January, 2016 (Revised*) Northwest Evaluation Association (NWEA ) completed a project to connect the scale of the tests used for the New England Common Assessments Program (NECAP) mathematics and reading assessments with NWEA s RIT scale. The NECAP is the result of collaboration among New Hampshire, Rhode Island, Vermont and Maine to create an assessment to meet the requirements of the No Child Left Behind Act (NCLB). Information from the NECAP assessments was used in a study to establish performance-level s on the RIT scale that would indicate a good chance of success on these tests by students in Maine, New Hampshire, Rhode Island and Vermont. The data used in the study were derived from the NECAP test s of New Hampshire students. To perform the analysis, we linked aggregate state test results with NWEA test results for all schools whose NWEA test count for a grade and subject was between 95% and 105% of the count tested on the state assessment. This provided assurance that only schools that had tested a very similar population on both tests were included. The NECAP state test is administered in fall. For the fall season, an equipercentile method was used to estimate the RIT equivalent to each state performance level. For fall, we determined the percentage of the population within the selected study group that performed at each level on the state test and found the equivalent percentile ranges within the NWEA dataset to estimate the cut s. For example, if 40% of the study group population in grade 3 mathematics performed below the proficient level on the state test, we would find the RIT that would be equivalent to the 40 th percentile for the study population (this would not be the same as the 40 th percentile in the NWEA norms). This RIT would be the estimated point on the NWEA RIT scale that would be equivalent to the minimum for proficiency on the state test. More complete documentation about this method can be found on our website: Tables 1 through 4 show the best estimate of the RIT equivalent to each NECAP performance level for same-season (fall) and prior-season (spring) RIT s. These tables may be used to identify students who may need additional help to perform well on these tests. Tables 5 through 8 show the proportion of students achieving various RIT ranges whom we estimate would achieve a proficient on the state assessment. These tables can be used to assist in identifying students who are not likely to pass these assessments, thereby increasing the probability that intervention strategies will be planned and implemented. 1

4 Table 1 - Recommended same-season (fall) RIT cut s for NECAP performance levels - Reading Grade Substantially Below Partially Distinction 3 < < < < < < Table 2 - Recommended same-season (fall) RIT cut s for NECAP performance levels - Mathematics Grade Substantially Below Partially NWEA Page 4 Distinction 3 < < < < < <

5 Table 3 - Recommended prior-season (spring) RIT cut s for NECAP performance levels - Reading Grade Substantially Below Partially Distinction 3 < < < < < < Table 4 - Recommended prior-season (spring) RIT cut s for NECAP performance levels - Mathematics Grade Substantially Below Partially NWEA Page 5 Distinction 3 < < < < < <

6 Table 5 - Proportion of students passing the NECAP state reading assessment based on same-season (fall) reading RIT range Percent in this range who pass RIT Range % 2 % 1 % 1 % 0 % 0 % % 4 % 2 % 1 % 1 % 0 % % 6 % 3 % 1 % 1 % 1 % % 9 % 5 % 2 % 2 % 1 % % 1 4 % 8 % 4 % 3 % 1 % % 2 2 % 1 2 % 6 % 4 % 2 % % 3 1 % 1 8 % 9 % % 4 % % 4 3 % 2 % 1 4 % 1 1 % 6 % % 5 5 % 3 8 % 2 2 % 1 % 1 0 % % 6 % 5 0 % 3 1 % 2 5 % 1 6 % % % 6 2 % 4 3 % 3 6 % 2 3 % % 8 4 % 3 % 5 5 % 4 8 % 3 3 % % 9 0 % 8 2 % 6 % 6 0 % 4 5 % % 9 4 % 8 8 % % 1 % 5 % % 9 6 % 9 2 % 8 4 % 8 0 % 6 9 % % 9 8 % 9 5 % 9 0 % 8 % 8 % % 9 9 % 9 % 9 4 % 9 2 % 8 6 % % 9 9 % 9 8 % 9 6 % 9 5 % 9 1 % % 9 9 % 9 9 % 9 8 % 9 % 9 4 % % % 9 9 % 9 9 % 9 8 % 9 6 %

7 Table 6 - Proportion of students passing the NECAP state mathematics assessment based on same-season (fall) mathematics RIT range Percent in this range who pass RIT Range % 2% 1 % 0 % 0 % 0 % % 4 % 2 % 1 % 0 % 0 % 10 14% 6% 3 % 1 % 1 % 0 % % 1 0 % 5 % 2 % 1 % 0 % % 16% 8 % 3 % 2 % 1 % % 2 3 % 1 3 % 5 % 3 % 1 % % 3 3 % 2 0 % 8 % 5 % 2 % % 4 5 % 2 9 % 1 3 % 8 % 3 % 200 % 5 % 4 0 % 2 0 % 1 2 % 5 % % 6 9 % 5 2 % 2 9 % 1 8 % 8 % % 8 % 6 4 % 4 0 % 2 % 1 3 % % 8 6 % 5 % 5 2 % 3 8 % 2 0 % % 9 1 % 8 3 % 6 4 % 5 0 % 2 9 % % 9 4 % 8 9 % 5 % 6 2 % 4 0 % % 9 6 % 9 3 % 8 3 % 3 % 5 2 % % 9 8 % 9 6 % 8 9 % 8 2 % 6 4 % % 9 9 % 9 % 9 3 % 8 8 % 5 % % 9 9 % 9 8 % 9 6 % 9 2 % 8 3 % % 9 9 % 9 9 % 9 % 9 5 % 8 9 % % % 9 9 % 9 8 % 9 % 9 3 % % % % 9 9 % 9 8 % 9 6 %

8 Table - Proportion of students passing the NECAP state reading assessment based on prior-season (spring) reading RIT range Percent in this range who pass RIT Range % 2 % 1 % 1 % 0 % 0 % % 4 % 2 % 1 % 1 % 0 % 165 1% 6 % 3 % 1 % 1 % 1 % % 1 0 % 5 % 2 % 2 % 1 % % 1 6 % 8 % 4 % 3 % 1 % % 2 3 % 1 3 % 6 % 4 % 2 % % 3 3 % 2 0 % 9 % % 4 % % 4 5 % 2 9 % 1 4 % 1 1 % 6 % % 5 % 4 0 % 2 2 % 1 % 1 0 % % 6 9 % 5 2 % 3 1 % 2 5 % 1 6 % % 8 % 6 4 % 4 3 % 3 6 % 2 3 % % 8 6 % 5 % 5 5 % 4 8 % 3 3 % % 9 1 % 8 3 % 6 % 6 0 % 4 5 % % 9 4 % 8 9 % % 1 % 5 % % 9 6 % 9 3 % 8 4 % 8 0 % 6 9 % % 9 8 % 9 6 % 9 0 % 8 % 8 % % 9 9 % 9 % 9 4 % 9 2 % 8 6 % % 9 9 % 9 8 % 9 6 % 9 5 % 9 1 % % 9 9 % 9 9 % 9 8 % 9 % 9 4 % % % 9 9 % 9 9 % 9 8 % 9 6 % *Note: the grade indicated in this table is the grade that the student will be in when the state assessment is administered. Example: If a 2 nd grade student takes the MAP test in the spring and s a RIT of 180, a teacher would find 180 in the RIT Range column and then follow the 3 rd grade column down to the180 point to see that the probability that the student will pass the 3 rd grade state assessment is 48%.

9 Table 8 - Proportion of students passing the NECAP state mathematics assessment based on prior-season (spring) mathematics RIT range Percent in this range who pass RIT Range % 3% 1 % 0 % 0 % 0 % % 4 % 2 % 1 % 0 % 0 % 10 1% % 4 % 1 % 1 % 0 % 15 25% 11% 6 % 2 % 1 % 0 % % 1% 9 % 3 % 2 % 1 % % 2 5 % 1 4 % 5 % 3 % 1 % % 3 6 % 2 2 % 8 % 5 % 2 % % 4 8 % 3 1 % 1 2 % 8 % 3 % % 6 0 % 4 3 % 1 8 % 1 2 % 5 % % 1 % 5 5 % 2 % 1 8 % 8 % % 8 0 % 6 % 3 8 % 2 % 1 3 % % 8 % % 5 0 % 3 8 % 2 0 % % 9 2 % 8 4 % 6 2 % 5 0 % 2 9 % % 9 5 % 9 0 % 3 % 6 2 % 4 0 % % 9 % 9 4 % 8 2 % 3 % 5 2 % % 9 8 % 9 6 % 8 8 % 8 2 % 6 4 % % 9 9 % 9 8 % 9 2 % 8 8 % 5 % % 9 9 % 9 9 % 9 5 % 9 2 % 8 3 % % % 9 9 % 9 % 9 5 % 8 9 % % % 9 9 % 9 8 % 9 % 9 3 % % % % 9 9 % 9 8 % 9 6 % *Note: the grade indicated in this table is the grade that the student will be in when the state assessment is administered. Example: If a 2 nd grade student takes the MAP test in the spring and s a RIT of 180, a teacher would find 180 in the RIT Range column and then follow the 3 rd grade column down to the180 point to see that the probability that the student will pass the 3 rd grade state assessment is 36%. *Revisions: Condensing four NECAP studies to a single report that is applicable to New Hampshire, Vermont, Rhode Island, and Maine.