Rescoring of 2013-2014 Field Tested Assessments
During 2013-2014, a field test of newly-written End-of-Course (EOC) tests was conducted by the maintainers of WebXam, CETE at The Ohio State University, who coordinated with the Ohio Department of Education. The field test process, just like the large group review involving instructors, is an important part of psychometric quality assurance. The purpose of field testing is to examine scores on both individual items and entire modules. This QA process helps CETE staff to select quality items to create operational test forms.
When students took field tested EOC Tests this spring, the tests had a large number of test items, typically 80 or more. Also, students did not receive a pass/fail indication. In May, CETE staff analyzed these field test results. For EOC Tests with a sufficiently large number of testers, or approximately 125 students, CETE psychometric staff dropped poorly performing items and selected final test forms of 40 items so that tests could be rescored for accountability purposes. Every student’s test result is based on the set of items chosen. The percentage score may increase or decrease from the raw score shown to the student during field testing.
Districts can now run reports on the WebXam site to get these EOC scores. Reports will show the following:
- Rescored field tests appear with a score and a pass/fail indicator. These scores will be combined to create the composite Pathway Test score.
- Non-rescored field tests appear without a cut score and without a pass/fail indicator. These scores are not part of the composite Pathway Test score.
So, for field tested assessments, the overall score for a Pathway Test will consist only of scores for EOC Tests that were rescored.
The chart below shows which EOC Tests had a sufficient number of test takers for psychometric analysis. For these EOC Tests, the proficient and advanced cutoff scores are also shown. EOC Tests not listed were not rescored; they will be given another year to increase participation. When additional EOC Tests are rescored at the end of 2014-2015, you will be able to see students’ scores on the final forms for EOC Tests taken in 2013-2014.
|EOC Test Name||# Tests||Proficient %||Advanced %|
|Health Science Career Field|
|Athletic Injuries & Prevention||329||61||82|
|Clinical Laboratory Techniques||185||77||92|
|Exercise & Athletic Training||365||67||79|
|Exercise Physiology & Biochemistry||131||53||80|
|Fitness Evaluation & Assessment||293||54||83|
|Human Anatomy and Physiology||755||54||75|
|Lifespan Development and Medical Intervention||269||58||82|
|Nutrition & Wellness||289||60||81|
|Nutrition and Wellness||219||60||81|
|Patient Centered Care||719||73||89|
|Patient Centered Care and Diagnostics||250||64||84|
|Principles and Practices of Biomedical Technology||283||67||89|
|Principles of Allied Health||888||63||77|
|Engineering and Science Career Field|
|Manufacturing Technologies Career Field|
|Gas Metal Arc Welding||334||74||85|
|Machining with Industrial Lathes||199||64||92|
|Machining with Industrial Milling Machines||155||70||85|
|Construction Technologies Career Field|
|Carpentry and Masonry Technical Skills||191||75||94|
|Construction Technology–Core and Sustainable Construction||387||65||88|
|Residential Electrical Systems||228||75||93|
|Structural Coverings and Finishes||185||81||93|
|Law and Public Safety Career Field|
|The American Criminal Justice System||494||47||70|
|The Correctional System and Services||196||60||80|
|Foundations of Firefighting and EMS||185||71||82|
|Homeland Security Protecting America’s Critical Infrastructure||223||70||81|
|Investigations and Forensics in Criminal Investigations||313||61||84|
|Police Work and Practice in Public Safety||473||56||80|
|Security and Protective Services||187||53||77|
New Indicator of Incomplete Pathway Test
Please note that, although the format of the score output file to the state’s data system, EMIS, has not changed, there is a new score designation this year. Pathway tests that have moved to the EOC format require at least three EOC scores to be considered a valid overall test score. Students should take the EOC test for each course completed. However, in some cases, students have started testing but have fewer than three EOC scores. In this case, a numeric score and pass/fail value will not be reported. Instead, there will be an uppercase letter I in place of the percent score and a letter I in place of the pass/fail indicator. This is now reflected in the WebXam score reports, which show a “N/A” for passing status if the Pathway Test is considered incomplete.