Automated Scoring of Multiple-Choice Tests

 

Instructional Consultation offers instructors access to sophisticated test scoring software and hardware for scoring and subsequent analysis of multiple-choice tests. The purpose is to provide tools and information leading to the improvement of tests as measures of the outcomes of instruction.

The Simple Approach

Simple, easy-to-use scanners (Scantron half-sheet readers) are available in multiple locations on campus to score multiple choice exams, for the many situations in which all that is necessary is a score of the total number of correct responses by each student (and, optionally, a marking of which specific responses were correct and incorrect). Two such scanners are located in Kerr Learning Labs (Room 2160, 893-3963), which typically is open more than 70 hours per week. These scanners use “half sheet” forms which are readily available for student purchase in the Bookstore, the Arbor, and other locations on campus and in Isla Vista.

The ParScore Option

OIC’s test scoring system (ParScore) is not especially complex, but its use does require some familiarity with: handling of mark-sense response sheets, operation of an optical scanner, obtaining electronic enrollment rosters, operation of software that manipulates the scanned data, and interpretation of item analysis results. It is typical that OIC staff must provide some familiarization and orientation to those using the system for the first time.

ParScore does require that students respond on one particular form, the ParScore Sheet, also referred to as the the full size pink scantron form, a full 8 1/2 x 11 inch sheet with a maximum of 200 questions.

In order to provide service to as many instructors as possible, we have developed the following guidelines.

• Operation of the scanning system must be done by faculty members, TAs, or other authorized representatives of the course, department or program involved. OIC cannot afford to do the scanning for you.
  
  
• OIC will provide training only once for each course per quarter, typically to one person who will do all the scanning and scoring for the involved course(s). Particularly encouraged are approaches in which one person is responsible for test scoring for many courses. We encourage discussion of how this sort of arrangement may work best in specific situations.
  
  
• Access to the scoring system is on a scheduled basis. Drop-ins are sometimes possible, but advance scheduling is strongly recommended (call 893-4278 or 893-2972). The basic principle is “first-requested, first-scheduled.”
  
  
• The primary justification for using the ParScore system is its item analysis capabilities, which enable informed decisions about individual test questions. Manipulation of class rosters, rescoring of tests, and other information management capabilities are certainly helpful and convenient, but are not by themselves sufficient justification for using ParScore – there are many inexpensive or freeware course management software packages that can address those needs. We will be glad to help you identify long-term solutions to your needs.


For further information and assistance:
Mary Lou Ramos
Instructional Consultation
893-4278
marylou@id.ucsb.edu