Computer Assisted Marking

Computer assisted marking offers a low risk method of introducing computerised marking of free-text into high stakes on-screen assessment. With computer assisted marking, a human marker can remain as the primary mode of marking, but with each student response they mark also marked by computer. Any discrepancies between the human and the computer mark can be flagged to the human marker for a final decision. In this way the computer can help to detect errors and omissions in human marking which would otherwise go unchecked. The system is also able to collect and collate data relating to the frequency of human marker error.

The process of double marking is illustrated below.

IAT's double marking interface can be seen here. The first thing you will notice is that there is nowhere to type in a mark. The interface does not work that way. Rather, for each response the marker must click on the mark scheme answer(s) which match the response. The mark for the response is then automatically calculated based on which, if any, mark scheme answers have been selected, and this is shown in the mark panel. Where there is a difference between the mark the human awarded and the mark the computer has awarded, the human marker is prompted to check their marking decision. This process is illustrated here.

The key points of this unique technology are :

• The vast majority of marker errors will be picked up and flagged to the marker.
• The marker is forced to apply the mark scheme, or provide justification why not.
• Mark accumulation is automated.
• An audit trail of why marks were awarded is provided.
• It enables you to introduce and assess computerised marking of free-text in a controlled, low risk way.

Contact us to discuss how you can use this technology in your eAssessment project.