Standardising the Marking of Examinations

Provisional mark scheme

Each externally set assessment (eg question paper) has an associated mark scheme which is produced at the same time as the assessment is being drafted. The mark scheme is amended in conjunction with the question paper as it is being reviewed and revised. At the end of this revision process the provisional mark scheme is stored securely until the time comes for it to be applied to candidates' work, which normally takes the form of examination scripts ie question papers completed by candidates.

Revising the provisional mark scheme

Although the principal examiner and colleagues responsible for drafting the mark scheme try to anticipate all the likely responses to each of the assessment questions or tasks, it is usually the case that 'live scripts' include candidates' responses which have not been anticipated. The mark scheme therefore usually undergoes a series of revisions, amplifications and refinements with a view to accommodating all possible candidate responses. This standardisation process is designed to ensure that all examiners for a particular component mark scripts accurately and consistently. Each examiner must mark consistently over the time of the marking period and also consistently with all other examiners involved.

Standardisation - first stage

The standardisation process has a number of stages. Firstly the principal examiner and any other senior examiners such as assistant principal examiners or team leaders carry out some trial marking of candidates' scripts to see how well the provisional mark scheme works ie to what extent it accommodates the full range of possible candidates' responses to each question or task. The senior examining personnel then meet to discuss their findings. Where necessary the mark scheme is revised and expanded upon so that it includes all possible answers. The aim is to provide as much guidance as possible to all examiners, so that the scope for subjective judgements (and hence for variability in the marking) is reduced to the minimum.

Standardisation of examiners

Shortly after the revised mark scheme has been produced (usually on the following day) the standardisation meeting for all examiners takes place. The purpose of the standardisation meeting is to ensure that all examiners have a well-founded and common understanding of the requirements of the mark scheme and can apply it reliably. The QCA Code of Practice requires all examiners to attend this meeting in order to be allowed to mark.

Before the standardisation meeting, examiners will have received the provisional mark scheme and some of their allocation of scripts for marking. They will have familiarised themselves with it and have tried to apply it to a sample of 'live scripts'.

Examiners' standardisation meeting

At the standardisation meeting, all examiners receive the revised mark scheme provided by the principal examiner. After an administrative briefing, the examiners are given a full, detailed explanation of the mark scheme and how to apply it to candidates' answers, including any unexpected yet acceptable responses. They carry out some trial marking of scripts (which may be common photocopied scripts) provided by the principal examiner and compare their marking with that agreed by the principal examiner and any other senior examining personnel. They may also mention any queries raised by their own trial marking, which may lead to further revisions to the mark scheme.

After the standardisation meeting

By the end of the standardisation meeting, all examiners must have a shared understanding of the mark scheme and should feel confident that they will be able to apply it reliably and consistently over the marking period. Where changes have been made to the mark scheme in the course of the standardisation meeting, a revised mark scheme must be produced by the awarding body officer and sent to all examiners before they can start their marking. Once marking is underway, no changes can be made to the finalised marking scheme. In due course this finalised mark scheme is published to schools and colleges, to enable teachers to understand how their candidates' work was marked.