Skip to content

Quality and integrity

Fair results, and the record to prove it

Every result is evidence toward a progression decision, so it has to be right. Masterymark keeps results fair and defensible by finding and fixing weak questions, keeping marking consistent across markers and securing every sitting, with a record of every correction and who approved it.

Item quality

When a question misbehaves, fix it once

Item statistics flag weak questions after every sitting, and outside reviewers can check items before results are released. An approved key fix rescores every affected learner automatically, with the approval on record.

  • Difficulty and discrimination for every question
  • Weak items flagged before results are released
  • One governed chain: flag, reason, approve, recompute, release
  • Must-pass critical items: any miss goes to review, whatever the total score
Item-quality plot of discrimination against difficulty with Item 12 flagged, next to three steps: re-key Item 12, rescore all Learners, approve and release.

Fair marking

The same standard from every marker

  • Blind double marking

    Two markers grade blind, and a third settles large gaps between them.

  • Qualified, calibrated examiners

    Only trained, in-date examiners are assigned, and harsh or lenient marking is tracked.

  • One rule everywhere

    Examiner qualification and calibration decide who marks what, the same way across exams, OSCEs and workplace-based assessment.

Exam security

Security chosen per exam

Each exam gets the security it needs, from an open quiz to a high-stakes sitting.

  • Lockdown delivery

    Secure exams run in a lockdown client, so nothing else is open during the sitting.

  • Calculated items

    Each learner gets different numbers to work with, for example in dosage calculations.

  • Similarity checks

    Response similarity and answer-change patterns are checked after the exam.

  • One case file

    Proctoring flags, similarity and answer-change patterns land in one case file that a person reviews before any consequence.

Remote proctoring

Remote exams, with a person in the loop

Automated proctoring watches remote exams and remote OSCE stations, and flags possible integrity issues. A person reviews every flag before it has any consequence for the learner.

  • Automated proctoring for remote exams
  • The same proctoring on remote OSCE stations
  • An optional second camera on the learner's side that shows the room
  • Human review of every flag, before any consequence
A learner camera and a second-device room camera, shown as neutral placeholders, with a possible issue flagged at 12:41 going to a human reviewer, K. Osei, who can choose No issue or Refer: no consequence without review.

Results governance

Every correction and approval, on the record

When a learner appeals or an accreditor asks, the program can show how each result was corrected, approved and released.

  • Moderation, approval and academic standing in an accreditation-ready trail
  • Appeals, extenuating circumstances and deferrals in one register
  • An append-only audit trail, so a result years later is reconstructed as things stood
  • Load-rehearsed exam days, and OSCE circuits that keep running without internet
Block exam 3 results moving through a recorded trail, moderated by J. Ellis, approved by Dr. Holbrook and released on 12 Jun, beside an appeals register with one appeal under review and one deferral approved.

Questions

Quality and integrity questions

What happens when an answer key turns out to be wrong?

The item is flagged, the fix is approved with its reason, and Masterymark rescores every affected learner automatically. The correction and its approval stay on the record.

Can we require learners to pass critical items?

Yes. Programs can mark safety-critical items as must-pass, so any miss goes to review whatever the total score.

How is marking kept consistent?

Two markers grade blind and a third settles large gaps. Only trained, in-date examiners are assigned, and harsh or lenient marking is tracked.

Does remote proctoring decide outcomes on its own?

No. Automated proctoring only flags possible issues. A person reviews every flag before it has any consequence for the learner.

Can different exams have different security?

Yes. Security is chosen per exam: lockdown delivery, remote proctoring, calculated items and post-exam similarity checks, in whatever combination the exam needs.

Be among the first to use Masterymark

Masterymark Early Access is open to colleges and universities in North America. Apply to try it with your own program's assessments, or sign up for updates.