Skip to content

Reviewer

The Reviewer role is for quality assurance — people who inspect AI-generated scores, validate results, and override grades when the AI evaluation needs adjustment.

What can a Reviewer do?

  • View all assignments and their statuses
  • Inspect score reports with per-criterion breakdowns
  • Override grades when the AI score doesn't reflect actual performance
  • Add notes and feedback to score reports
  • View the dashboard with workspace metrics

Typical workflow

1. Check assignments

  1. Navigate to Assignments in the sidebar
  2. Review the assignment list — look for assignments with status completed or scored
  3. Click on an assignment to see details

2. Review a score report

A score report includes:

Field Description
Overall Score Aggregate score (typically out of 100)
Breakdown Per-criterion scores based on the rubric
Feedback AI-generated qualitative feedback
Recommendations Suggested next steps for the learner

3. Override a score (if needed)

If you disagree with the AI's evaluation:

  1. Open the score report
  2. Click Override on the specific criterion or overall score
  3. Enter the corrected score and a justification note
  4. Save the override

When to override

Common reasons to override an AI score:

  • The AI misinterpreted a learner's intent
  • Cultural or contextual nuance the AI missed
  • Technical issues during the session affected scoring

Best practices

Spot-check, don't review everything

Focus on edge cases — very high or very low scores, first-time learners, and flagged sessions. Trust the AI for routine evaluations.

Document your overrides

Always add a note when overriding a score. This creates an audit trail and helps improve future AI scoring accuracy.