Rubric
Your criteria, levels and weights. Up to 10 criteria and 6 levels.
Trust & Transparency
Transparency about our AI, its capabilities, and its limitations. We believe you should understand exactly how your assessment reports are generated before an assessor releases one.
The process
Each result goes through the same seven steps as every mark on Scorafy. The AI drafts; an assessor decides what is released.
Your criteria, levels and weights. Up to 10 criteria and 6 levels.
Written, spoken, recorded or uploaded, across 26 question types. No account needed.
Claude by Anthropic reads each answer against your rubric. Text in an answer is treated as an answer, never as instructions.
Each criterion gets a level, the evidence from the answer, and how sure the model is.
Your assessor checks, overrides and comments. The AI score stays on record beside the override.
The score reaches the respondent only when an assessor releases it. Who released it, and when, is logged.
The respondent gets their report. The audit pack (PDF and JSON) and your Accuracy page keep the record.
Key point
Every report is unique because every person's answers are unique. This is not template-based feedback. The AI reads and responds to what each individual actually wrote.
Built for reliability
AI-generated feedback is only as good as the structure you give it. Scorafy is built around principles that improve accuracy and reduce the risk of vague or unhelpful output.
Independent research consistently finds that AI scoring of subjective work is far less accurate and less consistent without a rubric. Scorafy's rubric builder gives the AI specific criteria to assess against, and every score is reviewed by your assessor before release.
The AI is instructed to reference specific answers as evidence for its analysis. It does not produce generic statements like "add more examples" - it cites what the respondent actually said and builds its analysis from there.
Reports follow a consistent format - summary, strengths, areas for development, and recommendations - ensuring completeness and making it easy for you to review and compare across respondents.
Reports are generated for the assessment creator to review before sharing. Scorafy is designed as a first draft, not a final word. You remain in the loop at every stage.
Honest about limits
We believe honesty about limitations builds more trust than overclaiming capabilities. Here is what AI assessment cannot do well today.
It does not know that a struggling student just produced their best work, or that an employee had a difficult week. Contextual factors that are obvious to a human are invisible to the AI unless explicitly captured in the assessment.
Research documents that AI tools can show score discrepancies for non-native English speakers and speakers of non-standard English dialects. We take this seriously and encourage assessment creators to consider language diversity when designing questions and reviewing reports.
AI performs best on structured criteria with clear rubrics. Open-ended, creative, or unconventional responses may not be assessed as accurately. The more structured your assessment, the more reliable the output.
Professional judgement should always be the final word. Use AI reports as a starting point for deeper conversation, not as a definitive evaluation of a person's capabilities or potential.
Data handling
Assessment data is sensitive. Here is how we handle it.
For full details, read our Privacy Policy and Terms of Service.
What we stand for
We welcome feedback, questions, and challenges about our AI approach. If something in a report does not look right, or if you have concerns about how the AI handled a particular response, we want to hear about it. Reach out at adam@scorafy.com.
For security and procurement reviews
Our security documentation, retention schedule and completed questionnaire answers, sent by a person rather than a download link. Two documents are public:
See it live
Try the interactive demo to see how Scorafy generates personalised reports from real assessment answers.