Skip to main content
Back to home
AI assessment

AI assessment for data analysts

Rubric-graded, human signed-off. Not a quiz generator.

Try it free

Free plan - no card required.

Scorafy is the assessment-feedback layer for data analytics bootcamps and academies. It reads a learner's actual submission - a written analysis, SQL or query code, a notebook, a dashboard explanation or a recorded walkthrough - then scores it against your own rubric with cited evidence taken from the work. An instructor reviews every result and signs off before it is recorded, so no judgement is made by software alone. It is not an LMS or an auto-grader - it reads the analysis the way an instructor would and handles the grading and feedback alongside the tools you already use.

What you assess for data analysis skills

  • Framing the right question and choosing an analysis approach that actually answers it, not just running a default method
  • Cleaning and preparing data correctly, including handling missing values, outliers and obvious data-quality issues
  • Interpreting results honestly, including stating assumptions, limitations and what the data does not support
  • Communicating findings to a non-technical audience, with a clear takeaway rather than a wall of charts
  • Justifying the choice of metric, segment or visualisation, and explaining why it fits the question

A worked rubric criterion

You define the criteria and levels. Scorafy grades each answer against them, with the evidence.

Criterion

Interprets the results of an analysis and states what they do and do not support

1Not yet competent - overstates the findings, confuses correlation with causation, ignores obvious limitations, or presents a chart with no clear takeaway
2Competent - draws conclusions the data supports, states the key assumptions and limitations, and communicates a clear takeaway tied back to the original question
3Exemplary - quantifies the uncertainty, flags where the data could mislead, proposes the next analysis that would strengthen the conclusion, and tailors the message to the decision the audience has to make

Why a quiz won't cut it

A quiz can check whether a learner knows what a p-value is, but it cannot show whether they would frame the right question, spot a data-quality problem, or resist overstating a result. Analytical skill lives in judgement - what they choose to measure, how they handle messy data, how honestly they read the output. That only shows up in the actual analysis and how they explain it. Scorafy grades that open-ended evidence against your rubric, so you assess the thinking, not the trivia.

Written, video, audio or file

A recorded walkthrough is valuable for data work because presenting findings is part of the job. A learner can upload a screen recording where they talk through a dashboard or notebook and explain their reasoning, plus the query code and written analysis. Scorafy reads all of it against your rubric, so a learner who communicates an insight clearly on camera is assessed on that communication, not just on the code.

A qualified person signs off

Scorafy drafts the scoring against your rubric and references the evidence. A qualified assessor reviews every result, overrides anything, and finalises it. The AI score is kept alongside the human-final score as an audit trail, so no decision is solely automated and every result can be explained.

Compliance and defensibility

Bootcamp results decide whether a learner is signed off as job-ready, so the human check matters. Scorafy is built compliance-first under the GDPR and the EU AI Act. An instructor reviews and signs off every result - there is no solely-automated decision about whether a learner has met the standard. Every score keeps an audit trail showing the cited evidence and the instructor who confirmed it, which is what you show learners or an accreditation body when a result is questioned.

Frequently asked questions

Can Scorafy assess SQL or a notebook, not just a written report?

Yes. A learner can submit query code, a notebook, a written analysis and a recorded walkthrough. Scorafy reads all of it as evidence against your rubric and cites what supports each judgement, then an instructor reviews and signs off.

Does it check whether the numbers are technically correct?

It assesses the analysis against the criteria you set, including reasoning and interpretation, and cites the evidence. It is not a calculation engine, so if your rubric needs an exact-answer check, run that alongside and use Scorafy for the judgement and communication.

Does software decide whether a learner passes?

No. Scorafy drafts the scoring against your rubric and shows its reasoning, but an instructor reviews, can override any score, and signs off before the result is recorded. No pass decision is made by software alone.

Is Scorafy a data platform or LMS?

No. Scorafy is the assessment-feedback layer. It grades open-ended analysis work and gives feedback against your rubric, and it works alongside whatever LMS or data tools you already use.

See it on your own rubric

Start free, build one rubric, and run a real submission through it before you decide.