Skip to main content

Competency sign-off for training cohorts

The AI that marks the answers.

It reads each response against your rubric, cites the lines it scored on, and holds every result until your assessor releases it.

1 assessment · 10 evaluations a month · No card

The Flow view

Branch on the answer. See every path.

Show or hide questions based on previous answers. The Flow view draws every route a respondent can take, so you can check the path before anyone sees it.

Conditional branching is on Starter and above.

The pipeline

Seven steps. One gate.

Every mark on Scorafy goes through the same seven steps. You can inspect all of them.

  1. Rubric

    Your criteria, levels and weights. Up to 10 criteria and 6 levels.

  2. Answer

    Written, spoken, recorded or uploaded, across 26 question types. No account needed.

  3. AI marking

    Claude by Anthropic reads each answer against your rubric. Text in an answer is treated as an answer, never as instructions.

  4. Evidence and confidence

    Each criterion gets a level, the evidence from the answer, and how sure the model is.

  5. Assessor review

    Your assessor checks, overrides and comments. The AI score stays on record beside the override.

  6. ReleaseThen it stops.

    The score reaches the respondent only when an assessor releases it. Who released it, and when, is logged.

  7. Report and record

    The respondent gets their report. The audit pack (PDF and JSON) and your Accuracy page keep the record.

Assessment should be fast and fair. Scorafy does the reading and the first draft. Your assessor keeps the judgement.

Built for accountability

One place to mark, review and release.

Review & release

Every result waits for a person

Read the evidence, override a criterion, then release. The respondent sees nothing before that.

Live rooms

Run the room

Everyone joins by QR. You move them on.

Evidence

Every mark shows its working

The words in the answer that earned it.

Data residency

Your data stays in your region

Hosted in the EU, or in Australia under a residency addendum.

  1. AI marked Noor Haddad · 75% · confidence high
  2. Jo Lee overrode HRIS integration 0 → 0.25"Mentioned SSO - partial credit"
  3. Jo Lee released the result

Audit trail

Who changed what, and why

Who scored it, who overrode it and who released it, with times.

The hidden problem

Two assessors. One answer. Two different marks.

On a borderline response, judgement fills the gap the rubric left. Scorafy does not remove the assessor. It hands them a first draft with the evidence already attached.

Assessor A

80

Read the answer generously. Counted the QR code as an invite link.

Assessor B

55

Read it strictly. No integration named, so no marks for it.

Same answer, same rubric · illustrative example

Markers disagree on open answers. When England's exam regulator checked exam marking against senior examiners, the chance of a candidate getting the “definitive” grade ranged from 0.96 for a maths qualification to 0.52 for an English language and literature qualification. Ofqual notes some answers have more than one legitimate mark. (Ofqual, 2018)

Nothing reaches a respondent until you release it.

The AI drafts. Your assessor decides. Every override is logged with who changed what, and why.

From a live pilot

An online education non-profit is piloting Scorafy in Australia for in-program assessments with adult learners. Every answer is scored against their own criteria, and an assessor signs off before a learner sees a result.

“Both respondents and staff have found the Scorafy recommendations highly actionable, and the platform itself very easy to navigate and use.”
“Feedback has been well received and immediately actioned by Scorafy.”
“As the Product Lead, I have found working with Scorafy to be brilliant - it's been an exciting and dynamic process”
Product and Digital Lead, online education non-profit

Free sample marking

Send 10 answers. Get them back marked in 48 hours.

Send 10 anonymised answers you have already marked, plus your marking guide. We mark them against your own criteria and send them back with the evidence behind every mark. No sign-up, no card.

Request a free sample

Pricing

Pricing that scales with your cohorts.

Start free. Scale to cohort and enterprise volume when you're ready.

MonthlyAnnualSave 25%

Free plan available

1 assessment, 10 AI evaluations per month. No card needed.

Start free

New yearly allowances apply from 1 January 2027. If you subscribe before then, you keep your current allowance until your first renewal after that date.

Starter

$39 /month

Up to 3 team members, plus unlimited assessors

For a single programme or team

  • 3 active assessments now, 10 from 1 January 2027
  • 100 marked responses a month now; from 1 January 2027, 600 a year (50 a month on monthly billing)
  • AI analysis on every response
  • All 26 question types
  • Conditional question branching
  • CSV export
  • Email and docs support
Start with Starter
Most popular

Growth

$99 /month

Up to 10 team members, plus unlimited assessors

For training and enablement teams running several cohorts

  • Everything in Starter, plus:
  • 15 active assessments now, unlimited from 1 January 2027
  • 500 marked responses a month now; from 1 January 2027, 1,800 a year (150 a month on monthly billing)
  • Custom branding (logo, colours, fonts)
  • PDF report export
  • Priority email support
Start growing

Pro

$249 /month

Unlimited team members and assessors

For programmes and companies certifying at volume

  • Everything in Growth, plus:
  • 2,000 marked responses a month now; from 1 January 2027, 4,800 a year (400 a month on monthly billing)
  • Unbranded assessments and reports (no Scorafy branding)
  • API access and webhooks
  • Priority support + onboarding call
Go Pro

For organisations

Business & Enterprise

From US$12,000 a year

A Scale response pool plus the service around it, for teams running assessments at scale. Enterprise is quoted.

Talk to us

Not ready to commit? Start with a paid pilot: US$3,000 for 90 days and up to 300 responses, credited in full to your first year.

Calibration service: US$900 per assessment. We mark up to 50 of your already-marked answers, report agreement by criterion, and tune the rubric before release.

  • A Scale pool of 12,000 to 48,000 responses a year
  • Dedicated onboarding and a named contact
  • Negotiated DPA
  • EU (Dublin) or Australian (Sydney) hosting
  • Canvas set up on your own instance
  • Invoice and PO billing
  • Enterprise above 48,000 responses (quoted)

All prices in USD. One marked response is one completed respondent assessment, evaluated. Annual plans get the whole year's allowance up front. When the allowance is used, marking pauses until you move up a plan or buy a top-up - no surprise bills. Scale plans (annual only) from US$5,400 a year and top-ups from US$150 - see full pricing. Not-for-profits and accredited education providers get 40% off the software.

Questions

Everything you might be wondering.

What counts as an AI evaluation?

One AI evaluation is one completed respondent assessment, evaluated. It is counted when someone completes your assessment and Scorafy generates their report. Partial or abandoned attempts do not count towards your limit. A resit is a new attempt, so it is a new evaluation, and so is regenerating a report. Appeals and changes an assessor makes to marks never count.

Do respondents need to create an account?

No. Respondents click a link and start the assessment. No signup, no friction. If an assessment is timed, respondents see a start screen first - the clock only starts when they press Start - and if they return after finishing they see a completion screen rather than dropping back into the questions.

When do respondents see their results?

When your assessor releases them. Scorafy holds every result - score, evidence, and report - until a human reviewer signs off. You can override any score before release, and overrides are kept on the record.

Can I run timed assessments?

Yes. Set a time limit for the whole assessment, individual questions, or both. The whole-assessment limit is enforced on our server, so it holds even if a respondent's browser is manipulated; per-question limits are too in live sittings.

What AI model do you use?

We use Claude by Anthropic. Every report is generated fresh from the respondent's specific answers - not matched to pre-written text buckets. The AI's score is a first draft - your assessor reviews and releases every result. See how scoring works at /how-scoring-works.

Can I run a whole room through an assessment at once?

Yes. In an assessor-paced live sitting you open one question at a time and everyone in the room answers it together, with instruction screens for briefing and pause-and-discuss beats in between. Sequencing is enforced on the server - the content of a question is not sent to anyone’s browser until you open it, and the platform refuses answers to questions that have not been opened yet. Candidates join by link or QR code, and live sittings are available on every plan, including free.

How do I know which AI marks to check first?

Every mark carries the model’s own confidence for that question, and every criterion carries an explanation of which rubric level was awarded and why. Reviewers work the low-confidence marks first rather than reading every result at the same depth. Your organisation also gets an Accuracy page showing how often your assessors agree with the AI, which questions attract the most overrides, and how each assessor moves scores.

Can respondents get feedback before the score is final?

Yes, if you want that. An assessment can be set to share the written feedback immediately while holding the numeric score back until an assessor signs it off. The score is withheld server-side - it does not reach the browser, and it is kept out of the AI’s written prose too.

Can I provide my own methodology for the AI?

Yes. You can add context, frameworks, rubrics, and grading schemas. The AI uses these to mark against your own standards, in your own terms.

Is there a limit on questions per assessment?

No. All plans allow unlimited questions. We recommend 8 - 25 for the best balance of respondent experience and AI analysis quality.

Is my data secure?

All data is encrypted in transit and at rest, with row-level security isolating every organisation’s data, and MFA available on all accounts. You control response retention per assessment, from 30 to 365 days. We never use your data to train AI models. Full detail on our security page at /security.

See how your answers would be marked.

Choose an assessment, answer it, and read the marking Scorafy writes back. No card needed.