Tested, logged, checked

AI systems can misread, and they can invent text that is not on the page. Collatorium is built so that every reading can be traced back to the image, and every mistake has a chance to be caught.

Three kinds of check

1Testedbefore anything is trusted

Every model is tried on pages whose text people have already checked.

2Loggedthe back of the cloth

Every reading and ruling keeps who or which model, when, and why.

3Checkedat every step

Invented text is flagged; names, numbers and dates go letter by letter.

Tested — before anything is trusted

Known-answer pages

Each AI system reads pages whose text people have already checked. Its score decides how far it is trusted on this archive.

Which model works best as the foundation

Each model takes a turn as the foundation on a sample; the best for this hand leads the full run.

Being built
Rules tried on a sample

The project's rules and signs are tried on a few pages before the full run.

Four-angle rotation test

Every image is described and read at four angles, so nothing is read sideways or upside down.

Checked — at every step

Invented-text check

Text that has no support in the image is flagged, however fluent it reads.

Letter-shape check

Each word's letter shapes (tall, short, tail below) are compared with Transkribus's letters. A word whose shapes do not fit is re-read letter by letter.

Names, numbers and dates

Always read letter by letter, even when every model agrees.

Independent re-reads

Disputed spots are read again by a fresh model that sees only the image, rating each letter: clear, likely, or not seen.

People audit agreed text

Agreement between models is a signal, never proof; people read the text the models agreed on too.

Every change has a ruling

Each new version is compared with the last; any difference without a ruling is stopped.

Counts

Copies are counted against originals, and every image must have a reading and a sign-off.

Logged — what every entry keeps

FieldWhat it records
WhenDate and time
StepWhich step of the process
WhoThe person, or the AI system and its exact model version
SettingsThe prompt and rules version used
WhereThe image, page and line
Before / afterWhat the text said, and what it says now
EvidenceWhy: the readings, the close-up, the letter ratings
ConfidenceHow sure, and anything still open

These logs are Excel workbooks in your Box folder — see what you get.