Analyze quality method

How we check Analyze before it tells you anything

Analyze shows a report in a language only after it passes a test on published public-domain prose in that language: 185 of 250 report and language pairs pass today. Each consistency check must also find errors planted in 80 random passages per language, on books it was tuned on and on text it never saw. Analyze gives no score and makes no prediction.

Every number on this page is generated from the test suite. Last checked against the code on 2026-11-06.

185 of 250
report and language pairs that pass the calibration gate
22
consistency checks shown, each passing on golden texts and unseen books
18
checks measured and kept hidden until they pass
69
public-domain books behind the genre benchmarks

The calibration gate

A report runs in a language only after it passes there

Every report Analyze runs without AI is tested on real prose, in every language it claims. The texts are a golden corpus of 14 public-domain works in 10 languages, so nothing in the test is synthetic.

  • Its numbers must land inside the range that edited, published prose actually occupies in that language.
  • A language joins a report only with a golden text and passing numbers. Anywhere else Analyze says the report is not available in that language, instead of showing a number nobody has checked.
  • Every result carries the report's version, so a run from before a recalibration is never compared with one after it as if nothing had changed.
Which reports pass in which language (25 reports, 10 languages)

Passes, shownNot yet, hidden

Which reports pass in which language (25 reports, 10 languages)
ReportENESFRDEITPTJAKOHEAR
Sticky sentencesSticky sentences in English: passes, shownSticky sentences in Spanish: passes, shownSticky sentences in French: passes, shownSticky sentences in German: passes, shownSticky sentences in Italian: passes, shownSticky sentences in Portuguese: passes, shownSticky sentences in Japanese: not calibrated yet, hiddenSticky sentences in Korean: not calibrated yet, hiddenSticky sentences in Hebrew: passes, shownSticky sentences in Arabic: passes, shown
EchoesEchoes in English: passes, shownEchoes in Spanish: passes, shownEchoes in French: passes, shownEchoes in German: passes, shownEchoes in Italian: passes, shownEchoes in Portuguese: passes, shownEchoes in Japanese: passes, shownEchoes in Korean: passes, shownEchoes in Hebrew: not calibrated yet, hiddenEchoes in Arabic: not calibrated yet, hidden
Filter wordsFilter words in English: passes, shownFilter words in Spanish: passes, shownFilter words in French: passes, shownFilter words in German: passes, shownFilter words in Italian: passes, shownFilter words in Portuguese: passes, shownFilter words in Japanese: passes, shownFilter words in Korean: passes, shownFilter words in Hebrew: passes, shownFilter words in Arabic: passes, shown
Weak modifiersWeak modifiers in English: passes, shownWeak modifiers in Spanish: passes, shownWeak modifiers in French: passes, shownWeak modifiers in German: passes, shownWeak modifiers in Italian: passes, shownWeak modifiers in Portuguese: passes, shownWeak modifiers in Japanese: passes, shownWeak modifiers in Korean: passes, shownWeak modifiers in Hebrew: passes, shownWeak modifiers in Arabic: passes, shown
GrammarGrammar in English: passes, shownGrammar in Spanish: not calibrated yet, hiddenGrammar in French: not calibrated yet, hiddenGrammar in German: not calibrated yet, hiddenGrammar in Italian: not calibrated yet, hiddenGrammar in Portuguese: not calibrated yet, hiddenGrammar in Japanese: passes, shownGrammar in Korean: not calibrated yet, hiddenGrammar in Hebrew: not calibrated yet, hiddenGrammar in Arabic: not calibrated yet, hidden
Sensory balanceSensory balance in English: passes, shownSensory balance in Spanish: passes, shownSensory balance in French: passes, shownSensory balance in German: passes, shownSensory balance in Italian: passes, shownSensory balance in Portuguese: passes, shownSensory balance in Japanese: passes, shownSensory balance in Korean: passes, shownSensory balance in Hebrew: not calibrated yet, hiddenSensory balance in Arabic: not calibrated yet, hidden
DialogueDialogue in English: passes, shownDialogue in Spanish: passes, shownDialogue in French: passes, shownDialogue in German: passes, shownDialogue in Italian: passes, shownDialogue in Portuguese: passes, shownDialogue in Japanese: passes, shownDialogue in Korean: passes, shownDialogue in Hebrew: passes, shownDialogue in Arabic: passes, shown
CharactersCharacters in English: passes, shownCharacters in Spanish: passes, shownCharacters in French: passes, shownCharacters in German: passes, shownCharacters in Italian: passes, shownCharacters in Portuguese: passes, shownCharacters in Japanese: passes, shownCharacters in Korean: passes, shownCharacters in Hebrew: not calibrated yet, hiddenCharacters in Arabic: not calibrated yet, hidden
Point of viewPoint of view in English: passes, shownPoint of view in Spanish: passes, shownPoint of view in French: passes, shownPoint of view in German: passes, shownPoint of view in Italian: passes, shownPoint of view in Portuguese: passes, shownPoint of view in Japanese: passes, shownPoint of view in Korean: not calibrated yet, hiddenPoint of view in Hebrew: not calibrated yet, hiddenPoint of view in Arabic: not calibrated yet, hidden
Style driftStyle drift in English: passes, shownStyle drift in Spanish: not calibrated yet, hiddenStyle drift in French: not calibrated yet, hiddenStyle drift in German: not calibrated yet, hiddenStyle drift in Italian: not calibrated yet, hiddenStyle drift in Portuguese: not calibrated yet, hiddenStyle drift in Japanese: passes, shownStyle drift in Korean: not calibrated yet, hiddenStyle drift in Hebrew: not calibrated yet, hiddenStyle drift in Arabic: not calibrated yet, hidden
PacingPacing in English: passes, shownPacing in Spanish: passes, shownPacing in French: passes, shownPacing in German: passes, shownPacing in Italian: passes, shownPacing in Portuguese: passes, shownPacing in Japanese: passes, shownPacing in Korean: passes, shownPacing in Hebrew: passes, shownPacing in Arabic: passes, shown
Reading timeReading time in English: passes, shownReading time in Spanish: passes, shownReading time in French: passes, shownReading time in German: passes, shownReading time in Italian: passes, shownReading time in Portuguese: passes, shownReading time in Japanese: passes, shownReading time in Korean: not calibrated yet, hiddenReading time in Hebrew: passes, shownReading time in Arabic: passes, shown
Tense slipsTense slips in English: passes, shownTense slips in Spanish: not calibrated yet, hiddenTense slips in French: not calibrated yet, hiddenTense slips in German: not calibrated yet, hiddenTense slips in Italian: not calibrated yet, hiddenTense slips in Portuguese: not calibrated yet, hiddenTense slips in Japanese: not calibrated yet, hiddenTense slips in Korean: not calibrated yet, hiddenTense slips in Hebrew: not calibrated yet, hiddenTense slips in Arabic: not calibrated yet, hidden
Themes and motifsThemes and motifs in English: passes, shownThemes and motifs in Spanish: passes, shownThemes and motifs in French: passes, shownThemes and motifs in German: passes, shownThemes and motifs in Italian: passes, shownThemes and motifs in Portuguese: passes, shownThemes and motifs in Japanese: passes, shownThemes and motifs in Korean: not calibrated yet, hiddenThemes and motifs in Hebrew: not calibrated yet, hiddenThemes and motifs in Arabic: not calibrated yet, hidden
Threads and payoffsThreads and payoffs in English: passes, shownThreads and payoffs in Spanish: passes, shownThreads and payoffs in French: passes, shownThreads and payoffs in German: passes, shownThreads and payoffs in Italian: passes, shownThreads and payoffs in Portuguese: passes, shownThreads and payoffs in Japanese: passes, shownThreads and payoffs in Korean: passes, shownThreads and payoffs in Hebrew: not calibrated yet, hiddenThreads and payoffs in Arabic: not calibrated yet, hidden
ConsistencyConsistency in English: passes, shownConsistency in Spanish: passes, shownConsistency in French: passes, shownConsistency in German: passes, shownConsistency in Italian: passes, shownConsistency in Portuguese: passes, shownConsistency in Japanese: passes, shownConsistency in Korean: passes, shownConsistency in Hebrew: passes, shownConsistency in Arabic: passes, shown
Style sheetStyle sheet in English: passes, shownStyle sheet in Spanish: passes, shownStyle sheet in French: passes, shownStyle sheet in German: passes, shownStyle sheet in Italian: passes, shownStyle sheet in Portuguese: passes, shownStyle sheet in Japanese: passes, shownStyle sheet in Korean: passes, shownStyle sheet in Hebrew: passes, shownStyle sheet in Arabic: passes, shown
Advanced statisticsAdvanced statistics in English: passes, shownAdvanced statistics in Spanish: passes, shownAdvanced statistics in French: passes, shownAdvanced statistics in German: passes, shownAdvanced statistics in Italian: passes, shownAdvanced statistics in Portuguese: passes, shownAdvanced statistics in Japanese: passes, shownAdvanced statistics in Korean: passes, shownAdvanced statistics in Hebrew: passes, shownAdvanced statistics in Arabic: passes, shown
Narrative arcNarrative arc in English: passes, shownNarrative arc in Spanish: not calibrated yet, hiddenNarrative arc in French: not calibrated yet, hiddenNarrative arc in German: not calibrated yet, hiddenNarrative arc in Italian: not calibrated yet, hiddenNarrative arc in Portuguese: not calibrated yet, hiddenNarrative arc in Japanese: not calibrated yet, hiddenNarrative arc in Korean: not calibrated yet, hiddenNarrative arc in Hebrew: not calibrated yet, hiddenNarrative arc in Arabic: not calibrated yet, hidden
Translation checkTranslation check in English: passes, shownTranslation check in Spanish: passes, shownTranslation check in French: passes, shownTranslation check in German: passes, shownTranslation check in Italian: passes, shownTranslation check in Portuguese: not calibrated yet, hiddenTranslation check in Japanese: not calibrated yet, hiddenTranslation check in Korean: not calibrated yet, hiddenTranslation check in Hebrew: not calibrated yet, hiddenTranslation check in Arabic: not calibrated yet, hidden
Narrator prepNarrator prep in English: passes, shownNarrator prep in Spanish: passes, shownNarrator prep in French: passes, shownNarrator prep in German: passes, shownNarrator prep in Italian: passes, shownNarrator prep in Portuguese: passes, shownNarrator prep in Japanese: passes, shownNarrator prep in Korean: passes, shownNarrator prep in Hebrew: passes, shownNarrator prep in Arabic: passes, shown
Quoted materialQuoted material in English: passes, shownQuoted material in Spanish: passes, shownQuoted material in French: passes, shownQuoted material in German: passes, shownQuoted material in Italian: passes, shownQuoted material in Portuguese: passes, shownQuoted material in Japanese: passes, shownQuoted material in Korean: passes, shownQuoted material in Hebrew: passes, shownQuoted material in Arabic: passes, shown
Plain languagePlain language in English: passes, shownPlain language in Spanish: not calibrated yet, hiddenPlain language in French: not calibrated yet, hiddenPlain language in German: not calibrated yet, hiddenPlain language in Italian: not calibrated yet, hiddenPlain language in Portuguese: not calibrated yet, hiddenPlain language in Japanese: not calibrated yet, hiddenPlain language in Korean: not calibrated yet, hiddenPlain language in Hebrew: not calibrated yet, hiddenPlain language in Arabic: not calibrated yet, hidden
Citations and signpostingCitations and signposting in English: passes, shownCitations and signposting in Spanish: passes, shownCitations and signposting in French: passes, shownCitations and signposting in German: passes, shownCitations and signposting in Italian: passes, shownCitations and signposting in Portuguese: passes, shownCitations and signposting in Japanese: passes, shownCitations and signposting in Korean: passes, shownCitations and signposting in Hebrew: passes, shownCitations and signposting in Arabic: passes, shown
Beta readersBeta readers in English: passes, shownBeta readers in Spanish: passes, shownBeta readers in French: passes, shownBeta readers in German: passes, shownBeta readers in Italian: passes, shownBeta readers in Portuguese: passes, shownBeta readers in Japanese: passes, shownBeta readers in Korean: passes, shownBeta readers in Hebrew: passes, shownBeta readers in Arabic: passes, shown

A dash is a report that stays hidden in that language until it passes. For example, there is no "Sticky sentences" report in Japanese and Korean: their grammar, not the writing, would drive the measure.

Planted errors

Consistency checks have to find errors we plant

Consistency findings (US or UK spelling, hyphens, numbers, dates, capitals, punctuation, Lore names, kanji and kana) are tested by planting errors. Per language we cut 40 random passages of about 1,000 words with each of 2 random seeds, check each passage as it is, then plant one error at a time with a program and see whether Analyze finds it.

  • An error is planted only where the passage uses the form 3 or more times, so the planted form is always in the minority.
  • Precision at least 0.85: of the findings a check reports in a planted passage, that share or more must be the planted error.
  • At most 1 finding per ten passages with nothing planted, and at least 5 planted errors, or it is not a measurement. Variation the book really has, checked by hand in the source, is reported apart and not counted as a clean finding.
  • It must pass on the golden texts it was tuned on and on 12 unseen books it was never tuned on: Project Gutenberg novels, the parts of the Japanese, Korean and Arabic novels outside the golden excerpts, and a Hebrew novel.
Precision of every check shown, per language (80 passages per language and per set)

Golden texts (tuned on)Unseen books (never tuned on)The bar: 0.85

  • US or UK spelling, EnglishUS or UK spelling, English: precision 0.94 on golden texts, 1.00 on unseen books
  • Numbers, EnglishNumbers, English: precision 0.93 on golden texts, 0.93 on unseen books
  • Punctuation, EnglishPunctuation, English: precision 0.98 on golden texts, 0.97 on unseen books
  • Lore names, EnglishLore names, English: precision 1.00 on golden texts, 0.97 on unseen books
  • Numbers, SpanishNumbers, Spanish: precision 1.00 on golden texts, 1.00 on unseen books
  • Capitals, SpanishCapitals, Spanish: precision 1.00 on golden texts, 0.96 on unseen books
  • Numbers, FrenchNumbers, French: precision 1.00 on golden texts, 1.00 on unseen books
  • Capitals, FrenchCapitals, French: precision 1.00 on golden texts, 0.89 on unseen books
  • Punctuation, FrenchPunctuation, French: precision 1.00 on golden texts, 0.98 on unseen books
  • Lore names, FrenchLore names, French: precision 1.00 on golden texts, 0.92 on unseen books
  • Numbers, GermanNumbers, German: precision 1.00 on golden texts, 1.00 on unseen books
  • Lore names, GermanLore names, German: precision 1.00 on golden texts, 0.97 on unseen books
  • Punctuation, ItalianPunctuation, Italian: precision 1.00 on golden texts, 0.98 on unseen books
  • Lore names, ItalianLore names, Italian: precision 1.00 on golden texts, 1.00 on unseen books
  • Numbers, PortugueseNumbers, Portuguese: precision 1.00 on golden texts, 0.89 on unseen books
  • Capitals, PortugueseCapitals, Portuguese: precision 1.00 on golden texts, 0.98 on unseen books
  • Punctuation, PortuguesePunctuation, Portuguese: precision 1.00 on golden texts, 0.95 on unseen books
  • Punctuation, JapanesePunctuation, Japanese: precision 1.00 on golden texts, 1.00 on unseen books
  • Kanji and kana, JapaneseKanji and kana, Japanese: precision 1.00 on golden texts, 0.96 on unseen books
  • Punctuation, KoreanPunctuation, Korean: precision 0.92 on golden texts, 1.00 on unseen books
  • Punctuation, HebrewPunctuation, Hebrew: precision 1.00 on golden texts, 1.00 on unseen books
  • Punctuation, ArabicPunctuation, Arabic: precision 1.00 on golden texts, 1.00 on unseen books

Precision: the share of findings that are the planted error

Show every measured check as a table, with recall
US or UK spelling, English · Shown: Yes
Golden texts (tuned on)Planted errors found: 33 of 34; precision 0.94; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 9 of 9; precision 1.00; 0.6 findings per 10 passages with nothing planted
Hyphenation, English · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 5 of 5; precision 1.00; 1.0 findings per 10 passages with nothing planted
Numbers, English · Shown: Yes
Golden texts (tuned on)Planted errors found: 39 of 48; precision 0.93; 0.4 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 27 of 27; precision 0.93; 0.8 findings per 10 passages with nothing planted
Dates, English · Shown: No
Golden texts (tuned on)No planted error (nothing to plant), 0.4 clean findings per 10 passages
Unseen books (never tuned on)Nothing to plant
Capitals, English · Shown: No
Golden texts (tuned on)Planted errors found: 48 of 48; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 54 of 58; precision 0.86; 1.9 findings per 10 passages with nothing planted
Punctuation, English · Shown: Yes
Golden texts (tuned on)Planted errors found: 79 of 79; precision 0.98; 0.3 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 68 of 68; precision 0.97; 0.1 findings per 10 passages with nothing planted
Lore names, English · Shown: Yes
Golden texts (tuned on)Planted errors found: 62 of 62; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 64 of 64; precision 0.97; 0.3 findings per 10 passages with nothing planted
Numbers, Spanish · Shown: Yes
Golden texts (tuned on)Planted errors found: 47 of 47; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 30 of 31; precision 1.00; 0.5 findings per 10 passages with nothing planted
Capitals, Spanish · Shown: Yes
Golden texts (tuned on)Planted errors found: 36 of 39; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 46 of 50; precision 0.96; 0.3 findings per 10 passages with nothing planted
Punctuation, Spanish · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 93 of 93; precision 1.00; 0.0 findings per 10 passages with nothing planted
Lore names, Spanish · Shown: No
Golden texts (tuned on)Planted errors found: 67 of 67; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 70 of 70; precision 0.88; 1.3 findings per 10 passages with nothing planted
US or UK spelling, French · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)No planted error (nothing to plant), 0.4 clean findings per 10 passages
Hyphenation, French · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 9 of 11; precision 1.00; 0.1 findings per 10 passages with nothing planted
Numbers, French · Shown: Yes
Golden texts (tuned on)Planted errors found: 50 of 50; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 56 of 58; precision 1.00; 0.0 findings per 10 passages with nothing planted
Capitals, French · Shown: Yes
Golden texts (tuned on)Planted errors found: 37 of 37; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 17 of 17; precision 0.89; 0.5 findings per 10 passages with nothing planted
Punctuation, French · Shown: Yes
Golden texts (tuned on)Planted errors found: 49 of 49; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 51 of 52; precision 0.98; 0.0 findings per 10 passages with nothing planted
Lore names, French · Shown: Yes
Golden texts (tuned on)Planted errors found: 78 of 78; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 70 of 70; precision 0.92; 0.8 findings per 10 passages with nothing planted
Numbers, German · Shown: Yes
Golden texts (tuned on)Planted errors found: 54 of 54; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 34 of 36; precision 1.00; 0.0 findings per 10 passages with nothing planted
Capitals, German · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)No planted error (nothing to plant), 0.3 clean findings per 10 passages
Punctuation, German · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 43 of 43; precision 0.98; 0.1 findings per 10 passages with nothing planted
Lore names, German · Shown: Yes
Golden texts (tuned on)Planted errors found: 80 of 80; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 76 of 77; precision 0.97; 0.3 findings per 10 passages with nothing planted
Hyphenation, Italian · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 1 of 1; precision 1.00; 0.1 findings per 10 passages with nothing planted
Numbers, Italian · Shown: No
Golden texts (tuned on)Planted errors found: 58 of 58; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 47 of 47; precision 0.80; 3.5 findings per 10 passages with nothing planted
Capitals, Italian · Shown: No
Golden texts (tuned on)Planted errors found: 63 of 72; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 36 of 36; precision 0.84; 1.3 findings per 10 passages with nothing planted
Punctuation, Italian · Shown: Yes
Golden texts (tuned on)Planted errors found: 77 of 77; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 122 of 122; precision 0.98; 0.4 findings per 10 passages with nothing planted
Lore names, Italian · Shown: Yes
Golden texts (tuned on)Planted errors found: 80 of 80; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 50 of 50; precision 1.00; 0.6 findings per 10 passages with nothing planted
US or UK spelling, Portuguese · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)No planted error (nothing to plant), 0.5 clean findings per 10 passages
Hyphenation, Portuguese · Shown: No
Golden texts (tuned on)Planted errors found: 5 of 5; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 1 of 1; precision 1.00; 0.9 findings per 10 passages with nothing planted
Numbers, Portuguese · Shown: Yes
Golden texts (tuned on)Planted errors found: 43 of 43; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 50 of 51; precision 0.89; 1.0 findings per 10 passages with nothing planted
Capitals, Portuguese · Shown: Yes
Golden texts (tuned on)Planted errors found: 21 of 21; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 45 of 46; precision 0.98; 0.1 findings per 10 passages with nothing planted
Punctuation, Portuguese · Shown: Yes
Golden texts (tuned on)Planted errors found: 110 of 110; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 59 of 62; precision 0.95; 0.3 findings per 10 passages with nothing planted
Lore names, Portuguese · Shown: No
Golden texts (tuned on)Planted errors found: 67 of 73; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 60 of 61; precision 0.90; 1.4 findings per 10 passages with nothing planted
Punctuation, Japanese · Shown: Yes
Golden texts (tuned on)Planted errors found: 77 of 77; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 65 of 65; precision 1.00; 0.0 findings per 10 passages with nothing planted
Kanji and kana, Japanese · Shown: Yes
Golden texts (tuned on)Planted errors found: 76 of 76; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 72 of 72; precision 0.96; 0.4 findings per 10 passages with nothing planted
Punctuation, Korean · Shown: Yes
Golden texts (tuned on)Planted errors found: 98 of 107; precision 0.92; 0.8 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 111 of 111; precision 1.00; 0.0 findings per 10 passages with nothing planted
Hyphenation, Hebrew · Shown: No
Golden texts (tuned on)No planted error (nothing to plant), 2.5 clean findings per 10 passages
Unseen books (never tuned on)Nothing to plant
Punctuation, Hebrew · Shown: Yes
Golden texts (tuned on)Planted errors found: 154 of 154; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 82 of 82; precision 1.00; 0.0 findings per 10 passages with nothing planted
Lore names, Hebrew · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 80 of 80; precision 0.71; 4.1 findings per 10 passages with nothing planted
Punctuation, Arabic · Shown: Yes
Golden texts (tuned on)Planted errors found: 60 of 60; precision 1.00; 0.0 findings per 10 passages with nothing planted
Unseen books (never tuned on)Planted errors found: 98 of 98; precision 1.00; 0.0 findings per 10 passages with nothing planted
Lore names, Arabic · Shown: No
Golden texts (tuned on)Nothing to plant
Unseen books (never tuned on)Planted errors found: 43 of 43; precision 1.00; 0.0 findings per 10 passages with nothing planted

18 measured checks stay hidden

A check stays hidden in a language until it passes on both sets. These were measured and are not shown today, each with its reason.

  • Hyphenation, EnglishToo few planted errors on the golden texts to measure (fewer than 5).
  • Dates, EnglishToo few planted errors on the golden texts to measure (fewer than 5).
  • Capitals, EnglishBelow the bar on the unseen books: precision 0.86, 1.9 clean findings per 10 passages, 58 planted.
  • Punctuation, SpanishToo few planted errors on the golden texts to measure (fewer than 5).
  • Lore names, SpanishBelow the bar on the unseen books: precision 0.88, 1.3 clean findings per 10 passages, 70 planted.
  • US or UK spelling, FrenchToo few planted errors on the golden texts to measure (fewer than 5).
  • Hyphenation, FrenchToo few planted errors on the golden texts to measure (fewer than 5).
  • Capitals, GermanToo few planted errors on the golden texts to measure (fewer than 5).
  • Punctuation, GermanToo few planted errors on the golden texts to measure (fewer than 5).
  • Hyphenation, ItalianToo few planted errors on the golden texts to measure (fewer than 5).
  • Numbers, ItalianBelow the bar on the unseen books: precision 0.80, 3.5 clean findings per 10 passages, 47 planted.
  • Capitals, ItalianBelow the bar on the unseen books: precision 0.84, 1.3 clean findings per 10 passages, 36 planted.
  • US or UK spelling, PortugueseToo few planted errors on the golden texts to measure (fewer than 5).
  • Hyphenation, PortugueseToo few planted errors on the unseen books to measure (fewer than 5).
  • Lore names, PortugueseBelow the bar on the unseen books: precision 0.90, 1.4 clean findings per 10 passages, 61 planted.
  • Hyphenation, HebrewToo few planted errors on the golden texts to measure (fewer than 5).
  • Lore names, HebrewToo few planted errors on the golden texts to measure (fewer than 5).
  • Lore names, ArabicToo few planted errors on the golden texts to measure (fewer than 5).

AI sections

AI findings quote your text, and their recall number comes later

Analyze's AI sections are evaluated on a replay corpus in English, Korean, and Japanese. Every quote an AI finding shows is checked word for word against your manuscript before it is shown.

  • The planted-flaw test set is built: public-domain chapters with a point-of-view slip, a timeline break, a repeated scene, an info-dump or a dropped thread injected, scored on whether the flaw is among the top 3 findings.
  • We will publish that recall number once the per-chapter AI pass ships. Until then we quote none.
  • None of the 25 reports above uses a language model. AI sections run only when you start them.

Genre benchmarks

Benchmarks come from public-domain books only

Genre ranges are measured with the same reports Analyze runs, on 69 public-domain books in their original language, published before 1931 by authors dead more than 70 years. A range needs 3 or more books, and only the numbers are kept, never the text. Old books make the ranges weaker for modern genres, and Analyze says so beside every one.

Books measured per language (176 ranges in all)
  • English41 books, 98 ranges
  • Spanish5 books, 14 ranges
  • French9 books, 22 ranges
  • German5 books, 14 ranges
  • Italian4 books, 14 ranges
  • Portuguese5 books, 14 ranges
  • JapaneseNone yet
  • KoreanNone yet
  • HebrewNone yet
  • ArabicNone yet

Measured on 2026-11-05. A language with no bar has no range yet, so Analyze shows none there.

Licences

Every word list has a recorded source and licence

The register lists each one with its source and licence, and a test fails on any list missing from it.

  • The sentiment list is AFINN-165 (Finn Årup Nielsen, Technical University of Denmark), licensed Apache-2.0 and credited in the code.
  • NRC EmoLex is licensed for non-commercial use only, so Plotiar does not ship it or any other NRC lexicon, and a test fails if one appears.
  • The LIWC dictionaries are proprietary and are not used: the narrative arc uses Plotiar's own open word lists.
  • Lists written for Plotiar (clichés, filter and sense words, tone words) are original, and the common-word lists are derived from public-domain books.

No score, no prediction

Measurements and findings, never a verdict

Analyze has no overall score out of 100 and makes no prediction about whether a book will sell, find an agent or be accepted. It shows what it measured and where, each finding linked to its passage, and what to change stays your decision.

Read the Analyze docs

Questions

Questions about the method

Short answers about how Analyze is tested today.

  • Because it has not passed its test in that language yet. A report joins a language only with a public-domain golden text and numbers inside the range published prose occupies; until then Analyze says it is not available rather than show an unchecked number.

  • Of all the findings a check reports in a passage with one planted error, a share of at least 0.85 must be that error. A check below the bar on the golden texts or on the unseen books stays hidden in that language.

  • No. They come only from 69 public-domain books. Plotiar never uses your manuscript to build benchmarks.

  • Not yet. The planted-flaw test set exists, and we will publish its recall once the per-chapter AI pass ships. Until then we quote no number.

  • They are generated from the test suite, not typed by hand. A test rebuilds them and fails when this page's numbers differ from what the tests measure today.

Try Analyze on your own manuscript

5 reports are free on every plan, one document at a time.

With your permission, we use analytics cookies to see how Plotiar is used and make it better. If you decline, no analytics data is sent. Cookies needed for sign-in and security are always on. Cookie Policy