Analyze quality method
How we check Analyze before it tells you anything
Analyze shows a report in a language only after it passes a test on published public-domain prose in that language: 185 of 250 report and language pairs pass today. Each consistency check must also find errors planted in 80 random passages per language, on books it was tuned on and on text it never saw. Analyze gives no score and makes no prediction.
Every number on this page is generated from the test suite. Last checked against the code on 2026-11-06.
- 185 of 250
- report and language pairs that pass the calibration gate
- 22
- consistency checks shown, each passing on golden texts and unseen books
- 18
- checks measured and kept hidden until they pass
- 69
- public-domain books behind the genre benchmarks
The calibration gate
A report runs in a language only after it passes there
Every report Analyze runs without AI is tested on real prose, in every language it claims. The texts are a golden corpus of 14 public-domain works in 10 languages, so nothing in the test is synthetic.
- Its numbers must land inside the range that edited, published prose actually occupies in that language.
- A language joins a report only with a golden text and passing numbers. Anywhere else Analyze says the report is not available in that language, instead of showing a number nobody has checked.
- Every result carries the report's version, so a run from before a recalibration is never compared with one after it as if nothing had changed.
Passes, shownNot yet, hidden
| Report | EN | ES | FR | DE | IT | PT | JA | KO | HE | AR |
|---|---|---|---|---|---|---|---|---|---|---|
| Sticky sentences | Sticky sentences in English: passes, shown | Sticky sentences in Spanish: passes, shown | Sticky sentences in French: passes, shown | Sticky sentences in German: passes, shown | Sticky sentences in Italian: passes, shown | Sticky sentences in Portuguese: passes, shown | Sticky sentences in Japanese: not calibrated yet, hidden | Sticky sentences in Korean: not calibrated yet, hidden | Sticky sentences in Hebrew: passes, shown | Sticky sentences in Arabic: passes, shown |
| Echoes | Echoes in English: passes, shown | Echoes in Spanish: passes, shown | Echoes in French: passes, shown | Echoes in German: passes, shown | Echoes in Italian: passes, shown | Echoes in Portuguese: passes, shown | Echoes in Japanese: passes, shown | Echoes in Korean: passes, shown | Echoes in Hebrew: not calibrated yet, hidden | Echoes in Arabic: not calibrated yet, hidden |
| Filter words | Filter words in English: passes, shown | Filter words in Spanish: passes, shown | Filter words in French: passes, shown | Filter words in German: passes, shown | Filter words in Italian: passes, shown | Filter words in Portuguese: passes, shown | Filter words in Japanese: passes, shown | Filter words in Korean: passes, shown | Filter words in Hebrew: passes, shown | Filter words in Arabic: passes, shown |
| Weak modifiers | Weak modifiers in English: passes, shown | Weak modifiers in Spanish: passes, shown | Weak modifiers in French: passes, shown | Weak modifiers in German: passes, shown | Weak modifiers in Italian: passes, shown | Weak modifiers in Portuguese: passes, shown | Weak modifiers in Japanese: passes, shown | Weak modifiers in Korean: passes, shown | Weak modifiers in Hebrew: passes, shown | Weak modifiers in Arabic: passes, shown |
| Grammar | Grammar in English: passes, shown | Grammar in Spanish: not calibrated yet, hidden | Grammar in French: not calibrated yet, hidden | Grammar in German: not calibrated yet, hidden | Grammar in Italian: not calibrated yet, hidden | Grammar in Portuguese: not calibrated yet, hidden | Grammar in Japanese: passes, shown | Grammar in Korean: not calibrated yet, hidden | Grammar in Hebrew: not calibrated yet, hidden | Grammar in Arabic: not calibrated yet, hidden |
| Sensory balance | Sensory balance in English: passes, shown | Sensory balance in Spanish: passes, shown | Sensory balance in French: passes, shown | Sensory balance in German: passes, shown | Sensory balance in Italian: passes, shown | Sensory balance in Portuguese: passes, shown | Sensory balance in Japanese: passes, shown | Sensory balance in Korean: passes, shown | Sensory balance in Hebrew: not calibrated yet, hidden | Sensory balance in Arabic: not calibrated yet, hidden |
| Dialogue | Dialogue in English: passes, shown | Dialogue in Spanish: passes, shown | Dialogue in French: passes, shown | Dialogue in German: passes, shown | Dialogue in Italian: passes, shown | Dialogue in Portuguese: passes, shown | Dialogue in Japanese: passes, shown | Dialogue in Korean: passes, shown | Dialogue in Hebrew: passes, shown | Dialogue in Arabic: passes, shown |
| Characters | Characters in English: passes, shown | Characters in Spanish: passes, shown | Characters in French: passes, shown | Characters in German: passes, shown | Characters in Italian: passes, shown | Characters in Portuguese: passes, shown | Characters in Japanese: passes, shown | Characters in Korean: passes, shown | Characters in Hebrew: not calibrated yet, hidden | Characters in Arabic: not calibrated yet, hidden |
| Point of view | Point of view in English: passes, shown | Point of view in Spanish: passes, shown | Point of view in French: passes, shown | Point of view in German: passes, shown | Point of view in Italian: passes, shown | Point of view in Portuguese: passes, shown | Point of view in Japanese: passes, shown | Point of view in Korean: not calibrated yet, hidden | Point of view in Hebrew: not calibrated yet, hidden | Point of view in Arabic: not calibrated yet, hidden |
| Style drift | Style drift in English: passes, shown | Style drift in Spanish: not calibrated yet, hidden | Style drift in French: not calibrated yet, hidden | Style drift in German: not calibrated yet, hidden | Style drift in Italian: not calibrated yet, hidden | Style drift in Portuguese: not calibrated yet, hidden | Style drift in Japanese: passes, shown | Style drift in Korean: not calibrated yet, hidden | Style drift in Hebrew: not calibrated yet, hidden | Style drift in Arabic: not calibrated yet, hidden |
| Pacing | Pacing in English: passes, shown | Pacing in Spanish: passes, shown | Pacing in French: passes, shown | Pacing in German: passes, shown | Pacing in Italian: passes, shown | Pacing in Portuguese: passes, shown | Pacing in Japanese: passes, shown | Pacing in Korean: passes, shown | Pacing in Hebrew: passes, shown | Pacing in Arabic: passes, shown |
| Reading time | Reading time in English: passes, shown | Reading time in Spanish: passes, shown | Reading time in French: passes, shown | Reading time in German: passes, shown | Reading time in Italian: passes, shown | Reading time in Portuguese: passes, shown | Reading time in Japanese: passes, shown | Reading time in Korean: not calibrated yet, hidden | Reading time in Hebrew: passes, shown | Reading time in Arabic: passes, shown |
| Tense slips | Tense slips in English: passes, shown | Tense slips in Spanish: not calibrated yet, hidden | Tense slips in French: not calibrated yet, hidden | Tense slips in German: not calibrated yet, hidden | Tense slips in Italian: not calibrated yet, hidden | Tense slips in Portuguese: not calibrated yet, hidden | Tense slips in Japanese: not calibrated yet, hidden | Tense slips in Korean: not calibrated yet, hidden | Tense slips in Hebrew: not calibrated yet, hidden | Tense slips in Arabic: not calibrated yet, hidden |
| Themes and motifs | Themes and motifs in English: passes, shown | Themes and motifs in Spanish: passes, shown | Themes and motifs in French: passes, shown | Themes and motifs in German: passes, shown | Themes and motifs in Italian: passes, shown | Themes and motifs in Portuguese: passes, shown | Themes and motifs in Japanese: passes, shown | Themes and motifs in Korean: not calibrated yet, hidden | Themes and motifs in Hebrew: not calibrated yet, hidden | Themes and motifs in Arabic: not calibrated yet, hidden |
| Threads and payoffs | Threads and payoffs in English: passes, shown | Threads and payoffs in Spanish: passes, shown | Threads and payoffs in French: passes, shown | Threads and payoffs in German: passes, shown | Threads and payoffs in Italian: passes, shown | Threads and payoffs in Portuguese: passes, shown | Threads and payoffs in Japanese: passes, shown | Threads and payoffs in Korean: passes, shown | Threads and payoffs in Hebrew: not calibrated yet, hidden | Threads and payoffs in Arabic: not calibrated yet, hidden |
| Consistency | Consistency in English: passes, shown | Consistency in Spanish: passes, shown | Consistency in French: passes, shown | Consistency in German: passes, shown | Consistency in Italian: passes, shown | Consistency in Portuguese: passes, shown | Consistency in Japanese: passes, shown | Consistency in Korean: passes, shown | Consistency in Hebrew: passes, shown | Consistency in Arabic: passes, shown |
| Style sheet | Style sheet in English: passes, shown | Style sheet in Spanish: passes, shown | Style sheet in French: passes, shown | Style sheet in German: passes, shown | Style sheet in Italian: passes, shown | Style sheet in Portuguese: passes, shown | Style sheet in Japanese: passes, shown | Style sheet in Korean: passes, shown | Style sheet in Hebrew: passes, shown | Style sheet in Arabic: passes, shown |
| Advanced statistics | Advanced statistics in English: passes, shown | Advanced statistics in Spanish: passes, shown | Advanced statistics in French: passes, shown | Advanced statistics in German: passes, shown | Advanced statistics in Italian: passes, shown | Advanced statistics in Portuguese: passes, shown | Advanced statistics in Japanese: passes, shown | Advanced statistics in Korean: passes, shown | Advanced statistics in Hebrew: passes, shown | Advanced statistics in Arabic: passes, shown |
| Narrative arc | Narrative arc in English: passes, shown | Narrative arc in Spanish: not calibrated yet, hidden | Narrative arc in French: not calibrated yet, hidden | Narrative arc in German: not calibrated yet, hidden | Narrative arc in Italian: not calibrated yet, hidden | Narrative arc in Portuguese: not calibrated yet, hidden | Narrative arc in Japanese: not calibrated yet, hidden | Narrative arc in Korean: not calibrated yet, hidden | Narrative arc in Hebrew: not calibrated yet, hidden | Narrative arc in Arabic: not calibrated yet, hidden |
| Translation check | Translation check in English: passes, shown | Translation check in Spanish: passes, shown | Translation check in French: passes, shown | Translation check in German: passes, shown | Translation check in Italian: passes, shown | Translation check in Portuguese: not calibrated yet, hidden | Translation check in Japanese: not calibrated yet, hidden | Translation check in Korean: not calibrated yet, hidden | Translation check in Hebrew: not calibrated yet, hidden | Translation check in Arabic: not calibrated yet, hidden |
| Narrator prep | Narrator prep in English: passes, shown | Narrator prep in Spanish: passes, shown | Narrator prep in French: passes, shown | Narrator prep in German: passes, shown | Narrator prep in Italian: passes, shown | Narrator prep in Portuguese: passes, shown | Narrator prep in Japanese: passes, shown | Narrator prep in Korean: passes, shown | Narrator prep in Hebrew: passes, shown | Narrator prep in Arabic: passes, shown |
| Quoted material | Quoted material in English: passes, shown | Quoted material in Spanish: passes, shown | Quoted material in French: passes, shown | Quoted material in German: passes, shown | Quoted material in Italian: passes, shown | Quoted material in Portuguese: passes, shown | Quoted material in Japanese: passes, shown | Quoted material in Korean: passes, shown | Quoted material in Hebrew: passes, shown | Quoted material in Arabic: passes, shown |
| Plain language | Plain language in English: passes, shown | Plain language in Spanish: not calibrated yet, hidden | Plain language in French: not calibrated yet, hidden | Plain language in German: not calibrated yet, hidden | Plain language in Italian: not calibrated yet, hidden | Plain language in Portuguese: not calibrated yet, hidden | Plain language in Japanese: not calibrated yet, hidden | Plain language in Korean: not calibrated yet, hidden | Plain language in Hebrew: not calibrated yet, hidden | Plain language in Arabic: not calibrated yet, hidden |
| Citations and signposting | Citations and signposting in English: passes, shown | Citations and signposting in Spanish: passes, shown | Citations and signposting in French: passes, shown | Citations and signposting in German: passes, shown | Citations and signposting in Italian: passes, shown | Citations and signposting in Portuguese: passes, shown | Citations and signposting in Japanese: passes, shown | Citations and signposting in Korean: passes, shown | Citations and signposting in Hebrew: passes, shown | Citations and signposting in Arabic: passes, shown |
| Beta readers | Beta readers in English: passes, shown | Beta readers in Spanish: passes, shown | Beta readers in French: passes, shown | Beta readers in German: passes, shown | Beta readers in Italian: passes, shown | Beta readers in Portuguese: passes, shown | Beta readers in Japanese: passes, shown | Beta readers in Korean: passes, shown | Beta readers in Hebrew: passes, shown | Beta readers in Arabic: passes, shown |
A dash is a report that stays hidden in that language until it passes. For example, there is no "Sticky sentences" report in Japanese and Korean: their grammar, not the writing, would drive the measure.
Planted errors
Consistency checks have to find errors we plant
Consistency findings (US or UK spelling, hyphens, numbers, dates, capitals, punctuation, Lore names, kanji and kana) are tested by planting errors. Per language we cut 40 random passages of about 1,000 words with each of 2 random seeds, check each passage as it is, then plant one error at a time with a program and see whether Analyze finds it.
- An error is planted only where the passage uses the form 3 or more times, so the planted form is always in the minority.
- Precision at least 0.85: of the findings a check reports in a planted passage, that share or more must be the planted error.
- At most 1 finding per ten passages with nothing planted, and at least 5 planted errors, or it is not a measurement. Variation the book really has, checked by hand in the source, is reported apart and not counted as a clean finding.
- It must pass on the golden texts it was tuned on and on 12 unseen books it was never tuned on: Project Gutenberg novels, the parts of the Japanese, Korean and Arabic novels outside the golden excerpts, and a Hebrew novel.
Golden texts (tuned on)Unseen books (never tuned on)The bar: 0.85
- US or UK spelling, EnglishUS or UK spelling, English: precision 0.94 on golden texts, 1.00 on unseen books
- Numbers, EnglishNumbers, English: precision 0.93 on golden texts, 0.93 on unseen books
- Punctuation, EnglishPunctuation, English: precision 0.98 on golden texts, 0.97 on unseen books
- Lore names, EnglishLore names, English: precision 1.00 on golden texts, 0.97 on unseen books
- Numbers, SpanishNumbers, Spanish: precision 1.00 on golden texts, 1.00 on unseen books
- Capitals, SpanishCapitals, Spanish: precision 1.00 on golden texts, 0.96 on unseen books
- Numbers, FrenchNumbers, French: precision 1.00 on golden texts, 1.00 on unseen books
- Capitals, FrenchCapitals, French: precision 1.00 on golden texts, 0.89 on unseen books
- Punctuation, FrenchPunctuation, French: precision 1.00 on golden texts, 0.98 on unseen books
- Lore names, FrenchLore names, French: precision 1.00 on golden texts, 0.92 on unseen books
- Numbers, GermanNumbers, German: precision 1.00 on golden texts, 1.00 on unseen books
- Lore names, GermanLore names, German: precision 1.00 on golden texts, 0.97 on unseen books
- Punctuation, ItalianPunctuation, Italian: precision 1.00 on golden texts, 0.98 on unseen books
- Lore names, ItalianLore names, Italian: precision 1.00 on golden texts, 1.00 on unseen books
- Numbers, PortugueseNumbers, Portuguese: precision 1.00 on golden texts, 0.89 on unseen books
- Capitals, PortugueseCapitals, Portuguese: precision 1.00 on golden texts, 0.98 on unseen books
- Punctuation, PortuguesePunctuation, Portuguese: precision 1.00 on golden texts, 0.95 on unseen books
- Punctuation, JapanesePunctuation, Japanese: precision 1.00 on golden texts, 1.00 on unseen books
- Kanji and kana, JapaneseKanji and kana, Japanese: precision 1.00 on golden texts, 0.96 on unseen books
- Punctuation, KoreanPunctuation, Korean: precision 0.92 on golden texts, 1.00 on unseen books
- Punctuation, HebrewPunctuation, Hebrew: precision 1.00 on golden texts, 1.00 on unseen books
- Punctuation, ArabicPunctuation, Arabic: precision 1.00 on golden texts, 1.00 on unseen books
Precision: the share of findings that are the planted error
Show every measured check as a table, with recall
- US or UK spelling, English · Shown: Yes
- Golden texts (tuned on)Planted errors found: 33 of 34; precision 0.94; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 9 of 9; precision 1.00; 0.6 findings per 10 passages with nothing planted
- Hyphenation, English · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 5 of 5; precision 1.00; 1.0 findings per 10 passages with nothing planted
- Numbers, English · Shown: Yes
- Golden texts (tuned on)Planted errors found: 39 of 48; precision 0.93; 0.4 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 27 of 27; precision 0.93; 0.8 findings per 10 passages with nothing planted
- Dates, English · Shown: No
- Golden texts (tuned on)No planted error (nothing to plant), 0.4 clean findings per 10 passages
- Unseen books (never tuned on)Nothing to plant
- Capitals, English · Shown: No
- Golden texts (tuned on)Planted errors found: 48 of 48; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 54 of 58; precision 0.86; 1.9 findings per 10 passages with nothing planted
- Punctuation, English · Shown: Yes
- Golden texts (tuned on)Planted errors found: 79 of 79; precision 0.98; 0.3 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 68 of 68; precision 0.97; 0.1 findings per 10 passages with nothing planted
- Lore names, English · Shown: Yes
- Golden texts (tuned on)Planted errors found: 62 of 62; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 64 of 64; precision 0.97; 0.3 findings per 10 passages with nothing planted
- Numbers, Spanish · Shown: Yes
- Golden texts (tuned on)Planted errors found: 47 of 47; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 30 of 31; precision 1.00; 0.5 findings per 10 passages with nothing planted
- Capitals, Spanish · Shown: Yes
- Golden texts (tuned on)Planted errors found: 36 of 39; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 46 of 50; precision 0.96; 0.3 findings per 10 passages with nothing planted
- Punctuation, Spanish · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 93 of 93; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Lore names, Spanish · Shown: No
- Golden texts (tuned on)Planted errors found: 67 of 67; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 70 of 70; precision 0.88; 1.3 findings per 10 passages with nothing planted
- US or UK spelling, French · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)No planted error (nothing to plant), 0.4 clean findings per 10 passages
- Hyphenation, French · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 9 of 11; precision 1.00; 0.1 findings per 10 passages with nothing planted
- Numbers, French · Shown: Yes
- Golden texts (tuned on)Planted errors found: 50 of 50; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 56 of 58; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Capitals, French · Shown: Yes
- Golden texts (tuned on)Planted errors found: 37 of 37; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 17 of 17; precision 0.89; 0.5 findings per 10 passages with nothing planted
- Punctuation, French · Shown: Yes
- Golden texts (tuned on)Planted errors found: 49 of 49; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 51 of 52; precision 0.98; 0.0 findings per 10 passages with nothing planted
- Lore names, French · Shown: Yes
- Golden texts (tuned on)Planted errors found: 78 of 78; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 70 of 70; precision 0.92; 0.8 findings per 10 passages with nothing planted
- Numbers, German · Shown: Yes
- Golden texts (tuned on)Planted errors found: 54 of 54; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 34 of 36; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Capitals, German · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)No planted error (nothing to plant), 0.3 clean findings per 10 passages
- Punctuation, German · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 43 of 43; precision 0.98; 0.1 findings per 10 passages with nothing planted
- Lore names, German · Shown: Yes
- Golden texts (tuned on)Planted errors found: 80 of 80; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 76 of 77; precision 0.97; 0.3 findings per 10 passages with nothing planted
- Hyphenation, Italian · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 1 of 1; precision 1.00; 0.1 findings per 10 passages with nothing planted
- Numbers, Italian · Shown: No
- Golden texts (tuned on)Planted errors found: 58 of 58; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 47 of 47; precision 0.80; 3.5 findings per 10 passages with nothing planted
- Capitals, Italian · Shown: No
- Golden texts (tuned on)Planted errors found: 63 of 72; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 36 of 36; precision 0.84; 1.3 findings per 10 passages with nothing planted
- Punctuation, Italian · Shown: Yes
- Golden texts (tuned on)Planted errors found: 77 of 77; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 122 of 122; precision 0.98; 0.4 findings per 10 passages with nothing planted
- Lore names, Italian · Shown: Yes
- Golden texts (tuned on)Planted errors found: 80 of 80; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 50 of 50; precision 1.00; 0.6 findings per 10 passages with nothing planted
- US or UK spelling, Portuguese · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)No planted error (nothing to plant), 0.5 clean findings per 10 passages
- Hyphenation, Portuguese · Shown: No
- Golden texts (tuned on)Planted errors found: 5 of 5; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 1 of 1; precision 1.00; 0.9 findings per 10 passages with nothing planted
- Numbers, Portuguese · Shown: Yes
- Golden texts (tuned on)Planted errors found: 43 of 43; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 50 of 51; precision 0.89; 1.0 findings per 10 passages with nothing planted
- Capitals, Portuguese · Shown: Yes
- Golden texts (tuned on)Planted errors found: 21 of 21; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 45 of 46; precision 0.98; 0.1 findings per 10 passages with nothing planted
- Punctuation, Portuguese · Shown: Yes
- Golden texts (tuned on)Planted errors found: 110 of 110; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 59 of 62; precision 0.95; 0.3 findings per 10 passages with nothing planted
- Lore names, Portuguese · Shown: No
- Golden texts (tuned on)Planted errors found: 67 of 73; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 60 of 61; precision 0.90; 1.4 findings per 10 passages with nothing planted
- Punctuation, Japanese · Shown: Yes
- Golden texts (tuned on)Planted errors found: 77 of 77; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 65 of 65; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Kanji and kana, Japanese · Shown: Yes
- Golden texts (tuned on)Planted errors found: 76 of 76; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 72 of 72; precision 0.96; 0.4 findings per 10 passages with nothing planted
- Punctuation, Korean · Shown: Yes
- Golden texts (tuned on)Planted errors found: 98 of 107; precision 0.92; 0.8 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 111 of 111; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Hyphenation, Hebrew · Shown: No
- Golden texts (tuned on)No planted error (nothing to plant), 2.5 clean findings per 10 passages
- Unseen books (never tuned on)Nothing to plant
- Punctuation, Hebrew · Shown: Yes
- Golden texts (tuned on)Planted errors found: 154 of 154; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 82 of 82; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Lore names, Hebrew · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 80 of 80; precision 0.71; 4.1 findings per 10 passages with nothing planted
- Punctuation, Arabic · Shown: Yes
- Golden texts (tuned on)Planted errors found: 60 of 60; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Unseen books (never tuned on)Planted errors found: 98 of 98; precision 1.00; 0.0 findings per 10 passages with nothing planted
- Lore names, Arabic · Shown: No
- Golden texts (tuned on)Nothing to plant
- Unseen books (never tuned on)Planted errors found: 43 of 43; precision 1.00; 0.0 findings per 10 passages with nothing planted
18 measured checks stay hidden
A check stays hidden in a language until it passes on both sets. These were measured and are not shown today, each with its reason.
- Hyphenation, EnglishToo few planted errors on the golden texts to measure (fewer than 5).
- Dates, EnglishToo few planted errors on the golden texts to measure (fewer than 5).
- Capitals, EnglishBelow the bar on the unseen books: precision 0.86, 1.9 clean findings per 10 passages, 58 planted.
- Punctuation, SpanishToo few planted errors on the golden texts to measure (fewer than 5).
- Lore names, SpanishBelow the bar on the unseen books: precision 0.88, 1.3 clean findings per 10 passages, 70 planted.
- US or UK spelling, FrenchToo few planted errors on the golden texts to measure (fewer than 5).
- Hyphenation, FrenchToo few planted errors on the golden texts to measure (fewer than 5).
- Capitals, GermanToo few planted errors on the golden texts to measure (fewer than 5).
- Punctuation, GermanToo few planted errors on the golden texts to measure (fewer than 5).
- Hyphenation, ItalianToo few planted errors on the golden texts to measure (fewer than 5).
- Numbers, ItalianBelow the bar on the unseen books: precision 0.80, 3.5 clean findings per 10 passages, 47 planted.
- Capitals, ItalianBelow the bar on the unseen books: precision 0.84, 1.3 clean findings per 10 passages, 36 planted.
- US or UK spelling, PortugueseToo few planted errors on the golden texts to measure (fewer than 5).
- Hyphenation, PortugueseToo few planted errors on the unseen books to measure (fewer than 5).
- Lore names, PortugueseBelow the bar on the unseen books: precision 0.90, 1.4 clean findings per 10 passages, 61 planted.
- Hyphenation, HebrewToo few planted errors on the golden texts to measure (fewer than 5).
- Lore names, HebrewToo few planted errors on the golden texts to measure (fewer than 5).
- Lore names, ArabicToo few planted errors on the golden texts to measure (fewer than 5).
AI sections
AI findings quote your text, and their recall number comes later
Analyze's AI sections are evaluated on a replay corpus in English, Korean, and Japanese. Every quote an AI finding shows is checked word for word against your manuscript before it is shown.
- The planted-flaw test set is built: public-domain chapters with a point-of-view slip, a timeline break, a repeated scene, an info-dump or a dropped thread injected, scored on whether the flaw is among the top 3 findings.
- We will publish that recall number once the per-chapter AI pass ships. Until then we quote none.
- None of the 25 reports above uses a language model. AI sections run only when you start them.
Genre benchmarks
Benchmarks come from public-domain books only
Genre ranges are measured with the same reports Analyze runs, on 69 public-domain books in their original language, published before 1931 by authors dead more than 70 years. A range needs 3 or more books, and only the numbers are kept, never the text. Old books make the ranges weaker for modern genres, and Analyze says so beside every one.
- English41 books, 98 ranges
- Spanish5 books, 14 ranges
- French9 books, 22 ranges
- German5 books, 14 ranges
- Italian4 books, 14 ranges
- Portuguese5 books, 14 ranges
- JapaneseNone yet
- KoreanNone yet
- HebrewNone yet
- ArabicNone yet
Measured on 2026-11-05. A language with no bar has no range yet, so Analyze shows none there.
Licences
Every word list has a recorded source and licence
The register lists each one with its source and licence, and a test fails on any list missing from it.
- The sentiment list is AFINN-165 (Finn Årup Nielsen, Technical University of Denmark), licensed Apache-2.0 and credited in the code.
- NRC EmoLex is licensed for non-commercial use only, so Plotiar does not ship it or any other NRC lexicon, and a test fails if one appears.
- The LIWC dictionaries are proprietary and are not used: the narrative arc uses Plotiar's own open word lists.
- Lists written for Plotiar (clichés, filter and sense words, tone words) are original, and the common-word lists are derived from public-domain books.
No score, no prediction
Measurements and findings, never a verdict
Analyze has no overall score out of 100 and makes no prediction about whether a book will sell, find an agent or be accepted. It shows what it measured and where, each finding linked to its passage, and what to change stays your decision.
Questions
Questions about the method
Short answers about how Analyze is tested today.
Because it has not passed its test in that language yet. A report joins a language only with a public-domain golden text and numbers inside the range published prose occupies; until then Analyze says it is not available rather than show an unchecked number.
Of all the findings a check reports in a passage with one planted error, a share of at least 0.85 must be that error. A check below the bar on the golden texts or on the unseen books stays hidden in that language.
No. They come only from 69 public-domain books. Plotiar never uses your manuscript to build benchmarks.
Not yet. The planted-flaw test set exists, and we will publish its recall once the per-chapter AI pass ships. Until then we quote no number.
They are generated from the test suite, not typed by hand. A test rebuilds them and fails when this page's numbers differ from what the tests measure today.
Try Analyze on your own manuscript
5 reports are free on every plan, one document at a time.