Civic archive intake · Current policy, 17 October 2026

Keep usable English.
Record defects without filtering countries.

The new screen checks the complete document. It preserves minor translation problems, uncertain names, short articles and mixed text with usable English. It excludes empty/invalid input and bodies classified as wholly non-English. These are input decisions, not an accuracy score.

7,373,816Canonical eligible source records checked
7,369,175Pass the current input screen
4,641Input holds: empty/invalid, language or technical field issues

What the numbers mean

These four rows form a complete, non-overlapping partition at the recorded claim snapshot.
DecisionRecords
Eligible for a new cached request7,368,612
Previous paid or unresolved identity excluded563
Retained source-scope exclusion1
Input exclusion4,640
All canonical records7,373,816

2,531,940 passing inputs carry warnings. This is a subset of the passing count, not another exclusion category. One input-held record also has a retained source-scope issue; the exclusive table assigns it to source scope, so its input-exclusion row is one lower than the total input-screen holds. 21 earlier document-level holds were retained with warnings after checking for substantive English prose obscured by repeated or garbled tails.

Claim snapshot: 2026-10-17T04:58:47.174031+00:00. The candidate count is not a live queue size, a guarantee that all records fit one request, or a semantic acceptance total. Every actual submission rechecks paid/unknown claims, source identity, physical request limits and remaining budget.

Warnings versus exclusions

Keep with a recorded warningExclude from new input
Awkward grammar, shortened translation, short text or incomplete endingsEmpty, non-string or technically unusable translated text
Names, datelines, isolated foreign fragments, uncertain language scoresBody classified as wholly non-English without substantive English prose
Mixed English and other language, including repeated or garbled tailsAlready paid/unresolved identities, duplicate content, or a retained source-scope issue

Original source language and country are not exclusion rules. Exact stored translated title and body are used; blank translated titles may remain blank when the body is usable. Text is not silently repaired, completed or replaced by the original-language fields.

Language-model scores are screening signals, not calibrated certainty or a count of proven bad translations. This screen does not establish translation fidelity, complete sentences or scientific label accuracy.

Input exclusion reasons

Reason labels are mechanical screen results. Multiple reasons may describe one input; do not add them as disjoint article counts.
Recorded reasonOccurrences
body empty or invalid4,093
body not string20
body nul character3
body wholly non english511
title not string16

Why the old “remaining candidates” count was misleading

The earlier 1,624,549 was an intersection: records had to clear older language-window, sentence and quality-hold checks and previous-attempt exclusions. It was not the number of all usable English articles, and it was not a representative research sampling frame.

The earlier strict screen could flag a name, byline or short span even when the article body was readable English. That explains why an automatic flag was too broad a reason to remove an article. The old report remains available as historical evidence; current candidate decisions use the updated policy above.

Scope, processing order and traceability

The source scope is MLP civic-related, non-disaster, non-999 records from enabled sources. MLEED ENV source families are excluded. Shared MLP/MLEED domains remain when they are valid MLP source identities. The canonical snapshot covers January 2012–October 2026; September is the latest nonempty month.

Paid processing starts with June 2026 and moves backward within the inclusive shared $500 budget. Previous spending, pending reservations and unknown outcomes count toward that limit. Requests use the stable prompt, cached shared prefix and bounded output cap; no automatic paid retry is allowed.

Each result retains its source/version, request, prompt, model, policy, structural outcome and review flags. Operational results are labeled as structurally valid with pending or sampled review, rather than fully reviewed scientific gold. DB insertion and exact readback are reported only from actual write receipts.

First 40 production attempts: returned and stored

All 40 responses are accounted for. The DB contains all 40 immutable operational attempts, each checked by exact readback, with zero save exceptions and no source documents modified. The one structural failure is preserved as a failed attempt with its raw response; it is not silently repaired or retried.

Review of the actual outputs. These categories describe observed conflicts and pending decisions, not a research accuracy benchmark.
Output review statusAttempts
No concrete conflict identified in the review26
Clear prompt-rule conflicts retained as flags4
Adjudication flags retained9
Mechanical failure; raw response preserved1
Stored operational attempts, exactly read back40

The 39 structurally valid records include the four clear conflicts and nine adjudication cases. The original outputs and flags remain visible for later parsing or scientific review. Storage does not convert flagged or unreviewed labels into accepted gold data, and this 40-record shard is not a completed month.

Cache reuse: 39/40 requests. The batch used 262,782 cache-read tokens, 6,738 cache-write tokens and 17,628 ordinary input tokens. Actual cost for all 40 outcomes, including the failed extraction, was $0.014481185 (ledger-rounded $0.014482). The $0.117373 reservation was a conservative bound, not the charge.

The 47,459 output tokens already include reasoning usage; reasoning is not charged a second time. Observed cache reuse is not a guaranteed future hit rate or a full-month cost forecast.

These are the final amended review counts after the bounded independent reread. Four review dispositions were updated in separate, exactly read-back DB amendments. This includes correcting an initially overstrong conflict judgment and recording additional action/response and interpretation flags. Original model outputs, attempts and source text are unchanged.

A further 40 June requests have been submitted by the rolling worker and were awaiting provider completion at 05:17:25 UTC on 17 October. They are not included in the completed or DB totals above.

Cache reuse is already demonstrated

The completed 15-request diagnostic had 13 cache-read requests, 87,594 cache-read tokens and 13,476 cache-write tokens. Actual cost was $0.004370770. All 15 outputs were structurally valid; 11 reviewed attempts were saved with exact DB readback.

Open the completed cache test. This is evidence of actual reuse, not a guaranteed monthly hit rate or controlled accuracy comparison. The shared $500 budget is not the same as diagnostic-only spending.

All 40 responses from the first June production batch returned: 39 structurally valid and one evidence-length failure. All 40 original operational attempts are stored with exact DB readback, including failures and review flags. These are not 40 accepted scientific labels. This batch had 39/40 cache-read requests and cost $0.014481185 in total. A further 40 June requests have been submitted by the rolling worker and were awaiting provider completion at 05:17:25 UTC on 17 October. They are not included in the completed or DB totals above. Structural validity is not a full scientific accuracy certification; DB totals are reported separately.

Month-by-month input screen

178 calendar months; October 2026 is empty and September is the latest nonempty archive.
MonthRecordsInput screen passedInput exclusions
2012-0116,06516,0614
2012-0217,55317,5512
2012-0319,58719,5843
2012-0418,48618,4833
2012-0522,23322,2321
2012-0621,01921,0163
2012-0720,33520,3341
2012-0820,49320,4930
2012-0921,88721,8789
2012-1025,02325,0230
2012-1123,49723,4934
2012-1222,09522,0950
2013-0124,13324,1321
2013-0223,07823,0753
2013-0324,87324,8712
2013-0426,90526,9023
2013-0527,48827,47810
2013-0628,92228,9166
2013-0732,09032,0891
2013-0828,60028,5982
2013-0928,24228,2411
2013-1028,15628,1533
2013-1128,23828,2353
2013-1228,77128,7701
2014-0131,92831,9199
2014-0232,87032,8700
2014-0336,32036,3200
2014-0436,35736,3543
2014-0540,44840,4462
2014-0630,91230,9075
2014-0730,40830,4053
2014-0831,67231,6675
2014-0930,90430,9013
2014-1033,27633,2742
2014-1131,65031,6473
2014-1229,36829,3608
2015-0131,95731,91938
2015-0231,97131,95120
2015-0334,86334,82736
2015-0434,49634,42373
2015-0533,44833,35098
2015-0635,14134,958183
2015-0735,40535,305100
2015-0837,08237,03943
2015-0936,47336,373100
2015-1040,86540,77491
2015-1139,21339,13083
2015-1238,53738,45285
2016-0137,19537,11184
2016-0240,97340,92350
2016-0345,56145,50259
2016-0445,31145,26843
2016-0545,22345,17845
2016-0641,34841,30444
2016-0745,00844,96840
2016-0844,48544,46421
2016-0941,12641,11214
2016-1044,89944,8918
2016-1145,88145,8765
2016-1240,75740,7498
2017-0144,42844,37553
2017-0245,00844,875133
2017-0348,94748,798149
2017-0445,25345,114139
2017-0545,91045,736174
2017-0644,84444,689155
2017-0745,53245,404128
2017-0842,81642,78036
2017-0942,28542,20679
2017-1047,56847,461107
2017-1148,82448,73787
2017-1243,54843,444104
2018-0148,01847,884134
2018-0246,34046,25486
2018-0353,73853,65286
2018-0452,84652,744102
2018-0555,79055,74545
2018-0651,06251,0548
2018-0754,05554,0514
2018-0848,40648,4024
2018-0949,52249,5184
2018-1053,71053,7055
2018-1150,52350,5203
2018-1252,31852,30810
2019-0151,36851,3653
2019-0251,12551,1232
2019-0358,83558,8296
2019-0459,63059,6246
2019-0557,08157,0765
2019-0646,58846,5862
2019-0749,29549,2905
2019-0845,22245,2184
2019-0947,94647,9433
2019-1056,73356,7258
2019-1149,91649,9124
2019-1247,71247,7048
2020-0148,36648,3606
2020-0247,68647,6824
2020-0339,33939,3327
2020-0430,56730,5661
2020-0536,12136,1174
2020-0645,24645,2415
2020-0748,92048,9146
2020-0845,68345,6803
2020-0952,58252,5811
2020-1059,84059,82812
2020-1153,85053,83812
2020-1254,04054,0337
2021-0148,51048,5064
2021-0251,84451,8386
2021-0359,02659,0233
2021-0455,21355,2085
2021-0550,73950,7345
2021-0652,31052,3028
2021-0749,92349,9158
2021-0844,82544,78936
2021-0950,94450,92024
2021-1056,79056,72565
2021-1157,56457,46599
2021-1251,98951,872117
2022-0150,95950,637322
2022-0253,30853,197111
2022-0360,36460,3613
2022-0452,37852,35721
2022-0553,74253,7339
2022-0653,16853,15513
2022-0750,12250,1175
2022-0850,00949,99811
2022-0949,57149,5638
2022-1052,72552,7196
2022-1154,15054,1482
2022-1248,64248,62913
2023-0149,99749,9970
2023-0247,74347,7349
2023-0355,30055,2928
2023-0445,33845,32711
2023-0553,54053,53010
2023-0643,57643,5715
2023-0745,98445,9813
2023-0845,05945,0581
2023-0943,80343,8021
2023-1045,46945,4663
2023-1145,02645,0224
2023-1245,43445,4295
2024-0143,15143,1465
2024-0250,34250,33210
2024-0350,27750,2734
2024-0453,38453,3795
2024-0556,79256,7875
2024-0650,00449,9959
2024-0748,14648,1424
2024-0848,94848,9462
2024-0948,99148,9874
2024-1053,12453,1213
2024-1150,11550,1141
2024-1240,09340,0876
2025-0136,10036,08119
2025-0237,09437,08212
2025-0338,78438,77311
2025-0437,07537,0696
2025-0538,78438,7813
2025-0634,47434,4704
2025-0739,54939,5472
2025-0838,68238,6766
2025-0936,73436,7304
2025-1037,81837,8162
2025-1139,30339,3021
2025-1236,66036,6555
2026-0134,18534,1814
2026-0234,73434,7286
2026-0333,36733,35710
2026-0436,07536,05223
2026-0535,46835,45117
2026-0626,64826,63711
2026-0723,30723,28918
2026-0813,32213,30616
2026-091,1201,1200
2026-10000