Loading...
Corpus linguistics toolkit for Soviet census methodology texts (1926-1989): VLM extraction, orthography canonicalization, lemmatization, concordance, keyword, and register analysis.
The Soviet census counted identities and shaped official vocabulary for nationality, ethnicity, language, and belonging. I built the extraction pipeline and tracked language shifts from 1926 to 1989.
Research infrastructure for tracing how the official language of Soviet census methodology changed from 1926 through 1989.
The repository and extracted corpus are private. This page includes aggregate findings and a generated chart, but not raw scans, corpus pages, or unreleased thesis text.
Published Soviet census methodology/preface series analyzed as the main chain.
Methodology and preface pages only, across the primary chain plus 1937/1939 vignettes.
Nominal density rises from 1926 to a 1979 peak, then partially reverses in 1989.
Vocabulary richness contracts by roughly 40% from 1926 to the 1979 minimum; 1989 is raw TTR because it falls below the 5k STTR floor.
A VLM extraction pipeline turns scanned census front matter into a normalized, lemmatized corpus while preserving recoverable original forms.
The analysis shows the register becoming more nominal and less lexically varied through 1979, followed by a partial reversal in 1989.