Materials and Methods
Epstein Suite indexes the text; the original document lives at its official source. We don't host the original file — view it on the official release to read it in full.
View the original on the official releaseDocument text
Text is machine OCR and may contain errors. Confirm against the original source above.
Materials and Methods
“Quantitative analysis of culture using millions of digitized books”,
Michel et al.
Contents
|, OvervieW of Google BOOKS DIGILIZALION ciseiccvsvesees canweneeusveners caus eueeunveners cans eueeunyeqers cans eeeernyeners canweeees 3
1.1. Metadata o.oo... cece cccccce cece cece cee aeeeee ee ee ec aeaeeeeeeeee ce aaeaeeeeeeeeececcaeaeeeeeeesecsccueaeeseeeeseeseneees 3
Fae Be] t72-) (0) s 4
1.3. Structure Extraction ...........cccecccceccceceeeeeeeeeeeeeeeeeseccaeaeeeeeeeseseccaeaeeeeeeeseceecueaeeeeeeeseesenieees 4
Il. Construction of Historical N-grams Corpora ........cccccccccccccccececeseseseeeseeeseeeseceseseseneseseseseseseneteneeenenes 5
I1.1. Additional filtering Of DOOKS ..... ccc cccccccececeeeeeeeeeeeeeeeeeseeeeeeeseeeeeeeeeeeneneeesenenenenenenes 5
Il.1A. Accuracy of Date-of-Publication Metadata 2.0... ccccccccccccececeeeeeeeseseeeeeeeseeeeeseeenenes 5
Pf = @ LO) ne (0 r- || 6
I1.1C. Accuracy of language Metadata... cccccccccccccececeseseseseeeseeeeeseeeseseeeeeeesesesesesenenes 6
ILTD: V6ar REStrCUOR semcessmarce: cammmemnenmancts tamenmemneninnent UaMenNRNanineN: SmmEnERMNNOREN: SuEmnRMUNETRER: emmeRR 7
I|.2. Metadata based subdivision of the Google Books Collection.............cccccccccceseseeeeenes 7
I1.2ZA. Determination Of IANQUAGE ....... cc ccccccccccccececeeececeeeeeeeeeeeeeeeeeeeseeeeeseeeseseeeeeeeeenetenenenenes 7
I1.2B. Determination of book subject ASSIQGNMENtS.......... cc cccccccccccececeseeeseseeeseeeseseeeeesenenenes 7
I1.2C. Determination of book CouNtry-Of-PUDIICATION ..... cc ccccccceeecesececeeeeeeeeeseseeeeenenenes 7
I1.3. Construction of historical N-QraMS COPPOLA ....... cc ccccccccccceccccseceeeseseseseseseeeeeeeeeseeesesenenenes 8
II.3A. Creation of a digital sequence of 1-grams and extraction of n-gram counts............. 8
I1.3B. Generation of historical N-QraMS COPPOLA .......cccccccccccceccceseseseseseseseeeseseseeesesesesenenenes 10
Ill. Culturomic AnalySe@ss ...........c.ccccccceeecccce eee eeaeeeeeeeeeeeaeaeaeaeaeaeaeaeaeeeeeaeaeaeeeaeaeeeseeeeeeeeeeeeeaeeeaeseeeeeeeeseeeeesneeaees 12
IlL.O; GRAS] REMARKS xcesmacccs wsemsummmnens wmewamnmmeens impaeRNENeR IaOIMAERUARNER SaNISMNteREMRNNERY tauNNenemRNER saree 12
| Oa ©) pk Occ) 1 ole) kc; 12
I11.0.2 On the number Of BOOKS PUDLISNE)M «0.2.0... ccc cece cececesesececeeeneceeeeeseeeseseseeeseeesenenetesenenenees 13
II1.1. Generation of timeline Plots oo... cc cccccceceeeeeeeceeeeeseeeeeseseeeeeeeeeeeeeeeeeseseneseseeeeesetesenenenees 13
WN. 1A. Single QUETY ....... ccc ccc cece cecene cece cette caeae cece eects aaeaeeeeeeesecaaeaeeeeeeesecceaeeeeeeeeesecensaeeeeeereetenes 13
I11.1B. Multiple Query/Cohort Timelines ............c.cccccceececeecce cece cece eeeaeceeeeeeeseceeeaeceeeeeeeseeseneeeeeeseeeeee 14
III.2. Note on collection of historical and cultural data ..............cececeeeccceceeeeeeeeeeeceeeeeeeeeeeeseeeeeereneeees 14
IU:3: GQHUUGS ccc nmcommeresenne enecmeNeRs SIMONI: STRING SRNR SKETRTRG eaeURES sane 15
ILL.4. LE XIGOR ANALYSIS: ccxccssvesors cnwenenmmmeners cuseueemenets dane reeeeNReNeNs CanETHOMENENENS CaNSHOREANENENS canSTHOMENNENENS cane 15
1
HOUSE_OVERSIGHT_017009
Have a question about what this document contains?
Ask the documents