Evaluating supervised topic models in the presence of OCR errors

Daniel Walker; Eric Ringger; Kevin Seppi

doi:10.1117/12.2008345

4 February 2013 Evaluating supervised topic models in the presence of OCR errors

Daniel Walker, Eric Ringger, Kevin Seppi

Proceedings Volume 8658, Document Recognition and Retrieval XX; 865812 (2013) https://doi.org/10.1117/12.2008345
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

Supervised topic models are promising tools for text analytics that simultaneously model topical patterns in document collections and relationships between those topics and document metadata, such as timestamps. We examine empirically the effect of OCR noise on the ability of supervised topic models to produce high quality output through a series of experiments in which we evaluate three supervised topic models and a naive baseline on synthetic OCR data having various levels of degradation and on real OCR data from two different decades. The evaluation includes experiments with and without feature selection. Our results suggest that supervised topic models are no better, or at least not much better in terms of their robustness to OCR errors, than unsupervised topic models and that feature selection has the mixed result of improving topic quality while harming metadata prediction quality. For users of topic modeling methods on OCR data, supervised topic models do not yet solve the problem of finding better topics than the original unsupervised topic models.

Citation Download Citation

Daniel Walker, Eric Ringger, and Kevin Seppi "Evaluating supervised topic models in the presence of OCR errors", Proc. SPIE 8658, Document Recognition and Retrieval XX, 865812 (4 February 2013); https://doi.org/10.1117/12.2008345

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available