Dayne Freitag, John Cadigan, John Niekrasz and Robert Sasseen. 2022. “Accelerating Human Authorship of Information Extraction Rules.” Proceedings of the First Workshop on Pattern-Based Approaches to NLP in the Age of Deep Learning (PAN-DL).
Abstract
We consider whether machine models can facilitate the human development of rule sets for information extraction. Arguing that rule-based methods possess a speed advantage in the early development of new extraction capabilities, we ask whether this advantage can be increased further through the machine facilitation of common recurring manual operations in the creation of an extraction rule set from scratch. Using a historical rule set, we reconstruct and describe the putative manual operations required to create it. In experiments targeting one key operation—the enumeration of words occurring in particular contexts—we simulate the process of corpus review and word list creation, showing that several simple interventions greatly improve recall as a function of simulated labor.