Using grammatical inference to improve precision in information extraction


Freitag D. Using grammatical inference to improve precision in information extraction, in Proceedings of the ICML-97 Workshop on Automata Induction, Grammatical Inference, and Language Acquisition, 1997.


The field of information extraction (IE) is concerned with applying natural language processing (NLP) and information retrieval (IR) techniques to the automatic extraction of essential details from text documents. We are exploring the use of machine learning methods for IE. While the most promising methods we have developed perform well for problems defined over a collection of electronic seminar announcements, they are imprecise in their identification of the boundaries of relevant text fragments (fields). Here, we entertain the idea of using grammatical inference (GI) methods to learn the appropriate form of a field. We describe one method for translating raw text into an abstract alphabet suitable for GI, and show that, by combining one IE learning method with the resulting inferred grammars, large improvements in precision can be realized for some fields.

Read more from SRI