|
Polibits 2012
A Flexible Table Parsing ApproachKeywords: information retrieval, document processing, tables. Abstract: relational data is often encoded in tables. tables are easy to read by humans, but difficult to interpret automatically. in cases where table layout cues are not obtainable (missing html tags) or where columns are distorted (by copying from a spreadsheet to text) previous table extraction approaches run into problems. this paper introduces a novel table parsing approach. our approach is based on a set of simple assumptions: (a) every table can be split up in data cells and headers, and (b) every table can be parsed beginning from a data cell utilizing the overall table structure. the table parsing is defined as "table flattening" in this paper. that is, the parsing starts with a data cell and pulls out all token (i.e., headers and sub-headers) associated with a respective data cell. we propose a parsing technique that uses two simple parsing heuristics: table headers are to the left of and above a data cell. we experimented with trader emails that contained instrument information with bid-ask prices as data cells. we developed a clustering and classifying method for finding prices reliably in the data set we used. this method is transferable to other data cell types and can be applied to other table content.
|