Recent advances in tabular question answering (QA) have been limited to answering questions over a single table, which constrains their coverage and does not involve common table operations such as set operations, Cartesian products (joins), or nested queries. To address this gap, researchers have explored two major directions: semantic parsing-based techniques that transform natural language questions into logical forms used to query a relational database, and end-to-end neural models that combine question understanding with table reasoning. Our work focuses on the latter direction and proposes a new task of answering questions over multiple tables using our model called MultiTabQA. This model not only answers questions over multiple tables but also generates tabular answers. To enable effective training, we build a pre-training dataset comprising 132,645 SQL queries and tabular answers. Furthermore, we evaluate the generated tables by introducing table-specific metrics of varying strictness assessing various levels of granularity of the table structure. Compared to state-of-the-art single-table QA models adapted to multi-table QA settings by finetuning on three datasets (Spider, Atis, and GeoQuery), MultiTabQA outperforms them in terms of accuracy and generalization ability. Our approach is particularly useful for non-normalized tables from sources other than relational databases such as web tables or tables in text documents. Moreover, our work highlights the importance of generating accurate tabular outputs for multi-table QA tasks since they often result in a tabular output. We introduce novel evaluation metrics that assess the quality of generated tables at different levels of granularity based on their structural properties such as column names and data types associated with the generated values. In summary, our proposed MultiTabQA model addresses the limitations of existing tabular QA systems by enabling accurate answer generation for complex multi-table queries from diverse sources beyond relational databases while providing an effective training methodology and novel evaluation metrics for generated tables.
- Recent advances in tabular question answering (QA) have been limited to answering questions over a single table, which constrains their coverage and does not involve common table operations such as set operations, Cartesian products (joins), or nested queries.
- Two major directions have been explored to address this gap: semantic parsing-based techniques and end-to-end neural models.
- The proposed model is called MultiTabQA, which answers questions over multiple tables and generates tabular answers.
- A pre-training dataset comprising 132,645 SQL queries and tabular answers was built for effective training.
- MultiTabQA outperforms state-of-the-art single-table QA models adapted to multi-table QA settings by finetuning on three datasets (Spider, Atis, and GeoQuery) in terms of accuracy and generalization ability.
- The approach is particularly useful for non-normalized tables from sources other than relational databases such as web tables or tables in text documents.
- Novel evaluation metrics that assess the quality of generated tables at different levels of granularity based on their structural properties such as column names and data types associated with the generated values are introduced.
There is a new way to answer questions about tables that can use more than one table. This is called MultiTabQA. It works better than other ways that can only use one table. They made a big list of questions and answers to help teach the computer how to do this well. This is helpful for tables that are not organized in a normal way, like ones on websites or in documents. They also made new ways to check if the answers are good or not."
Definitions- Tabular question answering (QA): A type of computer program that helps people find information in tables.
- Semantic parsing-based techniques: A way for computers to understand what people mean when they ask questions.
- End-to-end neural models: A type of computer program that uses artificial intelligence to learn how to do things by itself.
- Cartesian products (joins): A way of combining two or more tables into one big table.
- Nested queries: A type of question that asks about information within another question's answer.
- Pre-training dataset: A large set of questions and answers used to teach a computer program how to do something.
- SQL queries: A type of language used to talk with databases and get information from them.
- Accuracy: How correct something is.
- Generalization ability: How well something can work with different types of information or situations.
- Non-normalized tables: Tables that are not organized in a usual or expected way.
- Web tables: Tables found on websites.
- Evaluation metrics
Recent Advances in Tabular Question Answering (QA)
The field of tabular question answering has seen limited advances in recent years, with existing models only able to answer questions over a single table. This limitation restricts the coverage of these systems and does not involve common table operations such as set operations, Cartesian products (joins), or nested queries. To address this gap, two major directions have been explored: semantic parsing-based techniques that transform natural language questions into logical forms used to query a relational database, and end-to-end neural models that combine question understanding with table reasoning.
MultiTabQA: A Model for Answering Questions Over Multiple Tables
Our work focuses on the latter direction and proposes a new task of answering questions over multiple tables using our model called MultiTabQA. This model not only answers questions over multiple tables but also generates tabular answers. To enable effective training, we build a pre-training dataset comprising 132,645 SQL queries and tabular answers. Furthermore, we evaluate the generated tables by introducing table-specific metrics of varying strictness assessing various levels of granularity of the table structure. Compared to state-of-the-art single-table QA models adapted to multi-table QA settings by finetuning on three datasets (Spider, Atis, and GeoQuery), MultiTabQA outperforms them in terms of accuracy and generalization ability.
Benefits Beyond Relational Databases
Our approach is particularly useful for non-normalized tables from sources other than relational databases such as web tables or tables in text documents. Moreover, our work highlights the importance of generating accurate tabular outputs for multi-table QA tasks since they often result in a tabular output. We introduce novel evaluation metrics that assess the quality of generated tables at different levels of granularity based on their structural properties such as column names and data types associated with the generated values.
Conclusion
In summary, our proposed MultiTabQA model addresses the limitations of existing tabular QA systems by enabling accurate answer generation for complex multi-table queries from diverse sources beyond relational databases while providing an effective training methodology and novel evaluation metrics for generated tables
