johnnyhwu/Awesome-LLM-Tabular

Awesome-LLM-Tabular: a curated list of Large Language Model applied to Tabular Data

430

68 commits

updated Apr 6, 2026

See the code

README

Awesome-LLM-Tabular

Awesome License: MIT

:bulb: Since the emergence of ChatGPT, Large Language Models (LLMs) have garnered significant attention, with new advancements continuously emerging. LLMs have found applications in various domains like vision, audio, and text tasks. However, tabular data remains a crucial data format in this world. Hence, this repo focuses on collecting research papers that explore the integration of LLM technology with tabular data, and aims to save you valuable time and boost research efficiency.

:sparkles: Awesome-LLM-Tabular is a curated list of Large Language Model applied to Tabular Data.

:fire: This project is currently under development. Feel free to :star: (STAR) and :telescope: (WATCH) it to stay updated on the latest developments.

Table of Content

DatekeywordsPaperPublicationResource
2019/09TabFactTabFact: A Large-scale Dataset for Table-based Fact VerificationStatic BadgeStatic Badge
2020TableGPTTableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content MatchingStatic BadgeStatic Badge
2020/05TaBERTTaBERT: Pretraining for Joint Understanding of Textual and Tabular DataStatic BadgeStatic Badge
2020/09GaPPaGraPPa: Grammar-Augmented Pre-Training for Table Semantic ParsingStatic BadgeStatic Badge
2020/10TabGANSynthetic tabular data generation using GANs (CTGAN), Diffusion Models, and LLMs (GReaT) with adversarial filtering, privacy metrics, and sklearn integration.Static Badge
2022/02TableQueryTableQuery: Querying tabular data with natural language
2022/05FeSTEFew-Shot Tabular Data Enrichment Using Fine-Tuned Transformer ArchitecturesStatic Badge
2022/05FMCan Foundation Models Wrangle Your Data?Static BadgeStatic Badge
2022/05TURLTechnical Perspective of TURL: Table Understanding through Representation LearningStatic Badge
2022/06TabTextTabText: A Flexible and Contextual Approach to Tabular Data Representation
2022/06LIFTLIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning TasksStatic BadgeStatic Badge
2022/09PTabPTab: Using the Pre-trained Language Model for Modeling Tabular Data
2022/09TabMWPDynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical ReasoningStatic BadgeStatic Badge
2022/10GReaTLanguage Models are Realistic Tabular Data GeneratorsStatic BadgeStatic Badge
2022/10TabLLMTabLLM: Few-shot Classification of Tabular Data with Large Language ModelsStatic BadgeStatic Badge
2023/??IngesTablesIngesTables: Scalable and Efficient Training of LLM-Enabled Tabular Foundation ModelsStatic Badge
2023/??ElephantsElephants Never Forget: Testing Language Models for Memorization of Tabular DataStatic BadgeStatic Badge
2023/01DATERLarge Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based ReasoningStatic Badge
2023/02AdaPTGenAdapting Prompt for Few-shot Table-to-Text Generation
2023/03Survey PaperTransformers for Tabular Data Representation: A Survey of Models and ApplicationsStatic Badge
2023/04TABLETTABLET: Learning From Instructions For Tabular DataStatic Badge
2023/05AnyPredictAnyPredict: Foundation Model for Tabular Prediction
2023/05TAPTAPGenerative Table Pre-training Empowers Models for Tabular PredictionStatic BadgeStatic Badge
2023/05BirdCan LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLsStatic BadgeStatic Badge
2023/07TableGPTTableGPT: Towards Unifying Tables, Nature Language and Commands into One GPT
2023/07UniTabEUniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data ScienceStatic Badge
2023/10TabFMsTOWARDS FOUNDATION MODELS FOR LEARNING ON TABULAR DATA
2023/10TableFormatTabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMs
2023/10UniPredictUniPredict: Large Language Models are Universal Tabular Classifiers
2023/10Table-GPTTable-GPT: Table-tuned GPT for Diverse Table TasksStatic Badge
2024/03TableLLMTable Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical StudyStatic Badge
2023/11NumericalReasoningExploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular DataStatic Badge
2023/12TaCoChain-of-Thought Reasoning in Tabular Language ModelsStatic BadgeStatic Badge
2023/12TableLLMRethinking Tabular Data Understanding with Large Language ModelsStatic BadgeStatic Badge
2024/01Chain-of-TableChain-of-Table: Evolving Tables in the Reasoning Chain for Table UnderstandingStatic Badge
2024/01TAT-LLMTAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual DataStatic Badge
2024/01DataFrame QADataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure
2024/02Survey PaperLLM on Tabular Data: Prediction, Generation, and Understanding
2024/02Survey PaperLarge Language Model for Table Processing: A Survey
2024/02CABINETCABINET: Content Relevance based Noise Reduction for Table Question AnsweringStatic BadgeStatic Badge
2024/02OpenTabOpenTab: Advancing Large Language Models as Open-domain Table ReasonersStatic BadgeStatic Badge
2024/02CancerGPTCancerGPT for few shot drug pair synergy prediction using large pretrained language modelsStatic Badge
2024/02Exploration of LLM on TabularTables as Images? Exploring the Strengths and Limitations of LLMs on Multimodal Representations of Tabular Data
2024/03TableLLMTable Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical StudyStatic Badge
2024/03ITAB-LLMUnleashing the Potential of Large Language Models for Predictive Tabular Tasks in Data ScienceStatic Badge
2024/03TP-BERTaMaking Pre-trained Language Models Great on Tabular PredictionStatic BadgeStatic Badge
2024/04FeatLLMLarge Language Models Can Automatically Engineer Features for Few-Shot Tabular LearningStatic Badge
2024/04TabSQLifyTabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table DecompositionStatic BadgeStatic Badge
2024/04LLMCleanLLMClean: Context-Aware Tabular Data Cleaning via LLM-Generated OFDsStatic Badge
2024/04Elephants Never ForgetElephants Never Forget: Memorization and Learning of Tabular Data in Large Language ModelsStatic BadgeStatic Badge
2024/05CARTECARTE: Pretraining and Transfer for Tabular LearningStatic BadgeStatic Badge
2024/05DataBenchQuestion Answering over Tabular Data with DataBench: A Large-Scale Empirical Evaluation of LLMsStatic Badge
2024/05PositionPosition: Why Tabular Foundation Models Should Be a Research PriorityStatic Badge
2024/06Struc-BenchStruc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data?Static BadgeStatic Badge
2024/07folktextsEvaluating language models as risk scoresStatic Badge
2024/07SpreadsheetLLMSpreadsheetLLM: Encoding Spreadsheets for Large Language Models
2024/08rLLMrLLM: Relational Table Learning with LLMsStatic Badge

Workshops

Useful Blogs

Citation

@misc{wu2024awesomellmtabular,
  author = {Hong-Wei, Wu},
  title = {Awesome-LLM-Tabular},
  year = {2024},
  note = {Accessed: 2024-05-30},
  url = {https://github.com/johnnyhwu/Awesome-LLM-Tabular},
  orcid = {https://orcid.org/0009-0005-8073-5297}
}

Contributing

We welcome contributions to keep this repository up-to-date with the latest research and applications of LLM in the tabular domain. Whether you want to correct any mistakes, add new content, or suggest improvements, your contributions are highly appreciated :hugs:.

awesome
large-language-models
tabular-data

johnnyhwu/Awesome-LLM-Tabular

Awesome-LLM-Tabular: a curated list of Large Language Model applied to Tabular Data

430

68 commits

updated Apr 6, 2026

See the code

README

Awesome-LLM-Tabular

Awesome License: MIT

:bulb: Since the emergence of ChatGPT, Large Language Models (LLMs) have garnered significant attention, with new advancements continuously emerging. LLMs have found applications in various domains like vision, audio, and text tasks. However, tabular data remains a crucial data format in this world. Hence, this repo focuses on collecting research papers that explore the integration of LLM technology with tabular data, and aims to save you valuable time and boost research efficiency.

:sparkles: Awesome-LLM-Tabular is a curated list of Large Language Model applied to Tabular Data.

:fire: This project is currently under development. Feel free to :star: (STAR) and :telescope: (WATCH) it to stay updated on the latest developments.

Table of Content

DatekeywordsPaperPublicationResource
2019/09TabFactTabFact: A Large-scale Dataset for Table-based Fact VerificationStatic BadgeStatic Badge
2020TableGPTTableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content MatchingStatic BadgeStatic Badge
2020/05TaBERTTaBERT: Pretraining for Joint Understanding of Textual and Tabular DataStatic BadgeStatic Badge
2020/09GaPPaGraPPa: Grammar-Augmented Pre-Training for Table Semantic ParsingStatic BadgeStatic Badge
2020/10TabGANSynthetic tabular data generation using GANs (CTGAN), Diffusion Models, and LLMs (GReaT) with adversarial filtering, privacy metrics, and sklearn integration.Static Badge
2022/02TableQueryTableQuery: Querying tabular data with natural language
2022/05FeSTEFew-Shot Tabular Data Enrichment Using Fine-Tuned Transformer ArchitecturesStatic Badge
2022/05FMCan Foundation Models Wrangle Your Data?Static BadgeStatic Badge
2022/05TURLTechnical Perspective of TURL: Table Understanding through Representation LearningStatic Badge
2022/06TabTextTabText: A Flexible and Contextual Approach to Tabular Data Representation
2022/06LIFTLIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning TasksStatic BadgeStatic Badge
2022/09PTabPTab: Using the Pre-trained Language Model for Modeling Tabular Data
2022/09TabMWPDynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical ReasoningStatic BadgeStatic Badge
2022/10GReaTLanguage Models are Realistic Tabular Data GeneratorsStatic BadgeStatic Badge
2022/10TabLLMTabLLM: Few-shot Classification of Tabular Data with Large Language ModelsStatic BadgeStatic Badge
2023/??IngesTablesIngesTables: Scalable and Efficient Training of LLM-Enabled Tabular Foundation ModelsStatic Badge
2023/??ElephantsElephants Never Forget: Testing Language Models for Memorization of Tabular DataStatic BadgeStatic Badge
2023/01DATERLarge Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based ReasoningStatic Badge
2023/02AdaPTGenAdapting Prompt for Few-shot Table-to-Text Generation
2023/03Survey PaperTransformers for Tabular Data Representation: A Survey of Models and ApplicationsStatic Badge
2023/04TABLETTABLET: Learning From Instructions For Tabular DataStatic Badge
2023/05AnyPredictAnyPredict: Foundation Model for Tabular Prediction
2023/05TAPTAPGenerative Table Pre-training Empowers Models for Tabular PredictionStatic BadgeStatic Badge
2023/05BirdCan LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLsStatic BadgeStatic Badge
2023/07TableGPTTableGPT: Towards Unifying Tables, Nature Language and Commands into One GPT
2023/07UniTabEUniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data ScienceStatic Badge
2023/10TabFMsTOWARDS FOUNDATION MODELS FOR LEARNING ON TABULAR DATA
2023/10TableFormatTabular Representation, Noisy Operators, and Impacts on Table Structure Understanding Tasks in LLMs
2023/10UniPredictUniPredict: Large Language Models are Universal Tabular Classifiers
2023/10Table-GPTTable-GPT: Table-tuned GPT for Diverse Table TasksStatic Badge
2024/03TableLLMTable Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical StudyStatic Badge
2023/11NumericalReasoningExploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular DataStatic Badge
2023/12TaCoChain-of-Thought Reasoning in Tabular Language ModelsStatic BadgeStatic Badge
2023/12TableLLMRethinking Tabular Data Understanding with Large Language ModelsStatic BadgeStatic Badge
2024/01Chain-of-TableChain-of-Table: Evolving Tables in the Reasoning Chain for Table UnderstandingStatic Badge
2024/01TAT-LLMTAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual DataStatic Badge
2024/01DataFrame QADataFrame QA: A Universal LLM Framework on DataFrame Question Answering Without Data Exposure
2024/02Survey PaperLLM on Tabular Data: Prediction, Generation, and Understanding
2024/02Survey PaperLarge Language Model for Table Processing: A Survey
2024/02CABINETCABINET: Content Relevance based Noise Reduction for Table Question AnsweringStatic BadgeStatic Badge
2024/02OpenTabOpenTab: Advancing Large Language Models as Open-domain Table ReasonersStatic BadgeStatic Badge
2024/02CancerGPTCancerGPT for few shot drug pair synergy prediction using large pretrained language modelsStatic Badge
2024/02Exploration of LLM on TabularTables as Images? Exploring the Strengths and Limitations of LLMs on Multimodal Representations of Tabular Data
2024/03TableLLMTable Meets LLM: Can Large Language Models Understand Structured Table Data? A Benchmark and Empirical StudyStatic Badge
2024/03ITAB-LLMUnleashing the Potential of Large Language Models for Predictive Tabular Tasks in Data ScienceStatic Badge
2024/03TP-BERTaMaking Pre-trained Language Models Great on Tabular PredictionStatic BadgeStatic Badge
2024/04FeatLLMLarge Language Models Can Automatically Engineer Features for Few-Shot Tabular LearningStatic Badge
2024/04TabSQLifyTabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table DecompositionStatic BadgeStatic Badge
2024/04LLMCleanLLMClean: Context-Aware Tabular Data Cleaning via LLM-Generated OFDsStatic Badge
2024/04Elephants Never ForgetElephants Never Forget: Memorization and Learning of Tabular Data in Large Language ModelsStatic BadgeStatic Badge
2024/05CARTECARTE: Pretraining and Transfer for Tabular LearningStatic BadgeStatic Badge
2024/05DataBenchQuestion Answering over Tabular Data with DataBench: A Large-Scale Empirical Evaluation of LLMsStatic Badge
2024/05PositionPosition: Why Tabular Foundation Models Should Be a Research PriorityStatic Badge
2024/06Struc-BenchStruc-Bench: Are Large Language Models Good at Generating Complex Structured Tabular Data?Static BadgeStatic Badge
2024/07folktextsEvaluating language models as risk scoresStatic Badge
2024/07SpreadsheetLLMSpreadsheetLLM: Encoding Spreadsheets for Large Language Models
2024/08rLLMrLLM: Relational Table Learning with LLMsStatic Badge

Workshops

Useful Blogs

Citation

@misc{wu2024awesomellmtabular,
  author = {Hong-Wei, Wu},
  title = {Awesome-LLM-Tabular},
  year = {2024},
  note = {Accessed: 2024-05-30},
  url = {https://github.com/johnnyhwu/Awesome-LLM-Tabular},
  orcid = {https://orcid.org/0009-0005-8073-5297}
}

Contributing

We welcome contributions to keep this repository up-to-date with the latest research and applications of LLM in the tabular domain. Whether you want to correct any mistakes, add new content, or suggest improvements, your contributions are highly appreciated :hugs:.

awesome
large-language-models
tabular-data