jacobmarks/awesome-neurips-2023

Conference schedule, top papers, and analysis of the data for NeurIPS 2023!

Jupyter Notebook

121

17 commits

updated Dec 15, 2023

See the code

README

Awesome NeurIPS 2023 Info

Neurips 2023 wordcloud Caption: Wordcloud of all NeurIPS 2023 titles

Welcome to the hub for all things NeurIPS 2023! We scraped the data for all 3500+ NeurIPS projects and dove into the depths of Hugging Face, GitHub, LinkedIn, and Arxiv to pick out the most interesting content.

In this repo, you will find:

  • Data Analysis: detailed analysis of the titles and abstracts from NeurIPS 2023 accepted papers
  • Awesome Projects: synthesized collection of 40 NeurIPS 2023 papers you won't want to miss
  • Conference Schedule: comprehensive listing of all NeurIPS 2023 projects (title, authors, abstract) organized by poster session and sorted alphabetically

Data Analysis

The raw data is included in this repo. If you have ideas for other interesting analyses, feel free to create an issue or submit a PR!

For now, insights are organized into the following categories:

  • Authors
  • Titles
  • Abstracts

🔍 For the data analysis itself, check out the Jupyter Notebook!

🔍 And check out the blog post synthesizing the results here.

Authors

Neurips num authors

Most prolific authors

The top 10 authors with the most papers at NeurIPS 2023 are:

  • Bo Li: 15 papers
  • Ludwig Schmidt: 14 papers
  • Bo Han: 13 papers
  • Mihaela van der Schaar: 13 papers
  • Hao Wang: 12 papers
  • Dacheng Tao: 11 papers
  • Bernhard Schölkopf: 11 papers
  • Masashi Sugiyama: 11 papers
  • Andreas Krause: 11 papers
  • Tongliang Liu: 11 papers

Number of unique authors

There were 13,012 unique authors at NeurIPS 2023, up from 9913 at NeurIPS 2022.

This continues the exponential explosion of unique authors over the past decade.

Neurips unique authors history

Number of authors per paper

Titles

Title Length

Neurips 2023 title length histogram

  • The average title length was 8.72 words, up from 8.48 at NeurIPS 2022. This continues an ongoing trend of title lengthening:

Neurips title length history

Prevalence of Acronyms

22% of titles introduced an acronym, up from 18% at NeurIPS 2022.

LaTeX in Titles

  • 1.3% of titles contained LaTeX, whereas none of the titles at NeurIPS 2022 contained LaTeX.

Abstracts

abstract length

Abstract Length

GitHub Reigns Supreme

  • Out of the 3581 abstracts, 675 explicitly mention GitHub, including a link to their code, models, or data.
  • Only 79 abstracts include a URL that is not GitHub.

Modalities, Models, and Tasks

Using a CLIP model, we zero-shot classified/predicted the modality of focus for each paper based on its abstract. The categories were ["vision", "text", "audio", "tabular", "time series", "multimodal"].

By far the biggest category was multimodal, with a count of 1296. However, the CLIP model's inclination towards "multimodal" may be somewhat biased by trying to partially fit other modalities — the words multi-modal and multimodal only show up in 156 abstracts, and phrases like vision-language and text-to-image only appear a handful of times across the dataset.

Themes occurring frequently include:

  • "benchmark": 730
  • ("generation", "generate"): 681
  • ("efficient", "efficiency"): 963
  • "agent": 280
  • ("llm", "large language model"): 238

Cool NeurIPS Projects

TitlePaperCodeProject PageHugging FaceBlog
An Inverse Scaling Law for CLIP TrainingarXivGitHub
Augmenting Language Models with Long-Term MemoryarXivGitHub
Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsarXivGitHubProjectBlog
Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language ModelsarXivGitHubProjectBlog
DataComp: In search of the next generation of multimodal datasetsarXivGitHubProjectBlog
Direct Preference Optimization: Your Language Model is Secretly a Reward ModelarXivGitHubBlog
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic DataarXivGitHubProjectBlog
Fine-Tuning Language Models with Just Forward PassesarXivGitHubBlog
Generating Images with Multimodal Language ModelsarXivGitHubProject
Holistic Evaluation of Text-To-Image ModelsarXivGitHubProjectBlog
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FacearXivGitHubHugging Face
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationarXivGitHubHugging FaceBlog
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction TuningarXivGitHubHugging FaceBlog
Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaarXivGitHub
LAMM: Multi-Modal Large Language Models and Applications as AI AgentsarXivGitHubProjectHugging Face
LIMA: Less Is More for AlignmentarXivBlog
LLM-Pruner: On the Structural Pruning of Large Language ModelsarXivGitHub
LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision ScenarioarXivGitHub
MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware DiffusionarXivGitHubProject
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image EditingarXivGitHubProjectHugging FaceBlog
Mathematical Capabilities of ChatGPTarXivGitHubProject
Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent RepresentationarXivGitHubProject
Motion-X: A Large-scale 3D Expressive Whole-body Human Motion DatasetarXivGitHubProject
MotionGPT: Human Motion as Foreign LanguagearXivGitHubProjectHugging FaceBlog
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsarXivGitHubHugging FaceBlog
Photoswap: Personalized Subject Swapping in ImagesarXivGitHubProject
Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image GenerationarXivGitHubHugging FaceBlog
QLoRA: Efficient Finetuning of Quantized LLMsarXivGitHubHugging FaceBlog
Reflexion: Language Agents with Verbal Reinforcement LearningarXivGitHubBlog
ResShift: Efficient Diffusion Model for Image Super-resolution by Residual ShiftingarXivGitHubProjectBlog
Segment Anything in 3D with NeRFsarXivGitHubProjectBlog
Segment Anything in High QualityarXivGitHubHugging FaceBlog
Segment Everything Everywhere All at OncearXivGitHub
Self-Refine: Iterative Refinement with Self-FeedbackarXivGitHubProjectBlog
Simple and Controllable Music GenerationarXivGitHubBlog
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New PerspectivearXivGitHub
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data OnlyarXivHugging FaceBlog
Toolformer: Language Models Can Teach Themselves to Use ToolsarXivBlog
Unlimiformer: Long-Range Transformers with Unlimited Length InputarXivGitHubBlog
Visual Instruction TuningarXivGitHubProjectHugging FaceBlog

Conference Schedule

Note: GitHub automatically truncates files larger than 512 KB. To have all papers display on GitHub, we've split the file up by session.

Poster Session 1

Poster Session 2

Poster Session 3

Poster Session 4

Poster Session 5

Poster Session 6

Posters Not Presented

ai
awesome
awesome-list
awesome-readme
machine-learning
neurips
neurips-2023

Contributors

jacobmarks

16 commits

galtay

1 commits

jacobmarks/awesome-neurips-2023

Conference schedule, top papers, and analysis of the data for NeurIPS 2023!

Jupyter Notebook

121

17 commits

updated Dec 15, 2023

See the code

README

Awesome NeurIPS 2023 Info

Neurips 2023 wordcloud Caption: Wordcloud of all NeurIPS 2023 titles

Welcome to the hub for all things NeurIPS 2023! We scraped the data for all 3500+ NeurIPS projects and dove into the depths of Hugging Face, GitHub, LinkedIn, and Arxiv to pick out the most interesting content.

In this repo, you will find:

  • Data Analysis: detailed analysis of the titles and abstracts from NeurIPS 2023 accepted papers
  • Awesome Projects: synthesized collection of 40 NeurIPS 2023 papers you won't want to miss
  • Conference Schedule: comprehensive listing of all NeurIPS 2023 projects (title, authors, abstract) organized by poster session and sorted alphabetically

Data Analysis

The raw data is included in this repo. If you have ideas for other interesting analyses, feel free to create an issue or submit a PR!

For now, insights are organized into the following categories:

  • Authors
  • Titles
  • Abstracts

🔍 For the data analysis itself, check out the Jupyter Notebook!

🔍 And check out the blog post synthesizing the results here.

Authors

Neurips num authors

Most prolific authors

The top 10 authors with the most papers at NeurIPS 2023 are:

  • Bo Li: 15 papers
  • Ludwig Schmidt: 14 papers
  • Bo Han: 13 papers
  • Mihaela van der Schaar: 13 papers
  • Hao Wang: 12 papers
  • Dacheng Tao: 11 papers
  • Bernhard Schölkopf: 11 papers
  • Masashi Sugiyama: 11 papers
  • Andreas Krause: 11 papers
  • Tongliang Liu: 11 papers

Number of unique authors

There were 13,012 unique authors at NeurIPS 2023, up from 9913 at NeurIPS 2022.

This continues the exponential explosion of unique authors over the past decade.

Neurips unique authors history

Number of authors per paper

Titles

Title Length

Neurips 2023 title length histogram

  • The average title length was 8.72 words, up from 8.48 at NeurIPS 2022. This continues an ongoing trend of title lengthening:

Neurips title length history

Prevalence of Acronyms

22% of titles introduced an acronym, up from 18% at NeurIPS 2022.

LaTeX in Titles

  • 1.3% of titles contained LaTeX, whereas none of the titles at NeurIPS 2022 contained LaTeX.

Abstracts

abstract length

Abstract Length

GitHub Reigns Supreme

  • Out of the 3581 abstracts, 675 explicitly mention GitHub, including a link to their code, models, or data.
  • Only 79 abstracts include a URL that is not GitHub.

Modalities, Models, and Tasks

Using a CLIP model, we zero-shot classified/predicted the modality of focus for each paper based on its abstract. The categories were ["vision", "text", "audio", "tabular", "time series", "multimodal"].

By far the biggest category was multimodal, with a count of 1296. However, the CLIP model's inclination towards "multimodal" may be somewhat biased by trying to partially fit other modalities — the words multi-modal and multimodal only show up in 156 abstracts, and phrases like vision-language and text-to-image only appear a handful of times across the dataset.

Themes occurring frequently include:

  • "benchmark": 730
  • ("generation", "generate"): 681
  • ("efficient", "efficiency"): 963
  • "agent": 280
  • ("llm", "large language model"): 238

Cool NeurIPS Projects

TitlePaperCodeProject PageHugging FaceBlog
An Inverse Scaling Law for CLIP TrainingarXivGitHub
Augmenting Language Models with Long-Term MemoryarXivGitHub
Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsarXivGitHubProjectBlog
Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language ModelsarXivGitHubProjectBlog
DataComp: In search of the next generation of multimodal datasetsarXivGitHubProjectBlog
Direct Preference Optimization: Your Language Model is Secretly a Reward ModelarXivGitHubBlog
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic DataarXivGitHubProjectBlog
Fine-Tuning Language Models with Just Forward PassesarXivGitHubBlog
Generating Images with Multimodal Language ModelsarXivGitHubProject
Holistic Evaluation of Text-To-Image ModelsarXivGitHubProjectBlog
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FacearXivGitHubHugging Face
ImageReward: Learning and Evaluating Human Preferences for Text-to-Image GenerationarXivGitHubHugging FaceBlog
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction TuningarXivGitHubHugging FaceBlog
Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaarXivGitHub
LAMM: Multi-Modal Large Language Models and Applications as AI AgentsarXivGitHubProjectHugging Face
LIMA: Less Is More for AlignmentarXivBlog
LLM-Pruner: On the Structural Pruning of Large Language ModelsarXivGitHub
LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision ScenarioarXivGitHub
MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware DiffusionarXivGitHubProject
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image EditingarXivGitHubProjectHugging FaceBlog
Mathematical Capabilities of ChatGPTarXivGitHubProject
Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent RepresentationarXivGitHubProject
Motion-X: A Large-scale 3D Expressive Whole-body Human Motion DatasetarXivGitHubProject
MotionGPT: Human Motion as Foreign LanguagearXivGitHubProjectHugging FaceBlog
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsarXivGitHubHugging FaceBlog
Photoswap: Personalized Subject Swapping in ImagesarXivGitHubProject
Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image GenerationarXivGitHubHugging FaceBlog
QLoRA: Efficient Finetuning of Quantized LLMsarXivGitHubHugging FaceBlog
Reflexion: Language Agents with Verbal Reinforcement LearningarXivGitHubBlog
ResShift: Efficient Diffusion Model for Image Super-resolution by Residual ShiftingarXivGitHubProjectBlog
Segment Anything in 3D with NeRFsarXivGitHubProjectBlog
Segment Anything in High QualityarXivGitHubHugging FaceBlog
Segment Everything Everywhere All at OncearXivGitHub
Self-Refine: Iterative Refinement with Self-FeedbackarXivGitHubProjectBlog
Simple and Controllable Music GenerationarXivGitHubBlog
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New PerspectivearXivGitHub
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data OnlyarXivHugging FaceBlog
Toolformer: Language Models Can Teach Themselves to Use ToolsarXivBlog
Unlimiformer: Long-Range Transformers with Unlimited Length InputarXivGitHubBlog
Visual Instruction TuningarXivGitHubProjectHugging FaceBlog

Conference Schedule

Note: GitHub automatically truncates files larger than 512 KB. To have all papers display on GitHub, we've split the file up by session.

Poster Session 1

Poster Session 2

Poster Session 3

Poster Session 4

Poster Session 5

Poster Session 6

Posters Not Presented

ai
awesome
awesome-list
awesome-readme
machine-learning
neurips
neurips-2023

Contributors

jacobmarks

16 commits

galtay

1 commits

Languages

Jupyter Notebook

95.4%

Python

4.6%