Awesome 3D Gaussian Splatting Resources

3D Gaussian Splatting (3DGS) opens a new window for using neural rendering for real applications. This repo is intended to provide a collection of papers that are related to 3DGS, but not necessarily use 3DGS.

In general, 3D Gaussian Splatting can be considered as a variant of NeRF. This repo will more focused on the practical side of NeRF, e.g. realtime, compatibility with Unity/Unreal, ease of editing, etc.

Other resources:

• Dynamic NeRF
• awesome-LLMs-finetuning

Verified: Papers listed with [+] have been verfied by myself or colleagues. The code is runnable. Please leave an issue if you need help on setting up.

If you have any additions or suggestions, feel free to contribute. Everything is welcome.

Most Recent Update & News:

Complete List

• Aug 2024: added papers for improving NeRF speed
• May 2024: added 2024 section, added LLM subsection
• Dec 2023: added verified section
• 26 Nov 2023: added more details for cumstom data.
• Nov 2023: Start a separate page for NeRF
• 29 Oct 2023: Start a separate page for Dynamic NeRF

CVPR 2024 word cloud:

1. 3D Reconstruction

• 3D Gaussian Splatting for Real-Time Radiance Field Rendering, Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis, SIGGRAPH 2023 (Best Paper). [📄 Paper (Low Resolution) | 📄 Paper (High Resolution) | 🌐 Project Page | 💻 Code | 🎥 Short Presentation | 🎥 Explanation Video | ]

Other 3D Papers

• N-BVH: Neural ray queries with bounding volume hierarchies, SIGGRAPH 2024. [Paper | Project | Code]
• High-quality Surface Reconstruction using Gaussian Surfels. [Paper | Code]
• Toon3D: Seeing Cartoons from a New Perspective, 2024. [Paper | Project | Code]
• Texture Generation on 3D Meshes with Point-UV Diffusion, 2024. [Paper | Project | Code]

2024

General

• [+] 2DGS: 2D Gaussian Splatting for Geometrically Accurate Radiance Fields, SIGGRAPH 2024. [Paper | Project | Code]

• Deblur-GS: 3D Gaussian Splatting from Camera Motion Blurred Images, I3D 2024. [Paper | Code]

• GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting, [Paper | Code]

• DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark, [Paper | Project]

• GaussianPro: 3D Gaussian Splatting with Progressive Propagation, ICML 2024. [Paper | Project]

• VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality, [Paper | Project]

• MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images, ECCV2024. [Paper | Project]

• DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting, [Paper | Project]

• COLMAP-Free 3D Gaussian Splatting, CVPR2024. [Paper | Project | Code]

• FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization, CVPR 2024. [Paper | Project]

• GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting, CVPR 2024. [Project]

• LangSplat: 3D Language Gaussian Splatting, CVPR 2024 (Highlight). [Project | Code]

• SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering, CVPR 2024.

• GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces, CVPR 2024. [Project | Code]

• pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction, CVPR 2024.

• Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers, CVPR 2024. [Project | Code]

• GS-IR: 3D Gaussian Splatting for Inverse Rendering, CVPR 2024. [Project | Code]

• GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis, CVPR 2024. [Project | Code]

• Surfel-based Gaussian Inverse Rendering for Fast and Relightable Dynamic Human Reconstruction from Monocular Video, 2024. [Paper | Project]

• GaussMR: Interactive Gaussian Splatting Sandbox with GPU Particles and Signed Distance Fields, SIGGRAPH 2024. [Paper]

• MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo, ECCV 2024. [Project | Code]

• Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Image, CVPRW 2024 (3DMV). [Project | Code]

• Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting, 2024. [Project | Code]

• Deblurring 3D Gaussian Splatting, ECCV 2024. [Project | Code]

• bsGS: Recovering Fine Details for 3D Gaussian Splatting, ACM MM 2024. Code

• GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting, 2024. [Project]

• WildGaussians: 3D Gaussian Splatting in the Wild, 2024. [Project]

• Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections, 2024. [Project | Code]

• On Scaling Up 3D Gaussian Splatting Training, 2024. [Project | Code]

Literature Review

• Recent advances in 3D Gaussian splatting, Computational Visual Media, 2024. [Paper]
• 3D Gaussian Splatting as New Era: A Survey, IEEE Transactions on Visualization and Computer Graphics, 2024. [Paper]
• Gaussian Splatting: 3D Reconstruction and Novel View Synthesis: A Review, IEEE Access, 2024. [Paper]

NeRF (Improving speed & efficiency)

• How Far Can We Compress Instant-NGP-Based NeRF? CVPR 2024. [Project | code]
• FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices With a Simple Super-Resolution Pipeline, WACV 2024. [Paper]
• HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces, CVPR 2024. Project

Dynamic

• Shape of Motion: 4D Reconstruction from a Single Video, 2024. [Project | Code]
• MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds, 2024. Project
• Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos, 2024.
• CoGS : Controllable Gaussian Splatting, CVPR 2024. [Project | Code]

LLM & 3D

• Comp4D: LLM-Guided Compositional 4D Scene Generation, [Paper | Project]
• GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guidedGenerative Gaussian Splatting, [Paper | Project]

SLAM & Sensor Fusion

• Gaussian Splatting SLAM, CVPR 2024 [Paper | Code]
• SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM, CVPR 2024. [Paper | Code]
• RGBD GS-ICP SLAM, [Paper | Code]
• Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting, [Paper | Code]
• Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Cameras, [Paper | Code]

Compression & Efficiency

• GaussianPro: 3D Gaussian Splatting with Progressive Propagation, [Paper | Code]
• InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 10 Seconds, [Paper
• HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression, [Paper | Code]
• Reducing the Memory Footprint of 3D Gaussian Splatting, [Paper | Project]
• SUNDAE: Spectrally Pruned Gaussian Fields with Neural Compensation, [Paper | Code]
• Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis, CVPR 2024. [Project | Code]

2023

Speed & Efficiency

• [+] LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS, 2023. [Paper | Code]
• [+] SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering, 2023. [Paper | Code]
• Compact 3D Gaussian Representation for Radiance Field, [Paper | Code]
• Compact3D: Compressing Gaussian Splat Radiance Field Models with Vector Quantization, [Paper | Code]

Quality

• Mip-Splatting: Alias-free 3D Gaussian Splatting, [Paper | Code]
• Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering, [Paper | Code]
• FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information, Paper
• COLMAP-Free 3D Gaussian Splatting, [Paper | Project]
• NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance, Paper
• Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images, Paper
• GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting, Paper

Reflection & Relighting

• GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces, [Paper | Code]
• Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing, Paper

Others

• Splatter Image: Ultra-Fast Single-View 3D Reconstruction, [Paper | Code]
• pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction, [Paper | Project Page]
• Volume Feature Rendering for Fast Neural Radiance Field Reconstruction, NeurIPS 2023.

2. Dynamic 3D Gaussian Splatting:

• [+] 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering, [Paper | Project Page | Code | ]
• [+] 4K4D: Real-Time 4D View Synthesis at 4K Resolution. [Paper | Project Page | Code (Inference)]]
• Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis, [Paper | Project Page | Code | Explanation Video]
• Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction, [Paper | Project Page | Code]
• Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting, Paper
• GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis, Project Page

3. Generative 3D Gaussian Splatting:

Papers with shared code are ranked higher in this list

• DreamGaussian4D: Generative 4D Gaussian Splatting, [Paper | Code]
• Text-to-3D using Gaussian Splatting, [📄 Paper | Project Page | Code | Explanation Video]
• DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation, Paper | Project Page | Code | Explanation Video]
• GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors, [Paper | Project Page | Code]
• Gsgen: Text-to-3D using Gaussian Splatting, [Paper | Project Page | Code]
• LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes, [Paper | Project Page]
• PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics, [Paper | Project Page]
• HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting, [Paper]
• Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting, [Paper | Code]

4. Digital Avatar

• Gaussian Shell Maps for Efficient 3D Human Generation, [Paper | Code]
• GauHuman: Articulated Gaussian Splatting from Monocular Human Videos, [Paper | Project Page | Code]
• HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting, Paper
• HUGS: Human Gaussian Splats, Paper
• SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos, Paper
• Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling, Paper
• Human101: Training 100+FPS Human Gaussians in 100s from 1 View, Paper
• Deformable 3D Gaussian Splatting for Animatable Human Avatars, Paper

5. LLM 3D Gaussian Splatting

• LangSplat: 3D Language Gaussian Splatting, [Paper | Project Page | Code]

6. 3D Gaussian Viewers

Colab

• Camenduru
• NeRFStudio

Training

• fast: C++/CUDA
• nerfstudio: python/CUDA
• Taichi 3D Gaussian Splatting

Viewers

• Playcanvas
• Luma AI (WebGL)
• WebGL Viewer 1
• WebGL Viewer 2
• Three.js
• A-Frame

Game Engines

• Unity Implementation
• Blender

6. Documents

Product

• Luma AI
• Polycam

Blog Posts

1. Gaussian Splatting is pretty cool
2. Making Gaussian Splats smaller
3. Making Gaussian Splats more smaller

Tutorial Videos

1. Getting Started with 3DGS
2. How to view 3DGS Scenes in Unity

Reference

• Gaussian Splatting
• MrNeRF
• https://dellaert.github.io/NeRF22/
• https://github.com/yangjiheng/nerf_and_beyond_docs