Awesome Knowledge-Distillation for Autonomous Driving

• Autonomous Driving

  • 3D Object Detection

    • Camera-only
    • LiDAR-based

  • Segmentation

  • Auto Labeling

3D Object Detection

Camera-only Distillation

1. Leveraging Vision-Centric Multi-Modal Expertise for 3D Object Detection. NeurIPS 2023 [Official Code]

2. BEVSimDet: Simulated Multi-modal Distillation in Bird's-Eye View for Multi-view 3D Object Detection. Arxiv 2023 [Official Code]

3. Distilling Focal Knowledge From Imperfect Expert for 3D Object Detection. CVPR 2023 [Official Code]

4. UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View. CVPR 2023 [Official Code]

5. X $^3$ KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection. CVPR 2023

6. BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection. ICLR 2023 [Official Code]

7. BEV-LGKD: A Unified LiDAR-Guided Knowledge Distillation Framework for BEV 3D Object Detection. Arxiv 2022

8. TiG-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning. Arxiv 2022 [Official Code]

9. Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection. Arxiv 2022

10. Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detection. ECCV 2022 [Official Code]

11. Lidar Point Cloud Guided Monocular 3D Object Detection. ECCV 2022 [Official Code]

12. LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector. ICCV 2021 [Official Code]

LiDAR-based Distillation

1. Representation Disparity-aware Distillation for 3D Object Detection. ICCV 2023

2. itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detection. CVPR 2023

3. PointDistiller: Structured Knowledge Distillation TowardsEfficient and Compact 3D Detection. CVPR 2023 [Official Code]

4. UniDistill: A Universal Cross-Modality Knowledge Distillation Framework for 3D Object Detection in Bird's-Eye View. CVPR 2023 [Official Code]

5. Towards Efficient 3D Object Detection withKnowledge Distillation. NeurIPS 2022 [Official Code]

6. LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detection. ECCV 2022 [Official Code]

Pretraining Distillation

1. Geometric-aware Pretraining for Vision-centric 3D Object Detection. Arxiv 2023 [Official Code]

2. Towards Better 3D Knowledge Transfer via Masked Image Modeling for Multi-view 3D Understanding. ICCV 2023 [Official Code]

Segmentation

1. Segment Any Point Cloud Sequences by Distilling Vision Foundation Models. NeurIPS 2023 [Official Code]

2. Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data. CVPR 2022 [Official Code]

Auto Labeling

1. Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Driving. ICCV 2023

---

Note: All papers' pdf can be found and downloaded on arXiv, Google or Bing.