CVPR-2024-Papers

官网链接：https://cvpr.thecvf.com/

研讨会 🔔：6 月 17-18 日

主会 🔔：6 月 19-21 日

历年综述论文分类汇总戳这里↘️CV-Surveys施工中~~~~~~~~~~

2024 年论文分类汇总戳这里

↘️WACV-2024-Papers ↘️CVPR-2024-Papers ↘️ECCV-2024-Papers

2023 年论文分类汇总戳这里

↘️CVPR-2023-Papers ↘️WACV-2023-Papers ↘️ICCV-2023-Papers

2022 年论文分类汇总戳这里

2021 年论文分类汇总戳这里

2020 年论文分类汇总戳这里

💥💥💥收录论文已全部更新，并全部分类完成！！！

🏆Best Papers

• Generative Image Dynamics
  🏠project
• Rich Human Feedback for Text-to-Image Generation

🏅Best Paper Runners-Up

• EventPS: Real-Time Photometric Stereo Using an Event Camera
• pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction

🥇Best Student Papers

• Mip-Splatting: Alias-free 3D Gaussian Splatting
  ⭐code
  🏠project
• BioCLIP: A Vision Foundation Model for the Tree of Life
  ⭐code

🥈Best Student Paper Runner-Ups

• SpiderMatch: 3D Shape Matching with Global Optimality and Geometric Consistency
• Image Processing GNN: Breaking Rigidity in Super-Resolution
• Objects as Volumes: A Stochastic Geometry View of Opaque Solids
• Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methods

目录

62.全家桶

• UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio Video Point Cloud Time-Series and Image Recognition
  ⭐code用于音频、视频、点云、时间序列和图像识别的通用感知大内核卷积网络
• GPT4Point: A Unified Framework for Point-Language Understanding and Generation点语言理解和生成的统一框架
• AvatarGPT: All-in-One Framework for Motion Understanding Planning Generation and Beyond用于运动理解、规划、生成等的一体化框架

61.Gaze

• Sharingan: A Transformer Architecture for Multi-Person Gaze Following目光跟随
• From Feature to Gaze: A Generalizable Replacement of Linear Layer for Gaze Estimation

60.Sketch(草图)

• What Sketch Explainability Really Means for Downstream Tasks
• SketchINR: A First Look into Sketches as Implicit Neural Representations
• Open Vocabulary Semantic Scene Sketch Understanding草图理解
• CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attention

59.Clustering(聚类)

• MoDE: CLIP Data Experts via Clustering聚类
• Fine-Grained Bipartite Concept Factorization for Clustering
• 多视图聚类
  • Investigating and Mitigating the Side Effects of Noisy Views for Self-Supervised Clustering Algorithms in Practical Multi-View Scenarios
  • Learn from View Correlation: An Anchor Enhancement Strategy for Multi-view Clustering
  • Differentiable Information Bottleneck for Deterministic Multi-view Clustering

58.Fisheye Images(鱼眼图像)

• Deep Single Image Camera Calibration by Heatmap Regression to Recover Fisheye Images Under Manhattan World Assumption鱼眼图像

57.Visual Relationship Detection(视觉关系检测)

• Groupwise Query Specialization and Quality-Aware Multi-Assignment for Transformer-based Visual Relationship Detection
  ⭐code

56.Visual emotion recognition(视觉情绪识别)

• EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ⭐code视觉情感理解
• 多模态意图识别
  • Contextual Augmented Global Contrast for Multimodal Intent Recognition

55.Referring Expression Comprehension(指代表达理解)

• ScanFormer: Referring Expression Comprehension by Iteratively Scanning
• Zero-shot Referring Expression Comprehension via Structural Similarity Between Images and Captions
  ⭐code零样本指代表达理解
• Revisiting Counterfactual Problems in Referring Expression Comprehension

54.Vision Transformers

• Dexterous Grasp Transformer
• Mean-Shift Feature Transformer
• MLP Can Be A Good Transformer Learner
  ⭐code
• Unifying Top-down and Bottom-up Scanpath Prediction Using Transformers
• Solving Masked Jigsaw Puzzles with Diffusion Vision Transformers
• Dual-scale Transformer for Large-scale Single-Pixel Imaging
• DeiT-LT: Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets
• Solving Masked Jigsaw Puzzles with Diffusion Transformers
• Towards Understanding and Improving Adversarial Robustness of Vision Transformers
• RMT: Retentive Networks Meet Vision Transformers
  ⭐code
• You Only Need Less Attention at Each Stage in Vision Transformers
• MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers
  🏠project
• Instance-Aware Group Quantization for Vision Transformers
  🏠project
• Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers
  ⭐code
• RepViT: Revisiting Mobile CNN From ViT Perspective
  ⭐code
• Token Transformation Matters: Towards Faithful Post-hoc Explanation for Vision Transformer
• Autoregressive Queries for Adaptive Tracking with Spatio-Temporal Transformers
  👍摘要
• Comparing the Decision-Making Mechanisms by Transformers and CNNs via Explanation Methods
• On the Faithfulness of Vision Transformer Explanations
• Learning Correlation Structures for Vision Transformers
• Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach
  ⭐code
• Once for Both: Single Stage of Importance and Sparsity Search for Vision Transformer Compression
• Point Transformer V3: Simpler Faster Stronger
  ⭐code
• A General and Efficient Training for Transformer via Token Expansion
  ⭐code
• HEAL-SWIN: A Vision Transformer On The Sphere
  ⭐code
• SHViT: Single-Head Vision Transformer with Memory Efficient Macro DesignVision
• TransNeXt: Robust Foveal Visual Perception for Vision Transformers
  ⭐code
• Making Vision Transformers Truly Shift-Equivariant
• Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ⭐code
• Random Entangled Tokens for Adversarially Robust Vision Transformer

53.Light-Field(光场)

• Time-Efficient Light-Field Acquisition Using Coded Aperture and Events
  🏠project
• Continuous Pose for Monocular Cameras in Neural Implicit Representation
  ⭐code
• PanoPose: Self-supervised Relative Pose Estimation for Panoramic Images
  🏠project
• Unbiased Estimator for Distorted Conics in Camera Calibration
• 相机姿态
  • Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences
  • Map-Relative Pose Regression for Visual Re-Localization
    ⭐code
  • The Unreasonable Effectiveness of Pre-Trained Features for Camera Pose Refinement
    ⭐code
• 快照压缩成像
  • DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model

52.Biomedical

• ManiFPT: Defining and Analyzing Fingerprints of Generative Models
• Flexible Biometrics Recognition: Bridging the Multimodality Gap through Attention Alignment and Prompt Tuning生物识别
• 人员识别
  • Activity-Biometrics: Person Identification from Daily Activities
    ⭐code

51.Style Transfer(风格迁移)

• Z*: Zero-shot Style Transfer via Attention Reweighting
• MoST: Motion Style Transformer Between Diverse Action Contents
  ⭐code
• ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation
  ⭐code
  🏠project
• Arbitrary Motion Style Transfer with Multi-condition Motion Latent Diffusion Model
• Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer
  🏠project
• Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion Network
  👍平衡效率与质量，南航提出新风格迁移算法Puff-Net
• 零样本文本驱动运动迁移
  • Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer
    🏠project

50.OOD Detection

• Test-Time Linear Out-of-Distribution Detection
• Segment Every Out-of-Distribution Object
• Label-Efficient Group Robustness via Out-of-Distribution Concept Curation
• Enhancing the Power of OOD Detection via Sample-Aware Model SelectionOOD
• Discriminability-Driven Channel Selection for Out-of-Distribution Detection
• CORES: Convolutional Response-based Score for Out-of-distribution Detection
• Learning Transferable Negative Prompts for Out-of-Distribution Detection
  ⭐code
• A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?
  ⭐code
• Improving Out-of-Distribution Generalization in Graphs via Hierarchical Semantic Environments
• A Noisy Elephant in the Room: Is Your Out-of-Distribution Detector Robust to Label Noise?
• 异常检测
  • Hyperbolic Anomaly Detection
  • Universal Novelty Detection through Adaptive Contrastive Learning
  • Looking 3D: Anomaly Detection with 2D-3D Alignment

49.Dataset(数据集)

• 数据集
  • Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
  • 4D-DRESS: A 4D Dataset of Real-World Human Clothing With Semantic Annotations
  • DiLiGenRT: A Photometric Stereo Dataset with Quantified Roughness and Translucency
  • MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generation
  • LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs
  • 360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queries
  • Towards Automatic Power Battery Detection: New Challenge Benchmark Dataset and Baseline
  • MSU-4S - The Michigan State University Four Seasons Dataset
  • DiVa-360: The Dynamic Visual Dataset for Immersive Neural Fields
  • Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
  • LiDAR-Net: A Real-scanned 3D Point Cloud Dataset for Indoor Scenes
  • Advancing Saliency Ranking with Human Fixations: Dataset, Models and Benchmarks
  • MAGICK: A Large-scale Captioned Dataset from Matting Generated Images using Chroma Keying
  • HardMo: A Large-Scale Hardcase Dataset for Motion Capture
  • The STVchrono Dataset: Towards Continuous Change Recognition in Time
  • Insect-Foundation: A Foundation Model and Large-scale 1M Dataset for Visual Insect Understanding
  • LED: A Large-scale Real-world Paired Dataset for Event Camera Denoising
  • On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm
  • Towards Modern Image Manipulation Localization: A Large-Scale Dataset and Novel Methods
  • Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation
  • FineSports: A Multi-person Hierarchical Sports Video Dataset for Fine-grained Action Understanding细粒度动作理解
  • MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos
    🏠project
  • Traffic Scene Parsing through the TSP6K Dataset
  • Spectral and Polarization Vision: Spectro-polarimetric Real-world Dataset
  • RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos
    🏠project
    🌻datasetRGB-D object数据集
  • eTraM: Event-based Traffic Monitoring Dataset
    ⭐code
    🏠project流量监控数据集
  • Towards Real-World HDR Video Reconstruction: A Large-Scale Benchmark Dataset and A Two-Stage Alignment Network
    🌻dataset
  • JRDB-Social: A Multifaceted Robotic Dataset for Understanding of Context and Dynamics of Human Interactions Within Social Groups
    🏠project
  • TULIP: Multi-camera 3D Precision Assessment of Parkinson's Disease
  • JRDB-PanoTrack: An Open-world Panoptic Segmentation and Tracking Robotic Dataset in Crowded Human Environments
  • OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completion
    🏠project
  • SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos
  • RELI11D: A Comprehensive Multimodal Human Motion Dataset and Method
    🏠project
    👍摘要
  • MatSynth: A Modern PBR Materials Dataset
    🏠project
  • RCooper: A Real-world Large-scale Dataset for Roadside Cooperative Perception
    ⭐code
  • Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detection
  • EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World
    ⭐code
  • MCD: Diverse Large-Scale Multi-Campus Dataset for Robot Perception
    🌻dataset
  • HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarios
  • HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative
    🌻dataset
  • DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Vision
    🌻dataset
  • EFHQ: Multi-purpose ExtremePose-Face-HQ dataset
    ⭐code
    🏠project数据集
  • LUWA Dataset: Learning Lithic Use-Wear Analysis on Microscopic Images
  • MMVP: A Multimodal MoCap Dataset with Vision and Pressure Sensors
    ⭐code
  • FreeMan: Towards Benchmarking 3D Human Pose Estimation under Real-World Conditions
    🏠project
  • TUMTraf V2X Cooperative Perception Dataset
    🏠project
  • MVHumanNet: A Large-scale Dataset of Multi-view Daily Dressing Human Captures
    🌻dataset
• 基准
  • When Visual Grounding Meets Gigapixel-level Large-scale Scenes: Benchmark and Approach
  • THRONE: A Hallucination Benchmark for the Free-form Generations of Large Vision-Language Models
  • M3-UDA: A New Benchmark for Unsupervised Domain Adaptive Fetal Cardiac Structure Detection
    ⭐code
  • DriveTrack: A Benchmark for Long-Range Point Tracking in Real-World Videos现实视频中远程点跟踪的基准
  • SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge
  • MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding
  • RoDLA: Benchmarking the Robustness of Document Layout Analysis Models
    ⭐code
  • GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation
  • MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
  • Advancing Saliency Ranking with Human Fixations: Dataset Models and Benchmarks
  • ConCon-Chi: Concept-Context Chimera Benchmark for Personalized Vision-Language Tasks
  • Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark
    ⭐code
  • UVEB: A Large-scale Benchmark and Baseline Towards Real-World Underwater Video Enhancement
  • PKU-DyMVHumans: A Multi-View Video Benchmark for High-Fidelity Dynamic Human Modeling
    🏠project
  • MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
    ⭐code
  • Uncovering What Why and How: A Comprehensive Benchmark for Causation Understanding of Video Anomaly
  • VBench : Comprehensive Benchmark Suite for Video Generative Models
    ⭐code
    🏠project
  • MTMMC: A Large-Scale Real-World Multi-Modal Camera Tracking Benchmark
  • CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programs
    🏠project
  • How to Train Neural Field Representations: A Comprehensive Study and Benchmark
  • OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM

48.Semi/self-supervised learning(半/自监督)

• 弱监督学习
  • 部分标签学习
    • CroSel: Cross Selection of Confident Pseudo Labels for Partial-Label Learning部分标签学习-弱监督学习问题
• 半监督
  • Targeted Representation Alignment for Open-World Semi-Supervised Learning
  • SeNM-VAE: Semi-Supervised Noise Modeling with Hierarchical Variational Autoencoder
  • CDMAD: Class-Distribution-Mismatch-Aware Debiasing for Class-Imbalanced Semi-Supervised Learning
  • BEM: Balanced and Entropy-based Mix for Long-Tailed Semi-Supervised Learning
  • 正样本标签学习
    • Positive-Unlabeled Learning by Latent Group-Aware Meta DisambiguationPositive-Unlabeled Learning(正样本标签学习)半监督学习的一个重要分支
• 自监督学习
  • Self-supervised Representation Learning from Arbitrary Scenarios
  • Self-supervised Debiasing Using Low Rank Regularization
  • Self-Supervised Dual Contouring
  • Neural Modes: Self-supervised Learning of Nonlinear Modal Subspaces
  • Self-Supervised Representation Learning from Arbitrary Scenarios
  • SD2Event: Self-supervised Learning of Dynamic Detectors and Contextual Descriptors for Event Cameras
  • An Asymmetric Augmented Self-Supervised Learning Method for Unsupervised Fine-Grained Image Hashing
  • Self-supervised debiasing using low rank regularization
  • CNC-Net: Self-Supervised Learning for CNC Machining Operations
• 无监督学习
  • Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos

47.Dense Predictions(密集预测)

• Efficient Multitask Dense Predictor via Binarization密集预测
• Going Beyond Multi-Task Dense Prediction with Synergy Embedding Models
• Exploiting Diffusion Prior for Generalizable Dense Prediction
  🏠project
• ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictions
  ⭐code
  👍百度提出视觉新骨干ViT-CoMer，刷新密集预测任务SOTA
• Multi-Task Dense Prediction via Mixture of Low-Rank Experts
  ⭐code

46.Industrial Anomaly Detection(工业缺陷检测)

• Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detection
  ⭐code
• 异常检测
  • Supervised Anomaly Detection for Complex Industrial Images
  • Prompt-enhanced Multiple Instance Learning for Weakly Supervised Anomaly Detection弱监督异常检测
  • Multimodal Industrial Anomaly Detection by Crossmodal Feature Mapping
  • Text-Guided Variational Image Generation for Industrial Anomaly Detection and Segmentation
  • Long-Tailed Anomaly Detection with Learnable Class Names
    🏠project
  • RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detection
    ⭐code
  • Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Prompts
    ⭐code
  • PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detection
    ⭐code
• 薄膜去除
  • Learning to Remove Wrinkled Transparent Film with Polarized Prior
    ⭐code
• 基准/数据集
  • Real-IAD: A Real-World Multi-view Dataset for Benchmarking Versatile Industrial Anomaly Detection
    ⭐code
  • Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Network
    ⭐code

45.Neural Architecture Search(神经架构搜索)

• Towards Accurate and Robust Architectures via Neural Architecture Search
• Boosting Order-Preserving and Transferability for Neural Architecture Search: a Joint Architecture Refined Search and Fine-tuning Approach
• Building Optimal Neural Architectures using Interpretable Knowledge
  ⭐code
• AZ-NAS: Assembling Zero-Cost Proxies for Network Architecture Search
• SNED: Superposition Network Architecture Search for Efficient Video Diffusion Model
• Insights from the Use of Previously Unseen Neural Architecture Search Datasets
• FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer
  ⭐code

44.Image Fusion(图像融合)

• Equivariant Multi-Modality Image Fusion图像融合
• Task-Customized Mixture of Adapters for General Image Fusion
  ⭐code
• Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion
  ⭐code
• Revisiting Spatial-Frequency Information Integration from a Hierarchical Perspective for Panchromatic and Multi-Spectral Image Fusion
• Neural Spline Fields for Burst Image Fusion and Layer Separation
  🏠project
• 红外和可见光图像融合
  • Probing Synergistic High-Order Interaction in Infrared and Visible Image Fusion

43.Image Matching(图像匹配)

• XFeat: Accelerated Features for Lightweight Image Matching
  🏠project图像匹配
• 图像-文本
  • Composing Object Relations and Attributes for Image-Text Matching

42.Image Retrieval(图像检索)

• Language-only Training of Zero-shot Composed Image Retrieval
  ⭐code
• Evaluating Transferability in Retrieval Tasks: An Approach Using MMD and Kernel Methods
• Knowledge-Enhanced Dual-stream Zero-shot Composed Image Retrieval
• On Train-Test Class Overlap and Detection for Image Retrieval
  ⭐code
• D3still: Decoupled Differential Distillation for Asymmetric Image Retrieval
• Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detection
• 跨域检索
  • ProS: Prompting-to-simulate Generalized knowledge for Universal Cross-Domain Retrieval
    ⭐code
• 视频检索
  • Composed Video Retrieval via Enriched Context and Discriminative Embeddings
    ⭐code
• 跨模态检索
  • Learning to Rematch Mismatched Pairs for Robust Cross-Modal Retrieval
    ⭐code
  • Fine-grained Prototypical Voting with Heterogeneous Mixup for Semi-supervised 2D-3D Cross-modal Retrieval
• 文本-视频检索
  • Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval
    ⭐code
  • Holistic Features are almost Sufficient for Text-to-Video Retrieval
• 图像-文本检索
  • How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval?
• 视频文本检索
  • MV-Adapter: Multimodal Video Transfer Learning for Video Text Retrieval
• 组合图像检索
  • Visual Delta Generator with Large Multi-modal Models for Semi-supervised Composed Image Retrieval
• 细粒度图像检索
  • You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval
    🏠project
  • Characteristics Matching Based Hash Codes Generation for Efficient Fine-grained Image Retrieval
• 基于草图的检索
  • How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?
    ⭐code
  • Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers
    🏠project

41.Graph Generative Network(GNN/GCN)

• GNN
  • Domain Separation Graph Neural Networks for Saliency Object Ranking
  • GreedyViG: Dynamic Axial Graph Construction for Efficient Vision GNNs
  • FC-GNN: Recovering Reliable and Accurate Correspondences from Interferences
  • DGC-GNN: Leveraging Geometry and Color Cues for Visual Descriptor-Free 2D-3D Matching
  • GLiDR: Topologically Regularized Graph Generative Network for Sparse LiDAR Point Clouds图生成网络
• GCN
  • Learning for Transductive Threshold Calibration in Open-World Recognition

40.Scene Graph Generation(场景图生成)

• Leveraging Predicate and Triplet Learning for Scene Graph Generation
• OED: Towards One-stage End-to-End Dynamic Scene Graph Generation
• CLIP-Driven Open-Vocabulary 3D Scene Graph Generation via Cross-Modality Contrastive Learning
• Multi-Level Neural Scene Graphs for Dynamic Urban Environments
  ⭐code
• HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generation
  ⭐code
  ⭐code
• DSGG: Dense Relation Transformer for an End-to-end Scene Graph Generation
  ⭐code
  🏠project
• From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models
• EGTR: Extracting Graph from Transformer for Scene Graph Generation
  ⭐code
• LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generation

39.Motion Generation(动作生成)

• Programmable Motion Generation for Open-Set Motion Control Tasks
• Move as You Say Interact as You Can: Language-guided Human Motion Generation with Scene Affordance
• AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents
• Towards Variable and Coordinated Holistic Co-Speech Motion Generation
  ⭐code
• Generating Human Motion in 3D Scenes from Text Descriptions根据文本描述生成 3D 场景中的人体运动
• NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis
  🏠project人体运动合成
• OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers
  🏠project
• WANDR: Intention-guided Human Motion Generation
  📺video
• MAS: Multi-view Ancestral Sampling for 3D Motion Generation Using 2D Diffusion
  🏠project
• Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision Language Audio and Action
• Multimodal Sense-Informed Forecasting of 3D Human Motions
• 运动检索
  • Tri-Modal Motion Retrieval by Learning a Joint Embedding Space
• 动物运动
  • OmniMotionGPT: Animal Motion Generation with Limited Data
    ⭐code
    🏠project
• 人体运动预测
  • MoML: Online Meta Adaptation for 3D Human Motion Prediction
  • MoST: Multi-Modality Scene Tokenization for Motion Prediction
  • Rethinking Human Motion Prediction with Symplectic Integral
  • Human Motion Prediction Under Unexpected Perturbation
  • Continual Learning for Motion Prediction Model via Meta-Representation Learning and Optimal Memory Buffer Retention Strategy
• 人体运动估计
  • MultiPhys: Multi-Person Physics-aware 3D Motion Estimation
    🏠project
  • A Unified Diffusion Framework for Scene-aware Human Motion Estimation from Sparse Signals人体运动估计
• 人体运动重建
  • RoHM: Robust Human Motion Reconstruction via Diffusion

38.Vision Question Answering(视觉问答)

• GRAM: Global Reasoning for Multi-Page VQA
• SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities
  🏠project
• Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering
• How to Configure Good In-Context Sequence for Visual Question Answering
  ⭐code
• Causal-CoG: A Causal-Effect Look at Context Generation for Boosting Multi-modal Language Models
• Question Aware Vision Transformer for Multimodal Reasoning
• OpenEQA: Embodied Question Answering in the Era of Foundation Models
• Video-QA
  • Grounded Question-Answering in Long Egocentric Videos
    ⭐code
  • Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels
  • Language-aware Visual Semantic Distillation for Video Question Answering
  • MoReVQA: Exploring Modular Reasoning Models for Video Question Answering
  • Can I Trust Your Answer? Visually Grounded Video Question Answering
    ⭐code
  • Align and Aggregate: Compositional Reasoning with Video Alignment and Answer Aggregation for Video Question-Answering
• 图表问答
  • CoG-DQA: Chain-of-Guiding Learning with Large Language Models for Diagram Question Answering
  • Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA
• 视觉文本问答
  • VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning

37.OCR

• 场景文本识别
  • OTE: Exploring Accurate Scene Text Recognition Using One Token
  • An Empirical Study of Scaling Law for Scene Text Recognition
    ⭐code场景文本识别
  • Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizer
    ⭐code
  • Kernel Adaptive Convolution for Scene Text Detection via Distance Map Prediction
  • Choose What You Need: Disentangled Representation Learning for Scene Text Recognition Removal and Editing场景文本识别、删除和编辑
  • ODM: A Text-Image Further Alignment Pre-training Approach for Scene Text Detection and Spotting
    ⭐code
• 场景文本图像合成
  • Layout-Agnostic Scene Text Image Synthesis with Diffusion Models
• 场景文本理解
  • LayoutFormer: Hierarchical Text Detection Towards Scene Text Understanding
• 化学结构识别
  • Atom-Level Optical Chemical Structure Recognition with Limited Supervision
    ⭐code
• 文档色度检测
  • CMA: A Chromaticity Map Adapter for Robust Detection of Screen-Recapture Document Images
    ⭐code
• 文本检测
  • OmniParser: A Unified Framework for Text Spotting Key Information Extraction and Table Recognition
    ⭐code
  • Bridging the Gap Between End-to-End and Two-Step Text Spotting
    ⭐code
  • Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis
• 文档理解
  • LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understanding
    ⭐code
  • HRVDA: High-Resolution Visual Document Assistant
• 字体生成
  • Generate Like Experts: Multi-Stage Font Generation by Incorporating Font Transfer Process into Diffusion Models

36.4D Reconstruction(4D 重建)

• Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle
  🏠project
• Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Tracking
  🏠project
• 4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
  ⭐code
  🏠project
• 文本和图像引导 4D 场景生成
  • A Unified Approach for Text- and Image-guided 4D Scene Generation
    🏠project
• 4D视图合成
  • 4K4D: Real-Time 4D View Synthesis at 4K Resolution
    ⭐code
    🏠project
• 语言到 4D 建模
  • L4D-Track: Language-to-4D Modeling Towards 6-DoF Tracking and Shape Reconstruction in 3D Point Cloud Stream
    ⭐code

35.Scene Understanding(场景理解)

• Omni-Q: Omni-Directional Scene Understanding for Unsupervised Visual Grounding
• PanoContext-Former: Panoramic Total Scene Understanding with a Transformer
• DriveWorld: 4D Pre-trained Scene Understanding via World Models for Autonomous Driving
• OpenESS: Event-based Semantic Scene Understanding with Open Vocabularies
  ⭐code
• A Category Agnostic Model for Visual Rearrangment
  👍VILP
• 360+x: A Panoptic Multi-modal Scene Understanding Dataset
  ⭐code
• 开放词汇场景理解
  • Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding
• 3D场景理解
  • HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting
    🏠project
  • SurroundSDF: Implicit 3D Scene Understanding Based on Signed Distance Field
  • GSNeRF: Generalizable Semantic Neural Radiance Fields with Enhanced 3D Scene Understanding
  • GP-NeRF: Generalized Perception NeRF for Context-Aware 3D Scene Understanding
  • RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding
    🏠project
  • GroupContrast: Semantic-aware Self-supervised Representation Learning for 3D Understanding
    ⭐code
  • SceneFun3D: Fine-Grained Functionality and Affordance Understanding in 3D Scenes

34.Human–Computer Interaction(人机交互)

• Exploring Pose-Aware Human-Object Interaction via Hybrid Learning
• Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness
• Scaling Up Dynamic Human-Scene Interaction Modeling
  ⭐code
  🏠project
• ReGenNet: Towards Human Action-Reaction Synthesis
  ⭐code
• DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback
  ⭐code交互
• HOI-M^3: Capture Multiple Humans and Objects Interaction within Contextual Environment
• GenZI: Zero-Shot 3D Human-Scene Interaction Generation
• Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detection
• 人体运动跟踪
  • HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations
    ⭐code
    🏠project
• 新运动合成
  • PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
    ⭐code
    🏠project
• 手部交互
  • InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusion
    ⭐code
  • HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data
  • Physics-Aware Hand-Object Interaction Denoising
  • HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video
    ⭐code
    🏠project手物交互
  • GEARS: Local Geometry-aware Hand-object Interaction Synthesis
  • TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understanding
    🏠project
  • Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction
    ⭐code
  • G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis
    ⭐code
  • MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervision
  • HOIST-Former: Hand-held Objects Identification Segmentation and Tracking in the Wild
• 人物交互
  • Discovering Syntactic Interaction Clues for Human-Object Interaction Detection
  • Open-World Human-Object Interaction Detection via Multi-modal Prompts
  • LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
    ⭐code
    🏠project
  • Disentangled Pre-training for Human-Object Interaction Detection
    ⭐code
  • GenH2R: Learning Generalizable Human-to-Robot Handover via Scalable Simulation Demonstration and Imitation
    🏠project
  • Learning from Observer Gaze: Zero-Shot Attention Prediction Oriented by Human-Object Interaction Recognition
    🏠project
  • Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation
    🏠project
  • 3D 人物交互
    • I'M HOI: Inertia-aware Monocular Capture of 3D Human-Object Interactions
      🏠project
    • CG-HOI: Contact-Guided 3D Human-Object Interaction Generation
      🏠project
• 人-人交互
  • Inter-X: Towards Versatile Human-Human Interaction Analysis
    ⭐code
    🏠project
    👍三维数字人重建、编辑与驱动

33.NeRF

• GARField: Group Anything with Radiance Fields
• IReNe: Instant Recoloring of Neural Radiance Fields
• PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF
• LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes
• SIGNeRF: Scene Integrated Generation for Neural Radiance Fields
• NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation
• SpecNeRF: Gaussian Directional Encoding for Specular Reflections
• PaReNeRF: Toward Fast Large-scale Dynamic NeRF with Patch-based ReferenceNeRF
• Global and Hierarchical Geometry Consistency Priors for Few-shot NeRFs in Indoor Scenes
  👍摘要
• NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs
• Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modeling
  ⭐code
• Accelerating Neural Field Training via Soft Mining
• Gear-NeRF: Free-Viewpoint Rendering and Tracking with Motion-aware Spatio-Temporal Sampling
  🏠project
• How Far Can We Compress Instant-NGP-Based NeRF?
  ⭐code
  🏠project
• BANF: Band-Limited Neural Fields for Levels of Detail Reconstruction
  ⭐code
  🏠project
• Tactile-Augmented Radiance Fields
  ⭐code
  🏠project
• NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild
  🏠project
• L0-Sampler: An L0 Model Guided Volume Sampling for NeRF
  🏠projectNeRF
• HumanNeRF-SE: A Simple yet Effective Approach to Animate HumanNeRF with Diverse Poses
• Entangled View-Epipolar Information Aggregation for Generalizable Neural Radiance Fields
  ⭐code
• NeRFCodec: Neural Feature Compression Meets Neural Radiance Fields for Memory-Efficient Scene Representation
• MuRF: Multi-Baseline Radiance Fields
  🏠project
  🏠project
• InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fields
• NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors
  ⭐code
  🏠project
• Neural Fields as Distributions: Signal Processing Beyond Euclidean Space
  🏠project
• CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs
  ⭐code
• DaReNeRF: Direction-aware Representation for Dynamic Scenes
• Geometry Transfer for Stylizing Radiance Fields
  🏠project
• S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes
  ⭐code
• SpikeNeRF: Learning Neural Radiance Fields from Continuous Spike Stream
  ⭐code
• Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenes
  ⭐code
• Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates
  ⭐code
• LAENeRF: Local Appearance Editing for Neural Radiance Fields
  ⭐code
  🏠project
• Single View Refractive Index Tomography with Neural Fields
• ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models
• TeTriRF: Temporal Tri-Plane Radiance Fields for Efficient Free-Viewpoint Video
• NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided Segmentation
  ⭐code
• Learning with Unreliability: Fast Few-shot Voxel Radiance Fields with Relative Geometric Consistency
  ⭐code
• Grounding and Enhancing Grid-based Models for Neural Fields
  🏠project
• Mitigating Motion Blur in Neural Radiance Fields with Events and Frames
• OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos
• Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects
  ⭐code
• Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields
• Alpha Invariance: On Inverse Scaling Between Distance and Volume Density in Neural Radiance Fields
  🏠project
• Dynamic LiDAR Re-simulation using Compositional Neural Fields
  🏠project
• SOAC: Spatio-Temporal Overlap-Aware Multi-Sensor Calibration using Neural Radiance Fields
  🏠project
• ICON: Incremental CONfidence for Joint Pose and Radiance Field Optimization
• NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows
• 新视图合成
  • ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image
  • Unifying Correspondence Pose and NeRF for Generalized Pose-Free Novel View Synthesis
  • NeLF-Pro: Neural Light Field Probes for Multi-Scale Novel View Synthesis
  • 3D Geometry-Aware Deformable Gaussian Splatting for Dynamic View Synthesis
  • G-NeRF: Geometry-enhanced Novel View Synthesis from Single-View Images
  • MultiDiff: Consistent Novel View Synthesis from a Single Image
  • Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis
  • DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View Synthesis
  • 3D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesis
  • Generalizable Novel-View Synthesis using a Stereo Camera
    🏠project
  • DART: Implicit Doppler Tomography for Radar Novel View Synthesis
    🏠project
  • XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold
  • Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis
    ⭐code
    🏠project
  • NViST: In the Wild New View Synthesis from a Single Image with Transformers
    ⭐code
    🏠project
  • ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
    🏠project
  • SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes
    ⭐code
    🏠project
  • Neural Visibility Field for Uncertainty-Driven Active Mapping
    🏠project
  • EscherNet: A Generative Model for Scalable View Synthesis
    ⭐code
    🏠project
  • GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis
    ⭐code
    🏠project新视图
  • DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization
    ⭐code
    🏠project
  • LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesis
    ⭐code
    🏠project
  • Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?
  • Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models
    ⭐code
    🏠project
  • CoPoNeRF: Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs
    ⭐code
    🏠project
  • EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion
    ⭐code
    🏠project
  • Free3D: Consistent Novel View Synthesis without 3D Representation
    ⭐code
    🏠project
  • Novel View Synthesis with View-Dependent Effects from a Single Image
    🏠project
• 渲染
  • NeRF Director: Revisiting View Selection in Neural Volume Rendering
  • Multiplane Prior Guided Few-Shot Aerial Scene Rendering渲染
  • Differentiable Point-based Inverse Rendering逆渲染
  • Diffusion Reflectance Map: Single-Image Stochastic Inverse Rendering of Illumination and Reflectance渲染
  • Perceptual Assessment and Optimization of HDR Image Rendering
  • Global Latent Neural Rendering
  • Geometry-aware Reconstruction and Fusion-refined Rendering for Generalizable Neural Radiance Fields
    ⭐code
    🏠project
  • GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering
    🏠project
  • Real-time Acquisition and Reconstruction of Dynamic Volumes with Neural Structured Illumination
    🏠project
    📺video
    👍借助神经结构光，浙大实现动态三维现象的实时采集重建
  • Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields
    🏠project
  • Dr.Bokeh: DiffeRentiable Occlusion-aware Bokeh Rendering
    🏠project
  • HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting
    👍HiFi4G: 通过紧凑高斯进行高保真人体性能渲染
  • ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
    🏠project
  • SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wild
    🏠project神经渲染
  • LTM: Lightweight Textured Mesh Extraction and Refinement of Large Unbounded Scenes for Efficient Storage and Real-time Rendering
  • HashPoint: Accelerated Point Searching and Sampling for Neural Rendering
    🏠project
  • HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfaces
    🏠project
  • DUDF: Differentiable Unsigned Distance Fields with Hyperbolic Scaling
    ⭐code
    🏠project
  • Holoported Characters: Real-time Free-viewpoint Rendering of Humans from Sparse RGB Cameras
    🏠project
  • ConTex-Human: Free-View Rendering of Human from a Single Image with Texture-Consistent Synthesis
    🏠project
• 多视图逆渲染
  • VMINer: Versatile Multi-view Inverse Rendering with Near- and Far-field Light Sources
• 目标重建
  • Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstruction
    🏠project
  • SAOR: Single-View Articulated Object Reconstruction
    🏠project

32.NLP(自然语言处理)

• Describing Differences in Image Sets with Natural Language
• 实体识别
  • A Generative Approach for Wikipedia-Scale Visual Entity Recognition
• 提示学习
  • BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP
  • Active Prompt Learning in Vision Language Models
    ⭐code
  • Domain Prompt Learning with Quaternion Networks
  • On the Test-Time Zero-Shot Generalization of Vision-Language Models: Do We Really Need Prompt Learning?
  • ID-like Prompt Learning for Few-Shot Out-of-Distribution Detection
• 基础模型
  • Asymmetric Masked Distillation for Pre-Training Small Foundation Models
    ⭐code
  • Bootstrapping SparseFormers from Vision Foundation Models
    ⭐code

31.Edge Detection(边缘检测)

• MuGE: Multiple Granularity Edge Detection
• RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Losses
  ⭐code

30.Person Re-Identification(人员重识别)

• Fusing Personal and Environmental Cues for Identification and Segmentation of First-Person Camera Wearers in Third-Person Views
• Evidential Active Recognition: Intelligent and Prudent Open-World Embodied Perception
• 行人检测
  • DAP: A Dynamic Adversarial Patch for Evading Person Detectors
  • Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detection
    ⭐code
  • WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects Under Occlusion
  • 基于文本的行人检索
    • UFineBench: Towards Text-based Person Retrieval with Ultra-fine Granularity
      ⭐code
• 人群计数
  • Single Domain Generalization for Crowd Counting
    ⭐code
  • CrowdDiff: Multi-hypothesis Crowd Density Estimation using Diffusion Models
    🏠project
  • Regressor-Segmenter Mutual Prompt Learning for Crowd Counting
• 行人属性检测
  • Learning Group Activity Features Through Person Attribute Prediction
    ⭐code
    🏠project
• 重识别
  • SEAS: ShapE-Aligned Supervision for Person Re-Identification
  • Learning Continual Compatible Representation for Re-indexing Free Lifelong Person Re-identification
    ⭐code
  • View-decoupled Transformer for Person Re-identification under Aerial-ground Camera Network
    ⭐code
  • CA-Jaccard: Camera-aware Jaccard Distance for Person Re-identification
  • Attribute-Guided Pedestrian Retrieval: Bridging Person Re-ID with Internal Attribute Variability
  • All in One Framework for Multimodal Re-identification in the Wild
  • A Pedestrian is Worth One Prompt: Towards Language Guidance Person Re-Identification
  • Distribution-aware Knowledge Prototyping for Non-exemplar Lifelong Person Re-identification
  • Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructions
    ⭐code
  • 基于雷达的Re-Id
    • LiDAR-based Person Re-identification
  • 可见光-红外人员重识别
    • Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification
      ⭐code
    • Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-Identification
  • 文本-图像重识别
    • Harnessing the Power of MLLMs for Transferable Text-to-Image Person ReID
    • Noisy-Correspondence Learning for Text-to-Image Person Re-identification
      ⭐code
• 步态识别
  • Learning Visual Prompt for Gait Recognition
  • BigGait: Learning Gait Representation You Want by Large Vision Models
    ⭐code

29.Model Compression/Knowledge Distillation/Pruning(模型压缩/知识蒸馏/剪枝)

• MC
  • Dense Vision Transformer Compression with Few Samples
• KD
  • Small Scale Data-Free Knowledge Distillation
  • KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
  • Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation
  • Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
  • C2KD: Bridging the Modality Gap for Cross-Modal Knowledge Distillation
  • CrossKD: Cross-Head Knowledge Distillation for Object Detection
  • CLIP-KD: An Empirical Study of CLIP Model Distillation
    ⭐code
  • Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
  • FreeKD: Knowledge Distillation via Semantic Frequency Prompt
  • Logit Standardization in Knowledge Distillation
  • $V_kD:$ Improving Knowledge Distillation using Orthogonal Projections
    ⭐code
  • Scale Decoupled Distillation
    ⭐code
  • NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation
    ⭐code
  • De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts
  • PromptKD: Unsupervised Prompt Distillation for Vision-Language Models
    ⭐code
    🏠project
    👍中文解读
• 剪枝
  • Device-Wise Federated Network Pruning
  • FedMef: Towards Memory-efficient Federated Dynamic Pruning
  • OrthCaps: An Orthogonal CapsNet with Sparse Attention Routing and Pruning
  • BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks
  • Resource-Efficient Transformer Pruning for Finetuning of Large Models
  • Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
  • Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning
    🏠project
  • Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformers
  • MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric
  • Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
  • MULTIFLOW: Shifting Towards Task-Agnostic Vision-Language Pruning
    ⭐code
• 量化
  • PTQ4SAM: Post-Training Quantization for Segment Anything
  • Reg-PTQ: Regression-specialized Post-training Quantization for Fully Quantized Object Detector
  • Data-Free Quantization via Pseudo-label Filtering
  • JointSQ: Joint Sparsification-Quantization for Distributed Learning
  • Retraining-Free Model Quantization via One-Shot Weight-Coupling Learning
  • Epistemic Uncertainty Quantification For Pre-Trained Neural Networks
  • Enhancing Post-training Quantization Calibration through Contrastive Learning
  • Towards Accurate Post-training Quantization for Diffusion Models量化
  • Is Conventional SNN Really Efficient? A Perspective from Network Quantization
  • Are Conventional SNNs Really Efficient? A Perspective from Network Quantization

28.UAV/Remote Sensing/Satellite Image(无人机/遥感/卫星图像)

• Unleashing Unlabeled Data: A Paradigm for Cross-View Geo-Localization
  ⭐code
• Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagery
  ⭐code
• Aerial Lifting: Neural Urban Semantic and Building Instance Lifting from Aerial Imagery
  🏠project
• S2MAE: A Spatial-Spectral Pretraining Foundation Model for Spectral Remote Sensing Data
• Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scans
  🏠project
• WildlifeMapper: Aerial Image Analysis for Multi-Species Detection and Identification
  ⭐code
• Learning without Exact Guidance: Updating Large-scale High-resolution Land Cover Maps from Low-resolution Historical Labels
  ⭐code
• 遥感
  • GeoChat: Grounded Large Vision-Language Model for Remote Sensing
  • SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
  • 3D Building Reconstruction from Monocular Remote Sensing Images with Multi-level Supervisions
    ⭐code
  • Poly Kernel Inception Network for Remote Sensing Detection
  • Content-Adaptive Non-Local Convolution for Remote Sensing Pansharpening
    ⭐code
• 航空图像分割
  • SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation
  • Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentation
    ⭐code
    👍摘要
• 基于参考图像的超分辨率
  • Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model
    ⭐code
• 基于UAV的目标检测
  • Weakly Misalignment-free Adaptive Feature Alignment for UAVs-based Multimodal Object Detection
• 交叉视角定位
  • View From Above: Orthogonal-View aware Cross-view Localization

27.Vision-Language(视觉语言)

• A Vision Check-up for Language Models
• The Neglected Tails in Vision-Language Models
• Beyond Average: Individualized Visual Scanpath Prediction
• ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models
• Language Models as Black-Box Optimizers for Vision-Language Models
• Distilling Vision-Language Models on Millions of Videos
• SonicVisionLM: Playing Sound with Vision Language Models
• Jack of All Tasks Master of Many: Designing General-Purpose Coarse-to-Fine Vision-Language Model
• Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models
• JoAPR: Cleaning the Lens of Prompt Learning for Vision-Language Models
• MMA: Multi-Modal Adapter for Vision-Language Models
• Linguistic-Aware Patch Slimming Framework for Fine-grained Cross-Modal Alignment
• Building Vision-Language Models on Solid Foundations with Masked Distillation
• TCP:Textual-based Class-aware Prompt tuning for Visual-Language Model
  ⭐code
• On Scaling Up a Multilingual Vision and Language Model
• CogAgent: A Visual Language Model for GUI Agents
  ⭐code
• Towards Better Vision-Inspired Vision-Language Models
• SaCo Loss: Sample-wise Affinity Consistency for Vision-Language Pre-training
• MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer
• Sequential Modeling Enables Scalable Learning for Large Vision Models
  🏠project大型视觉模型
• Seeing the Unseen: Visual Common Sense for Semantic Placement
• Efficient Vision-Language Pre-training by Cluster Masking
  ⭐code
  🏠project
• VILA: On Pre-training for Visual Language Models
• EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models
  ⭐code
  🏠project
• SPIN: Simultaneous Perception Interaction and Navigation
• MAFA: Managing False Negatives for Vision-Language Pre-training
• Visual In-Context Prompting
  ⭐code
• Semantics-aware Motion Retargeting with Vision-Language Models
• DePT: Decoupled Prompt Tuning
  ⭐code
• Osprey: Pixel Understanding with Visual Instruction Tuning
  ⭐code
• FairCLIP: Harnessing Fairness in Vision-Language Learning
  🏠project
• Efficient Test-Time Adaptation of Vision-Language Models
  ⭐code
• BioCLIP: A Vision Foundation Model for the Tree of Life
  ⭐code
• InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
  ⭐code
• Anchor-based Robust Finetuning of Vision-Language Models
• Multi-Modal Hallucination Control by Visual Information Grounding
• Do Vision and Language Encoders Represent the World Similarly?
• Dual-View Visual Contextualization for Web Navigation
• Any-Shift Prompting for Generalization over Distributions
• Non-autoregressive Sequence-to-Sequence Vision-Language Models
• One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models
  ⭐code
• SC-Tune: Unleashing Self-Consistent Referential Comprehension in Large Vision Language Models
  ⭐code
• RegionGPT: Towards Region Understanding Vision Language Model
• Enhancing Vision-Language Pre-training with Rich Supervisions
• Grounding Everything: Emerging Localization Properties in Vision-Language Transformers
  ⭐code
• Probing and Mitigating Intersectional Social Biases in Vision-Language Models with Counterfactual Examples
• Beyond Text: Frozen Large Language Models in Visual Signal Comprehension
  ⭐code
• Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understanding
  ⭐code视觉语言构图理解
• FFF: Fixing Flawed Foundations in Contrastive Pre-Training Results in Very Strong Vision-Language Models
• [Enhancing Vision-Language Pretraining with Rich Supervisions]
• Improved Baselines with Visual Instruction Tuning
  🏠project
• Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignment
• Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models
  ⭐code
• A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models
  ⭐code
• Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding
  ⭐code
• SyncMask: Synchronized Attentional Masking for Fashion-centric Vision-Language Pretraining视觉-语言
• Learning by Correction: Efficient Tuning Task for Zero-Shot Generative Vision-Language Reasoning
• Improving Visual Recognition with Hyperbolical Visual Hierarchy Mapping
  ⭐code
• Iterated Learning Improves Compositionality in Large Vision-Language Models
• ViTamin: Designing Scalable Vision Models in the Vision-Language Era
  ⭐code
• Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners
  ⭐code
• Visual Concept Connectome (VCC): Open World Concept Discovery and their Interlayer Connections in Deep Models
  🏠project
• Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning
  🏠project
• HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models
  ⭐code
• Enhancing Visual Document Understanding with Contrastive Learning in Large Visual-Language Models
• Learning Vision from Models Rivals Learning Vision from Data
  ⭐code
• Probing the 3D Awareness of Visual Foundation Models
  ⭐code
• LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning
  🏠project
• 视觉理解
  • Towards More Unified In-context Visual Understanding
• LLM
  • PixelLM: Pixel Reasoning with Large Multimodal Model
    🏠project
  • OneLLM: One Framework to Align All Modalities with Language
  • Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld
  • Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation
  • Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMs
  • Hallucination Augmented Contrastive Learning for Multimodal Large Language Model
  • See Say and Segment: Teaching LMMs to Overcome False Premises
  • ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  • Driving Everywhere with Large Language Model Policy Adaptation
    🏠project
  • Exploring the Transferability of Visual Prompting for Multimodal Large Language Models
  • GROUNDHOG: Grounding Large Language Models to Holistic Segmentation
    🏠project
  • Self-Training Large Language Models for Improved Visual Program Synthesis With Visual Reinforcement
    🏠project
  • V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs
    ⭐code
  • Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
  • Pixel Aligned Language Models
    🏠project
  • SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection
  • OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation
    ⭐code多模态大语言模型
  • Low-Rank Approximation for Sparse Attention in Multi-Modal LLMsLLMs
  • LISA: Reasoning Segmentation via Large Language Model
    ⭐code
  • Querying as Prompt: Parameter-Efficient Learning for Multimodal Language Model
  • Compositional Chain-of-Thought Prompting for Large Multimodal Models
    ⭐code
  • Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs
    🏠project
  • Honeybee: Locality-enhanced Projector for Multimodal LLM
    ⭐codeLLM
  • HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data
    ⭐code
  • SEED-Bench: Benchmarking Multimodal Large Language Models
    ⭐code
  • PerceptionGPT: Effectively Fusing Visual Perception into LLM
  • UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them All
  • ModaVerse: Efficiently Transforming Modalities with LLMs
  • VCoder: Versatile Vision Encoders for Multimodal Large Language Models
    ⭐code
    🏠project
  • mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration
  • MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World
    🏠project大语言模型
  • RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
    ⭐code
  • DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Model
    ⭐code
    👍摘要
  • Prompt Highlighter: Interactive Control for Multi-Modal LLMs
    ⭐code
    🏠project
  • Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
    🏠project
  • General Object Foundation Model for Images and Videos at Scale
    ⭐code
    🏠project
    👍GLEE 华科与字节跳动联手打造全能目标感知基础模型
  • Link-Context Learning for Multimodal LLMs
    ⭐codeLLMs
  • Cloud-Device Collaborative Learning for Multimodal Large Language Models
  • LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Model
    ⭐code
    👍成果速览 | CVPR2024细粒度视觉感知多模态大模型Pink、LocLLM
  • Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
    ⭐code
    👍成果速览 | CVPR2024细粒度视觉感知多模态大模型Pink、LocLLM
  • LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
    ⭐code
    🏠projectMLLMs
  • GSVA: Generalized Segmentation via Multimodal Large Language Models
• VLN
  • Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigation
    ⭐code
    👍VILP
  • Volumetric Environment Representation for Vision-Language Navigation
  • OVER-NAV: Elevating Iterative Vision-and-Language Navigation with Open-Vocabulary Detection and StructurEd Representation
  • Vision-and-Language Navigation via Causal Learning
    ⭐code视觉和语言导航
• 视频语言
  • VidLA: Video-Language Alignment at Scale
  • SRTube: Video-Language Pre-Training with Action-Centric Video Tube Features and Semantic Role Labeling
  • VISTA-LLAMA: Reducing Hallucination in Video Language Models via Equal Distance to Visual Tokens
  • VideoLLM-online: Online Video Large Language Model for Streaming Video
    🏠project
• Visual Grounding
  • Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners
  • MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Grounding
  • Viewpoint-Aware Visual Grounding in 3D Scenes
  • Improved Visual Grounding through Self-Consistent Explanations
  • Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding
    🏠project
  • Towards CLIP-driven Language-free 3D Visual Grounding via 2D-3D Relational Enhancement and ConsistencyVisual Grounding
  • Marrying Hyperbolic Alignment with Explicit Semantic-Geometric Modeling for 3D Visual Grounding
  • Multi-Attribute Interactions Matter for 3D Visual Grounding
  • Investigating Compositional Challenges in Vision-Language Models for Visual Grounding
  • Separating the "Chirp" from the "Chat": Self-supervised Visual Grounding of Sound and Language
• 多模态模型
  • GLaMM: Pixel Grounding Large Multimodal Model
  • Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Models
    ⭐code
  • What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models
    🏠project
  • Multi-modal Learning for Geospatial Vegetation Forecasting
  • Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception
  • MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception
  • TRINS: Towards Multimodal Language Models that Can Read
  • Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotations
• 视觉基础模型
  • Three Pillars improving Vision Foundation Model Distillation for Lidar
    ⭐code
  • Bridging Remote Sensors with Multisensor Geospatial Foundation Models
  • Low-Resource Vision Challenges for Foundation Models
• 多视图理解
  • Learning to Select Views for Efficient Multi-View Understanding
    ⭐code
• 视觉定位
  • Learning to Produce Semi-dense Correspondences for Visual Localization
    ⭐code
  • PIN: Positional Insert Unlocks Object Localisation Abilities in VLMs定位
  • Efficient Privacy-Preserving Visual Localization Using 3D Ray Clouds

26.Information Security(信息安全)

• CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion
  ⭐code
• WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights
• 图像隐写术
  • Purified and Unified Steganographic Network
    ⭐code
• 知识产权保护
  • Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Models
  • MAP: MAsk-Pruning for Source-Free Model Intellectual Property Protection
    ⭐code
  • CPR: Retrieval Augmented Generation for Copyright Protection
  • VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Models
    ⭐code
  • Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models
• IP 保护
  • Steganographic Passport: An Owner and User Verifiable Credential for Deep Model IP Protection Without Retraining

25.Object Tracking(目标跟踪)

• 3D Feature Tracking via Event Camera
• Projecting Trackable Thermal Patterns for Dynamic Computer Vision
• ARTrackV2: Prompting Autoregressive Tracker Where to Look and How to Describe
• DPHMs: Diffusion Parametric Head Models for Depth-based Tracking
  🏠project
• NetTrack: Tracking Highly Dynamic Objects with a Net
  ⭐code
• RTracker: Recoverable Tracking via PN Tree Structured Memory
• Context-Aware Integration of Language and Visual References for Natural Language Tracking
• CodedEvents: Optimal Point-Spread-Function Engineering for 3D-Tracking with Event Cameras
• SpatialTracker: Tracking Any 2D Pixels in 3D Space
  ⭐code
• Learning Tracking Representations from Single Point Annotations
• 视觉目标跟踪
  • DiffusionTrack: Point Set Diffusion Model for Visual Object Tracking
  • OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning
  • HIPTrack: Visual Tracking with Historical Prompts
    ⭐code
  • Single-Model and Any-Modality for Video Object Tracking
    ⭐code
  • SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking
    ⭐code
• 多目标跟踪
  • Multi-Object Tracking in the Dark
  • Towards Generalizable Multi-Object Tracking
  • ADA-Track: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association
  • DeconfuseTrack:Dealing with Confusion for Multi-Object Tracking
  • Delving into the Trajectory Long-tail Distribution for Muti-object Tracking
    ⭐code
  • Self-Supervised Multi-Object Tracking with Path Consistency
  • DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction
    ⭐code
    🏠project
  • iKUN: Speak to Trackers without Retraining
    ⭐code
• 点跟踪
  • LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometry

24.Machine Learning(机器学习)

• Molecular Data Programming: Towards Molecule Pseudo-labeling with Systematic Weak Supervision
  👍摘要
• Improving Physics-Augmented Continuum Neural Radiance Field-Based Geometry-Agnostic System Identification with Lagrangian Particle Optimization
  🏠project
• Circuit Design and Efficient Simulation of Quantum Inner Product and Empirical Studies of Its Effect on Near-Term Hybrid Quantum-Classic Machine Learning
• 对抗
  • Infrared Adversarial Car Stickers
  • Robust Distillation via Untargeted and Targeted Intermediate Adversarial Samples
  • Revisiting Adversarial Training Under Long-Tailed Distributions
  • PAD: Patch-Agnostic Defense against Adversarial Patch Attacks
    ⭐code
  • Structured Gradient-based Interpretations via Norm-Regularized Adversarial Training
  • MimicDiffusion: Purifying Adversarial Perturbation via Mimicking Clean Diffusion Model对抗性扰动
  • Towards Transferable Targeted 3D Adversarial Attack in the Physical World
  • Deep-TROJ: An Inference Stage Trojan Insertion Algorithm through Efficient Weight Replacement Attack攻击
  • Attack To Defend: Exploiting Adversarial Attacks for Detecting Poisoned Models
  • Re-thinking Data Availability Attacks Against Deep Neural Networks
  • SlowFormer: Adversarial Attack on Compute and Energy Consumption of Efficient Vision Transformers
  • Re-thinking Data Availablity Attacks Against Deep Neural Networks攻击
  • NAPGuard: Towards Detecting Naturalistic Adversarial Patches
  • Focus on Hiders: Exploring Hidden Threats for Enhancing Adversarial Training
  • Not All Prompts Are Secure: A Switchable Backdoor Attack Against Pre-trained Vision Transfomers后门攻击
  • Physical Backdoor: Towards Temperature-based Backdoor Attacks in the Physical World
  • Backdoor Defense via Test-Time Detecting and Repairing
  • Nearest Is Not Dearest: Towards Practical Defense against Quantization-conditioned Backdoor Attacks
  • Semantic-Aware Multi-Label Adversarial Attacks对抗攻击
  • Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learning
  • Improving Transferable Targeted Adversarial Attacks with Model Self-Enhancement对抗攻击
  • On the Robustness of Large Multimodal Models Against Image Adversarial Attacks
  • Incremental Residual Concept Bottleneck Models
  • Revisiting Adversarial Training at Scale
    ⭐code
  • Language-Driven Anchors for Zero-Shot Adversarial Robustness零样本对抗
  • Transferable Structural Sparse Adversarial Attack Via Exact Group Sparsity Training
  • Learning to Transform Dynamically for Better Adversarial Transferability
  • Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
  • Boosting Adversarial Transferability by Block Shuffle and Rotation
    ⭐code对抗性可转移性
  • MMCert: Provable Defense against Adversarial Attacks to Multi-modal Models
  • Pre-trained Model Guided Fine-Tuning for Zero-Shot Adversarial Robustness
    👍VILP
  • Adversaral Doodles: Interpretable and Human-drawable Attacks Provide Describable Insights
  • PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor
  • Revisiting Adversarial Training under Long-Tailed Distributions
    ⭐code
  • Towards Fairness-Aware Adversarial Learning
  • Dispel Darkness for Better Fusion: A Controllable Visual Enhancer based on Cross-modal Conditional Adversarial Learning
  • Soften to Defend: Towards Adversarial Robustness via Self-Guided Label Refinement
  • Robust Overfitting Does Matter: Test-Time Adversarial Purification With FGSM
  • Boosting Adversarial Training via Fisher-Rao Norm-based Regularization
    ⭐code
  • A Stealthy Wrongdoer: Feature-Oriented Reconstruction Attack against Split Learning攻击
  • 后门攻击
    • LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioning
      ⭐code
    • Test-Time Backdoor Defense via Detecting and Repairing
    • Data Poisoning based Backdoor Attacks to Contrastive Learning
      ⭐code
• 持续学习
  • RCL: Reliable Continual Learning for Unified Failure Detection
  • Consistent Prompting for Rehearsal-Free Continual Learning
  • Improving Plasticity in Online Continual Learning via Collaborative Learning
  • Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters
    ⭐code
  • Enhancing Visual Continual Learning with Language-Guided Supervision
  • Convolutional Prompting meets Language Models for Continual Learning
  • Resurrecting Old Classes with New Data for Exemplar-Free Continual Learning
  • Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation
  • InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
  • Learning Equi-angular Representations for Online Continual Learning
  • BrainWash: A Poisoning Attack to Forget in Continual Learning
  • Adaptive VIO: Deep Visual-Inertial Odometry with Online Continual Learning持续学习
  • Traceable Federated Continual Learning
  • Interactive Continual Learning: Fast and Slow Thinking
• 增量学习
  • Towards Efficient Replay in Federated Incremental Learning
• 类增量学习
  • Dual-Consistency Model Inversion for Non-Exemplar Class Incremental Learning
  • Class Incremental Learning with Multi-Teacher Distillation
  • Dual-Enhanced Coreset Selection with Class-wise Collaboration for Online Blurry Class Incremental Learning
  • Generative Multi-modal Models are Good Class Incremental Learners
  • FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning
  • OrCo: Towards Better Generalization via Orthogonality and Contrast for Few-Shot Class-Incremental Learning
  • Long-Tail Class Incremental Learning via Independent Sub-prototype Construction
  • Gradient Reweighting: Towards Imbalanced Class-Incremental Learning
  • DYSON: Dynamic Feature Space Self-Organization for Online Task-Free Class Incremental Learning
  • NICE: Neurogenesis Inspired Contextual Encoding for Replay-free Class Incremental Learning
    ⭐code
  • Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning
    ⭐code
  • Text-Enhanced Data-free Approach for Federated Class-Incremental Learning
    ⭐code
  • Generative Multi-modal Models are Good Class-Incremental Learners
    ⭐code
  • Task-Adaptive Saliency Guidance for Exemplar-free Class Incremental Learning
    ⭐code
• 多任务
  • Masked AutoDecoder is Effective Multi-Task Vision Generalist
  • OmniVec2 - A Novel Transformer based Network for Large Scale Multimodal and Multitask Learning
  • Task-conditioned adaptation of visual features in multi-task policy learning
  • DiffusionMTL: Learning Multi-Task Denoising Diffusion Model from Partially Annotated Data
    ⭐code
  • FedHCA2: Towards Hetero-Client Federated Multi-Task Learning
    ⭐code
  • MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning
  • Joint-Task Regularization for Partially Labeled Multi-Task Learning
  • Task-Conditioned Adaptation of Visual Features in Multi-Task Policy Learning
  • 多标签学习
    • View-Category Interactive Sharing Transformer for Incomplete Multi-View Multi-Label Learning
• 多视角学习
  • Rethinking Multi-view Representation Learning via Distilled Disentangling
    ⭐code
• 元学习
  • FREE: Faster and Better Data-Free Meta-Learning
  • Improving Generalization via Meta-Learning on Hard Samples
• 联邦学习
  • An Aggregation-Free Federated Learning for Tackling Data Heterogeneity
  • Decentralized Directed Collaboration for Personalized Federated Learning
  • Rethinking the Representation in Federated Unsupervised Learning with Non-IID Data
  • Byzantine-robust Decentralized Federated Learning via Dual-domain Clustering and Trust Bootstrapping
  • FLHetBench: Benchmarking Device and State Heterogeneity in Federated Learning
  • Revamping Federated Learning Security from a Defender's Perspective: A Unified Defense with Homomorphic Encrypted Data Space
  • Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning
  • Mixed-Precision Quantization for Federated Learning on Resource-Constrained Heterogeneous Devices
  • FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning
  • Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity
    ⭐code
  • Global and Local Prompts Cooperation via Optimal Transport for Federated Learning
  • PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees
    ⭐code
  • Relaxed Contrastive Learning for Federated Learning
  • DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning
  • FedAS: Bridging Inconsistency in Personalized Federated Learning
    ⭐code
  • Leak and Learn: An Attacker's Cookbook to Train Using Leaked Data from Federated Learning
  • Data Valuation and Detections in Federated Learning
    ⭐code
  • An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learning
    ⭐code
  • Adaptive Hyper-graph Aggregation for Modality-Agnostic Federated Learning
  • FedUV: Uniformity and Variance for Heterogeneous Federated Learning
  • FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning
  • Communication-Efficient Federated Learning with Accelerated Client Gradient
• 强化学习
  • Improving Unsupervised Hierarchical Representation with Reinforcement Learning
  • AlignSAM: Aligning Segment Anything Model to Open Context via Reinforcement Learning强化学习
  • Training Diffusion Models Towards Diverse Image Generation with Reinforcement Learning
  • POCE: Primal Policy Optimization with Conservative Estimation for Multi-constraint Offline Reinforcement Learning
  • DMR: Decomposed Multi-Modality Representations for Frames and Events Fusion in Visual Reinforcement Learning
  • Learning to Control Camera Exposure via Reinforcement Learning
    🏠project
  • Regularized Parameter Uncertainty for Improving Generalization in Reinforcement Learning
  • Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World
    🏠project
• 多模态机器学习
  • DIEM: Decomposition-Integration Enhancing Multimodal Insights
• 迁移学习
  • Model Inversion Robustness: Can Transfer Learning Help?
  • Enhanced Motion-Text Alignment for Image-to-Video Transfer Learning
  • Structured Model Probing: Empowering Efficient Transfer Learning by Structured Regularization
  • UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory
    ⭐code
  • Initialization Matters for Adversarial Transfer Learning
• 对比学习
  • Improving Graph Contrastive Learning via Adaptive Positive Sampling
  • MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning
  • BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learning
  • Universal Novelty Detection Through Adaptive Contrastive Learning
  • NoiseCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions in Diffusion Models
    🏠project
• 模仿学习
  • LASIL: Learner-Aware Supervised Imitation Learning For Long-term Microscopic Traffic Simulation
• 上下文学习
  • Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learning
    ⭐code
• 弱监督学习
  • Virtual Immunohistochemistry Staining for Histological Images Assisted by Weakly-supervised Learning
• 启示学习
  • One-Shot Open Affordance Learning with Foundation Models

23.Sound

• Hearing Anything Anywhere
  🏠project
• Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling
• AV-RIR: Audio-Visual Room Impulse Response Estimation
  📺video
• DiffSal: Joint Audio and Video Learning for Diffusion Saliency Prediction
• Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ⭐code
• Weakly-Supervised Audio-Visual Video Parsing with Prototype-based Pseudo-Labeling
• 视听对话
  • The Audio-Visual Conversational Graph: From an Egocentric-Exocentric Perspective
    🏠project
• 视听导航
  • RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation
• 视听分割
  • Audio-Visual Segmentation via Unlabeled Frame Exploitation
  • Benchmarking Audio Visual Segmentation for Long-Untrimmed Videos
  • Cooperation Does Matter: Exploring Multi-Order Bilateral Relations for Audio-Visual Segmentation
  • Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition
    ⭐code
  • Unraveling Instance Associations: A Closer Look for Audio-Visual Segmentation
    ⭐code
• 语音识别
  • A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition
    ⭐code
• 语音定位
  • Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge
    ⭐code
• 音-视语音表示学习
  • ES³: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
    🏠project
    👍VILP
• 文本驱动的语音定位
  • T-VSL: Text-Guided Visual Sound Source Localization in Mixtures
• 从图像和语言提示合成音乐
  • MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models
• 耳音频生成和定位
  • Cyclic Learning for Binaural Audio Generation and Localization
• 视频和音频同步
  • DiVAS: Video and Audio Synchronization with Dynamic Frame Rates
• 视听表征学习
  • Looking Similar Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning
• 说话人检测
  • LoCoNet: Long-Short Context Network for Active Speaker Detection
    ⭐code
• 音频描述
  • MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning
    🏠project
• 视听语音翻译
  • AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
    🏠project视听语音到视听语音翻译

22.Deepfake Detection

• AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection
• Preserving Fairness Generalization in Deepfake Detection
  ⭐code
• Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection
  ⭐code
• Exploiting Style Latent Flows for Generalizing Deepfake Video Detection
• LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detection
• LAA-Net: Localized Artifact Attention Network for High-Quality Deepfakes Detection
• Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detection
• Contrastive Learning for DeepFake Classification and Localization via Multi-Label Ranking
• 图像篡改检测
  • DiffForensics: Leveraging Diffusion Prior to Image Forgery Detection and Localization伪造图像检测
  • EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection
    ⭐code用于篡改定位和版权保护的多功能图像水印
  • UnionFormer: Unified-Learning Transformer with Multi-View Representation for Image Manipulation Detection and Localization图像操作检测和定位
  • CORE-MPI: Consistency Object Removal with Embedding MultiPlane Image
• 合成图像检测
  • WinSyn: : A High Resolution Testbed for Synthetic Data
  • Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection

21.Few/Zero-Shot Learning/DG/A(小/零样本/域泛化/域适应)

• Transductive Zero-Shot and Few-Shot CLIP
  ⭐code
• DG
  • Disentangled Prompt Representation for Domain Generalization
  • A2XP: Towards Private Domain Generalization
    ⭐code
    🏠project
  • PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization
  • Towards Generalizing to Unseen Domains with Few Labels
  • Rethinking the Evaluation Protocol of Domain Generalization
  • Rethinking Multi-domain Generalization with A General Learning Objective
  • Unknown Prompt, the only Lacuna: Unveiling CLIP's Potential for Open Domain Generalization
    ⭐code
  • Prompt-Driven Dynamic Object-Centric Learning for Single Domain Generalization
  • Efficiently Assemble Normalization Layers and Regularization for Federated Domain Generalization
• DA
  • Parameter Efficient Self-Supervised Geospatial Domain Adaptation
  • Learning CNN on ViT: A Hybrid Model to Explicitly Class-specific Boundaries for Domain Adaptation
  • Discriminative Pattern Calibration Mechanism for Source-Free Domain Adaptation
  • Understanding and Improving Source-free Domain Adaptation from a Theoretical Perspective
  • A Versatile Framework for Continual Test-Time Domain Adaptation: Balancing Discriminability and Generalizability
  • Domain-Agnostic Mutual Prompting for Unsupervised Domain Adaptation
  • Unveiling the Unknown: Unleashing the Power of Unknown to Known in Open-Set Source-Free Domain Adaptation
  • Unsupervised Video Domain Adaptation with Masked Pre-Training and Collaborative Self-Training
  • Revisiting the Domain Shift and Sample Uncertainty in Multi-source Active Domain Transfer
  • LEAD: Learning Decomposition for Source-free Universal Domain Adaptation
    ⭐code
  • Split to Merge: Unifying Separated Modalities for Unsupervised Domain Adaptation
    ⭐code
  • Source-Free Domain Adaptation with Frozen Multimodal Foundation Model
    ⭐code
  • Universal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias
  • Unified Language-driven Zero-shot Domain Adaptation
    🏠project
• FSL
  • Adversarially Robust Few-shot Learning via Parameter Co-distillation of Similarity and Class Concept Learners
  • Descriptor and Word Soups: Overcoming the Parameter Efficiency Accuracy Tradeoff for Out-of-Distribution Few-shot Learning
  • Simple Semantic-Aided Few-Shot Learning
    ⭐code
  • DeIL: Direct-and-Inverse CLIP for Open-World Few-Shot Learning
  • AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learning
    👍摘要
  • Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning
    ⭐code
  • Flatten Long-Range Loss Landscapes for Cross-Domain Few-Shot Learning
  • Few-shot Learner Parameterization by Diffusion Time-steps
    ⭐code
• ZSL
  • Progressive Semantic-Guided Vision Transformer for Zero-Shot Learning
  • Visual-Augmented Dynamic Semantic Prototype for Generative Zero-Shot Learning
    👍提升生成式零样本学习能力，视觉增强动态语义原型方法
  • Context-based and Diversity-driven Specificity in Compositional Zero-Shot Learning
  • Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning
    ⭐code
  • Improving Generalized Zero-Shot Learning by Exploring the Diverse Semantics from External Class Names

20.Optical Flow Estimation(光流估计)

• Efficient Meshflow and Optical Flow Estimation from Event Cameras
• UnSAMFlow: Unsupervised Optical Flow Guided by Segment Anything Model
  ⭐code
• FlowTrack: Revisiting Optical Flow for Long-Range Dense Tracking
• FlowDiffuser: Advancing Optical Flow Estimation with Diffusion Models
• ADFactory: An Effective Framework for Generalizing Optical Flow with NeRF
• Dense Optical Tracking: Connecting the Dots
  ⭐code
  🏠project光流
• MemFlow: Optical Flow Estimation and Prediction with Memory
  ⭐code
• OCAI: Improving Optical Flow Estimation by Occlusion and Consistency Aware Interpolation
• 场景流
  • Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flow
  • ICP-Flow: LiDAR Scene Flow Estimation with ICP
• 3D 场景流估计
  • 3DSFLabelling: Boosting 3D Scene Flow Estimation by Pseudo Auto-labelling
  • DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Iterative Diffusion-Based Refinement

19.Object Pose Estimation(物体姿态估计)

• 3D-LFM: Lifting Foundation Model
  🏠project
• Efficient Solution of Point-Line Absolute Pose
  ⭐code
• Dual Pose-invariant Embeddings: Learning Category and Object-specific Discriminative Representations for Recognition and Retrieval
• DVMNet: Computing Relative Pose for Unseen Objects Beyond Hypotheses
  ⭐code
• Dynamic Support Information Mining for Category-Agnostic Pose Estimation
• From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation
• 物体姿态估计
  • Object Pose Estimation via the Aggregation of Diffusion Features
    ⭐code
  • NOPE: Novel Object Pose Estimation from a Single Image
    ⭐code
  • GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence
    ⭐code
• 6DoF
  • HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation
  • Towards Co-Evaluation of Cameras HDR and Algorithms for Industrial-Grade 6DoF Pose Estimation
  • Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)
  • SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation
    ⭐code
  • FAR: Flexible Accurate and Robust 6DoF Relative Camera Pose Estimation
    ⭐code
    🏠project
  • 6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation
  • MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images
  • Open-Vocabulary Object 6D Pose Estimation
  • FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
    🏠project
  • GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects
  • Open-vocabulary object 6D pose estimation
    🏠project
  • SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation
    ⭐code
  • A Simple and Effective Point-based Network for Event Camera 6-DOFs Pose Relocalization
  • Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation
  • MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation
  • Generalizing 6-DoF Grasp Detection via Domain Prior Knowledge
• 重识别
  • Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identification
    ⭐code
• 计数
  • Referring Expression Counting
  • Learning to Count without Annotations
  • Point, Segment and Count: A Generalized Framework for Object Counting
    ⭐code
  • DAVE - A Detect-and-Verify Paradigm for Low-Shot Counting
    ⭐code
  • Weakly Supervised Video Individual Counting

18.SLAM/AR/VR/Robotics(增强/虚拟现实/机器人)(机器人)

• Instance Tracking in 3D Scenes from Egocentric Videos
• VPR
  • TransLoc4D: Transformer-based 4D Radar Place Recognition
  • CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognition
    ⭐code
  • On the Estimation of Image-matching Uncertainty in Visual Place Recognition
  • Optimal Transport Aggregation for Visual Place Recognition
    ⭐code
• 导航
  • Imagine Before Go: Self-Supervised Generative Map for Object Goal Navigation
    👍VILP
  • Detours for Navigating Instructional Videos旅游视频导航
  • MemoNav: Working Memory Model for Visual Navigation
  • DiaLoc: An Iterative Approach to Embodied Dialog Localization
  • F$^3$Loc: Fusion and Filtering for Floorplan Localization
  • An Interactive Navigation Method with Effect-oriented Affordance交互式导航
• SLAM
  • SchurVINS: Schur Complement-Based Lightweight Visual Inertial Navigation System
    ⭐code
  • SubT-MRS Dataset: Pushing SLAM Towards All-weather Environments
  • SNI-SLAM: Semantic Neural Implicit SLAM
  • Gaussian Splatting SLAM
    ⭐code
    🏠project
  • SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
    🏠project
  • NARUTO: Neural Active Reconstruction from Uncertain Target Observations
  • Benchmarking Implicit Neural Representation and Geometric Rendering in Real-Time RGB-D SLAM
  • Implicit Event-RGBD Neural SLAM
    ⭐code
    🏠project
  • Multi-Session SLAM with Differentiable Wide-Baseline Pose Optimization
  • IBD-SLAM: Learning Image-Based Depth Fusion for Generalizable SLAM
  • Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular Stereo and RGB-D Cameras
  • Loopy-SLAM: Dense Neural SLAM with Loop Closures
    🏠project
  • GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting
    🏠project
• 机器人
  • Retrieval-Augmented Embodied Agents
  • ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation
  • SUGAR: Pre-training 3D Visual Representations for Robotics
    🏠project
  • Learning to navigate efficiently and precisely in real environments
  • Language-driven Grasp Detection
  • CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation
    🏠project
  • Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation
    ⭐code
  • Diffusion-EDFs:Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulation
    ⭐code
    🏠project
  • Rapid Motor Adaptation for Robotic Manipulator Arms机器人机械臂
  • Generate Subgoal Images before Act: Unlocking the Chain-of-Thought Reasoning in Diffusion Model for Robot Manipulation with Multimodal Prompts
• Avatar(虚拟建模)
  • SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting
    ⭐code
    📺video
  • MonoNPHM: Dynamic Head Reconstruction from Monocular Videos
  • Relightable and Animatable Neural Avatar from Sparse-View Video
    🏠project
  • Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes
    ⭐code
  • Artist-Friendly Relightable and Animatable Neural Heads
  • GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image
    ⭐code
  • DiffusionAvatars: Deferred Diffusion for High-fidelity 3D Head Avatars
  • EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars
  • Stratified Avatar Generation from Sparse Observations(https://zerg-overmind.github.io/)
    📺video
  • Real-Time Simulated Avatar from Head-Mounted Sensors
    🏠project
  • Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling
    ⭐code
    🏠project
  • NECA: Neural Customizable Human Avatar
    ⭐code
  • Make-Your-Anchor: A Diffusion-based 2D Avatar Generation Framework
    ⭐code
  • GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians
    ⭐code
    🏠project
  • Gaussian Head Avatar:Ultra High-fidelity Head Avatar via Dynamic Gaussians
    ⭐code
    🏠project
  • GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
    🏠project
  • UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided Textures
    ⭐code
    🏠project
  • GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
    🏠project
  • 3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting
    🏠project3D动画
  • AttriHuman-3D: Editable 3D Human Avatar Generation with Attribute Decomposition and Indexing3D 人体头像生成
  • Human Gaussian Splatting: Real-time Rendering of Animatable Avatars
  • GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
    ⭐code
  • DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulation
    🏠project
  • PEGASUS: Personalized Generative 3D Avatars with Composable Attributes
    🏠project
  • FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding
    🏠project
  • MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
    🏠project人体图像动画
  • Relightable Gaussian Codec Avatars
    🏠project
  • IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing
    🏠project
• 头发建模
  • MonoHair: High-Fidelity Hair Modeling from a Monocular Video
    ⭐code
• 虚拟试穿
  • Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On
  • CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Model
  • M&M VTO: Multi-Garment Virtual Try-On and Editing
    🏠project
  • StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On
    ⭐code
  • PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsigns
    🏠project
• 抓取
  • MANUS: Markerless Grasp Capture using Articulated 3D Gaussians
• 卡通人物
  • Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Text
    🏠project

17.Automated Driving(自动驾驶)

• Bezier Everywhere All at Once: Learning Drivable Lanes as Bezier Graphs
  ⭐code
• SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Prediction
• 自动驾驶
  • Accurate Training Data for Occupancy Map Prediction in Automated Driving Using Evidence Theory
  • VLP: Vision Language Planning for Autonomous Driving
  • Collaborative Semantic Occupancy Prediction with Hybrid Feature Fusion in Connected Automated Vehicles
  • DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes
  • Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous and Instruction-guided Driving
  • DualAD: Disentangling the Dynamic and Static World for End-to-End Driving
    🏠project
  • UniPAD: A Universal Pre-training Paradigm for Autonomous Driving
    ⭐code
  • Generalized Predictive Model for Autonomous Driving
    ⭐code
  • Cam4DOcc: Benchmark for Camera-Only 4D Occupancy Forecasting in Autonomous Driving Applications
  • ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles
  • Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Models
  • LMDrive: Closed-Loop End-to-End Driving with Large Language Models
    ⭐code
    🏠project
  • Feedback-Guided Autonomous Driving
  • PARA-Drive: Parallelized Architecture for Real-time Autonomous Driving
  • Is Ego Status All You Need for Open-Loop End-to-End Autonomous Driving
    ⭐code
  • On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving
  • Visual Point Cloud Forecasting enables Scalable Autonomous Driving
    ⭐code
  • Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving
    ⭐code
  • CLIP-BEVFormer: Enhancing Multi-View Image-Based BEV Detector with Ground Truth Flow
  • Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving
  • AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving
  • NeuRAD: Neural Rendering for Autonomous Driving
    ⭐code
    🏠project
  • Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
    ⭐code
    🏠project
  • Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents
    ⭐code
    🏠project
  • 3D LiDAR Mapping in Dynamic Environments using a 4D Implicit Neural Representation
    ⭐code
  • PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios
    ⭐code
    📺video
  • Bootstrapping Autonomous Driving Radars with Self-Supervised Learning
    ⭐code
  • SynFog: A Photo-realistic Synthetic Fog Dataset based on End-to-end Imaging Simulation for Advancing Real-World Defogging in Autonomous Driving自动驾驶去雾
• 轨迹预测
  • Pose-Transformed Equivariant Network for 3D Point Trajectory Prediction
  • Adversarial Backdoor Attack by Naturalistic Data Poisoning on Trajectory Prediction in Autonomous Driving
  • CaDeT: a Causal Disentanglement Approach for Robust Trajectory Prediction in Autonomous Driving
  • Higher-order Relational Reasoning for Pedestrian Trajectory Prediction
  • Density-Adaptive Model Based on Motif Matrix for Multi-Agent Trajectory Prediction
  • GigaTraj: Predicting Long-term Trajectories of Hundreds of Pedestrians in Gigapixel Complex Scenes
  • ERMVP: Communication-Efficient and Collaboration-Robust Multi-Vehicle Perception in Challenging Environments
  • HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attention
    ⭐code
    👍VILP
  • Adapting to Length Shift: FlexiLength Network for Trajectory Prediction
  • OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising
    ⭐code
  • SocialCircle: Learning the Angle-based Social Interaction Representation for Pedestrian Trajectory Prediction行人轨迹预测
  • T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory
    ⭐code
  • Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations
  • SmartRefine: An Scenario-Adaptive Refinement Framework for Efficient Motion Prediction
    ⭐code
  • Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
  • SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model
    ⭐code
  • Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction
    ⭐code
  • Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixture
    ⭐code
• 车道线检测
  • LaneCPP: Continuous 3D Lane Detection using Physical Priors
  • Lane2Seq: Towards Unified Lane Detection via Sequence Generation
    🏠project
• 车载凝视估计
  • What Do You See in Vehicle? Comprehensive Vision Solution for In-Vehicle Gaze Estimation
    🏠project
• 3D Occupancy Prediction
  • COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Prediction
    ⭐code
  • SelfOcc: Self-Supervised Vision-Based 3D Occupancy Prediction
    ⭐code
  • StreamingFlow: Streaming Occupancy Forecasting with Asynchronous Multi-modal Data Streams via Neural Ordinary Differential Equation 车辆重识别
  • Day-Night Cross-domain Vehicle Re-identification

16.Point Cloud(点云)

• Single-View Scene Point Cloud Human Grasp Generation
• LTA-PCS: Learnable Task-Agnostic Point Cloud Sampling
• StraightPCF: Straight Point Cloud Filtering
• CurveCloudNet: Processing Point Clouds with 1D Structure
• Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange
• Learning SO(3)-Invariant Semantic Correspondence via Local Shape Transform
• Multiway Point Cloud Mosaicking with Diffusion and Global Optimization
  📺video
• Point Cloud Pre-training with Diffusion Models
• PBWR: Parametric-Building-Wireframe Reconstruction from Aerial LiDAR Point Clouds
• Unsupervised Occupancy Learning from Sparse Point Cloud
• TULIP: Transformer for Upsampling of LiDAR Point Clouds
• Draw Step by Step Like Human: Reconstructing CAD Construction Sequences from Point Clouds via Multimodal Diffusion点​​云重建 CAD
• Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis
  ⭐code
• Local-consistent Transformation Learning for Rotation-invariant Point Cloud Analysis
  ⭐code
• Unsupervised Template-assisted Point Cloud Shape Correspondence Network
• GeoAuxNet: Towards Universal 3D Representation Learning for Multi-sensor Point Clouds
• Object Dynamics Modeling with Hierarchical Point Cloud-based Representations
• KPConvX: Modernizing Kernel Point Convolution with Kernel Attention
• 点云配准
  • Extend Your Own Correspondences: Unsupervised Distant Point Cloud Registration by Progressive Distance Extension
  • Inlier Confidence Calibration for Point Cloud Registration
  • ColorPCR: Color Point Cloud Registration with Multi-Stage Geometric-Color Fusion
  • Dynamic Cues-Assisted Transformer for Robust Point Cloud Registration
  • Learning Instance-Aware Correspondences for Robust Multi-Instance Point Cloud Registration in Cluttered Scenes
• 3D 点云
  • Hide in Thicket: Generating Imperceptible and Rational Adversarial Perturbations on 3D Point Clouds
    ⭐code
  • Density-guided Translator Boosts Synthetic-to-Real Unsupervised Domain Adaptive Segmentation of 3D Point Clouds
    ⭐code
    👍摘要
  • Point2CAD: Reverse Engineering CAD Models from 3D Point Clouds
  • Text2Loc: 3D Point Cloud Localization from Natural Language
    🏠project
  • 3DInAction: Understanding Human Actions in 3D Point Clouds
    ⭐code
  • Coupled Laplacian Eigenmaps for Locally-Aware 3D Rigid Point Cloud Matching
    ⭐code
• 点云识别
  • X-3D: Explicit 3D Structure Modeling for Point Cloud Recognition
• 点云上采样
  • RepKPU: Point Cloud Upsampling with Kernel Point Representation and Deformation
  • A Conditional Denoising Diffusion Probabilistic Model for Point Cloud Upsampling
  • [SPU-PMD: Self-Supervised Point Cloud Upsampling via Progressive Mesh Deformation](https://openaccess.thecvf.com/content/CVPR2024/papers/Liu_SPU-PMD_Self-Supervised_Point_Cloud_Upsampling_via