MarkMoHR/Awesome-Sketch-Based-Applications

:books: A collection of sketch based application papers.

716

337 commits

updated Aug 21, 2026

See the code

README

Awesome-Sketch-Based-Applications

A collection of sketch based applications.

Feel free to create a PR or an issue.

Outline


0. Survey & Toolkit

  • Survey
  • Toolkit
PaperSourceCode/Project Link
SketchKit2026[code]

1. Sketch Based Image Synthesis

1.1 Automatic Synthesis

  • Natural Image or Object
  • Human Face / Portrait / Body
  • 3D image
PaperSourceCode/Project Link
3D-aware Conditional Image SynthesisCVPR 2023[project] [code]

1.2 Style-conditioned

1.3 Text-conditioned

2. Sketch Based Image Editing

  • Arbitrary Image
  • Human Face / Portrait / Hair
  • Anime Editing
  • Video Editing

3. Sketch Based Image Retrieval (SBIR)

  • Object-level
PaperSourceCode/Project Link
Sketch Me That ShoeCVPR 2016[code-caffe] [code-tf] [project]
Deep Multi-task Attribute-driven Ranking for Fine-grained Sketch-based Image RetrievalBMVC 2016
Deep Sketch Hashing: Fast Free-hand Sketch-Based Image RetrievalCVPR 2017[code]
Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image RetrievalICCV 2017[project]
Zero-Shot Sketch-Image HashingCVPR 2018
SketchMate: Deep Hashing for Million-Scale Human Sketch RetrievalCVPR 2018
Generative Domain-Migration Hashing for Sketch-to-Image RetrievalECCV 2018[code]
A Zero-Shot Framework for Sketch Based Image RetrievalECCV 2018[code]
Generalising Fine-Grained Sketch-Based Image RetrievalCVPR 2019
Doodle to Search: Practical Zero-Shot Sketch-Based Image RetrievalCVPR 2019[project] [code]
LiveSketch: Query Perturbations for Guided Sketch-Based Visual SearchCVPR 2019
Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-Based Image RetrievalCVPR 2019[code]
Learning Structural Representations via Dynamic Object Landmarks Discovery for Sketch Recognition and RetrievalTIP 2019
Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image RetrievalICCV 2019
TC-Net for iSBIR: Triplet Classification Network for Instance-level Sketch Based Image RetrievalACM MM 2019
Sketch-Based Image Retrieval With Multi-Clustering Re-RankingTCSVT 2019
Semi-Heterogeneous Three-Way Joint Embedding Network for Sketch-Based Image RetrievalTCSVT 2019
Zero-Shot Sketch-Based Image Retrieval via Graph Convolution NetworkAAAI 2020
Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image RetrievalCVPR 2020[code]
Solving Mixed-modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image RetrievalCVPR 2020
Fine-Grained Instance-Level Sketch-Based Image RetrievalIJCV 2020
StyleMeUp: Towards Style-Agnostic Sketch-Based Image RetrievalCVPR 2021
More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch-Based Image RetrievalCVPR 2021[code]
DLA-Net for FG-SBIR: Dynamic Local Aligned Network for Fine-Grained Sketch-Based Image RetrievalACM MM 2021
Domain-Aware SE Network for Sketch-based Image Retrieval with Multiplicative Euclidean Margin SoftmaxACM MM 2021[code]
Relationship-Preserving Knowledge Distillation for Zero-Shot Sketch Based Image RetrievalACM MM 2021
Transferable Coupled Network for Zero-Shot Sketch-Based Image RetrievalTPAMI 2021[project]
TVT: Three-Way Vision Transformer through Multi-Modal Hypersphere Learning for Zero-Shot Sketch-Based Image RetrievalAAAI 2022
Sketching without Worrying: Noise-Tolerant Sketch-Based Image RetrievalCVPR 2022[code]
Sketch3T: Test-time Training for Zero-Shot SBIRCVPR 2022
Augmented Multi-Modality Fusion for Generalized Zero-Shot Sketch-based Visual RetrievalTIP 2022[code]
Adaptive Fine-Grained Sketch-Based Image RetrievalECCV 2022[code]
Conditional Stroke Recovery for Fine-Grained Sketch-Based Image RetrievalECCV 2022[code]
A Sketch Is Worth a Thousand Words: Image Retrieval with Text and SketchECCV 2022[code] [project]
Multi-Level Region Matching for Fine-Grained Sketch-Based Image RetrievalACM MM 2022[code]
Prototype-based Selective Knowledge Distillation for Zero-Shot Sketch Based Image RetrievalACM MM 2022
DLI-Net: Dual Local Interaction Network for Fine-Grained Sketch-Based Image RetrievalTCSVT 2022[code]
Data-Free Sketch-Based Image RetrievalCVPR 2023[code]
Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable StyleCVPR 2023[code]
Exploiting Unlabelled Photos for Stronger Fine-Grained SBIRCVPR 2023[project]
CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or NotCVPR 2023[project]
Cross-Domain Alignment for Zero-Shot Sketch-Based Image RetrievalTCSVT 2023
Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image RetrievalAAAI 2023
Text-to-Image Diffusion Models are Great Sketch-Photo MatchmakersCVPR 2024[project]
You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image RetrievalCVPR 2024[project]
How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?CVPR 2024[project]
Asymmetric Mutual Alignment for Unsupervised Zero-Shot Sketch-Based Image RetrievalAAAI 2024
Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex InteractionsAAAI 2024[project]
Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image RetrievalECCV 2024
Elevating All Zero-Shot Sketch-Based Image Retrieval Through Multimodal Prompt LearningECCV 2024[code]
Zero-Shot Sketch Based Image Retrieval via Modality Capacity GuidanceIJCAI-24[code]
Sketch Down the FLOPs: Towards Efficient Networks for Human SketchCVPR 2025[webpage]
Unified Category and Style Generalization for Instance-Level Sketch RetrievalSIGIR 2025[code]
  • Scene-level
  • Video Retrieval

4. Sketch Based 3D Shape Retrieval

5. Sketch Based 3D Shape Modeling

  • Survey
PaperSourceCode/Project Link
Deep Sketch-Based 3D Modeling: A SurveyCGF 2026
  • Object/Shape Generation
PaperSourceCode/Project Link
3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks3DV 2017[code] [project]
Shape Synthesis from Sketches via Procedural Models and Convolutional NetworksTVCG 2017
BendSketch: Modeling Freeform Surfaces Through 2D SketchingSIGGRAPH 2017[project]
Robust Flow-Guided Neural Prediction for Sketch-Based Freeform Surface ModelingSIGGRAPH Asia 2018[code] [project]
Monster Mash: A Single-View Approach to Casual 3D Modeling and AnimationSIGGRAPH Asia 2020[project] [code] [demo]
Interactive Liquid Splash Modeling by User SketchesSIGGRAPH Asia 2020
Towards Practical Sketch-Based 3D Shape Generation: The Role of Professional SketchesTCSVT 2020
Sketch2Model: View-Aware 3D Modeling from Single Free-Hand SketchesCVPR 2021
Sketch2Mesh: Reconstructing and Editing 3D Shapes from SketchesICCV 2021
Real-time Skeletonization for Sketch-based ModelingSMI 2021[code]
Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single SketchTVCG 2022
SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth SamplingECCV 2022[code]
Deep Reconstruction of 3D Smoke Densities from Artist SketchesEG 2022[code]
A Diffusion-ReFinement Model for Sketch-to-Point ModelingACCV 2022[code]
RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent DatasetCVPR 2023[project]
Reality3DSketch: Rapid 3D Modeling of Objects from Single Freehand SketchesTMM 2023
GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit FunctionsPG 2023[code]
Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D ShapesCVPR 2024[project] [code]
SENS: Part-Aware Sketch-based Implicit Neural Shape ModelingEG 2024[code] [project]
3D Reconstruction from a Single Sketch via View-dependent Depth SamplingTPAMI 2024[code]
Sketch2Vox: Learning 3D Reconstruction from a Single Monocular SketchECCV 2024
MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and EditingICCV 2025[webpage]
PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned PriorICCV 2025[webpage] [code]
Variational Neural Surfacing of 3D SketchesSIGGRAPH Asia 2025
From Sketch to Reality: Enabling High-Quality, Cross-Category 3D Model Generation from Free-Hand Sketches with Minimal DataTVCG 2026
Part-level Semantic Fusion for Sketch-based 3D Voxel ReconstructionTCSVT 2026
Sketch and Vector-Guided 3D Shape Generation via Cross-Modal DiffusionICASSP 2026
NeuralSketch2Surf: Fast Neural Surfacing of Unoriented 3D SketchesSIGGRAPH 2026[code]
  • Face/Head/Hair Generation
  • Human Pose/Motion Generation
  • Scene Generation
  • NeRF & 3DGS
  • CAD sketch
PaperSourceCode/Project Link
Lifting Freehand Concept Sketches into 3DSIGGRAPH Asia 2020[project] [code]
Sketch2CAD: Sequential CAD Modeling by Sketching in ContextSIGGRAPH Asia 2020[project] [code]
Computer-Aided Design as LanguageNeurIPS 2021[code]
Free2CAD: Parsing Freehand Drawings into CAD CommandsSIGGRAPH 2022[project] [code]
Symmetry-driven 3D Reconstruction From Concept SketchesSIGGRAPH 2022[project]
Piecewise-smooth Surface Fitting Onto Unstructured 3D SketchesSIGGRAPH 2022[project]
Vitruvion: A Generative Model of Parametric CAD SketchesICLR 2022[project] [code]
Reconstruction of Machine-Made Shapes from Bitmap SketchesSIGGRAPH Asia 2023[project]
CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided AttentionCVPR 2024
SfmCAD: Unsupervised CAD Reconstruction by Learning Sketch-based Feature Modeling OperationsCVPR 2024[code]
DAVINCI: A Single-Stage Architecture for Constrained CAD Sketch InferenceBMVC 2024[project]
PICASSO: A Feed-Forward Framework for Parametric Inference of CAD Sketches via Rendering Self-SupervisionWACV 2025[project]
Sketch2Seq: Reconstruct CAD models from Feature-based Sketch SegmentationTVCG 2025
From 2D CAD Drawings to 3D Parametric Models: A Vision-Language ApproachAAAI 2025[webpage]
DAFU-CAD: Depth-assisted Feature Unraveling for Sketch-based Robust CAD ModelingMM 2025
Sketch2Arti: Sketch-based Articulation Modeling of CAD ObjectsSIGGRAPH 2026[webpage]
Bidirectional Query-Driven Generation of Parametric CAD SketchCVPR 2026
CADrawer: Autoregressive CAD Generation from 3D SketchesEG 2026[webpage]

6. Sketch Based Garment Design

7. Sketch Completion

  • Sketch completion
  • Sketch gap / connectivity detection

8. Sketch Restoration, Retargeting and Inpainting

  • Manga
  • Hand-Drawn Drawings

9. Sketch and Shading

10. Sketch Enhancement / Beautification

  • Sketch Enhancement
  • Sketch Beautification
  • Super Resolution

11. Sketch-Guided Detection

  • Object Localization
  • Salient Object Detection
  • Re-identification
  • Keypoint Detection

12. Sketch-Guided Video Synthesis

13. Sketch Recognition

14. Sketch Segmentation and Perceptual Grouping

  • Semantic / Instance Segmentation
  • Perceptual Grouping
  • FloorPlan

15. Sketch Representation Learning

15.1 Latent Representation Learning

PaperSourceCode/Project LinkData MannerRelated Applications
A Neural Representation of Sketch Drawings (Sketch-RNN)ICLR 2018[code]Vector/stroke-levelReconstruction and interpolation
SketchHealer: A Graph-to-Sequence Network for Recreating Partial Human SketchesBMVC 2020[code]Vector/stroke-levelSketch recognition, retrieval, completion and analogy
Sketchformer: Transformer-based Representation for Sketched StructureCVPR 2020[code]Vector/stroke-levelSketch classification, SBIR, reconstruction and interpolation
CoSE: Compositional Stroke EmbeddingsNeurIPS 2020[Code]Vector/stroke-levelAuto-completing diagrams
SketchLattice: Latticed Representation for Sketch ManipulationICCV 2021[code]Lattice graphSketch healing and image-to-sketch synthesis
SketchODE: Learning neural sketch representation in continuous timeICLR 2022[Project]Vector/Stroke-levelContinuous-time representation, reconstruction & interpolation
Linking Sketch Patches by Learning Synonymous Proximity for Graphic Sketch RepresentationAAAI 2023[code]Vector/Stroke-levelSketch synthesis and sketch healing
SketchKnitter: Vectorized Sketch Generation with Diffusion ModelsICLR 2023[code]Vector/Stroke-levelvectorized sketch generation
ChiroDiff: Modelling chirographic data with Diffusion ModelsICLR 2023[Project]Vector/Stroke-levelvectorization, de-noising/healing, abstraction
Enhance Sketch Recognition's Explainability via Semantic Component-Level ParsingAAAI 2024[code]Vector/Stroke-levelrecognition and segmentation
Modelling complex vector drawings with stroke-cloudsICLR 2024[code]Vector/Stroke-levelreconstruction and generation
Sketchformer++: A Hierarchical Transformer Architecture for Vector Sketch RepresentationCVM 2024Vector/Stroke-levelreconstruction, recognition and semantic segmentation
VQ-SGen: A Vector Quantized Stroke Representation for Creative Sketch GenerationICCV 2025[webpage]Vector/Stroke-levelgeneration and completion
PaperSourceCode/Project LinkData MannerRelated Applications
A Learned Representation for Scalable Vector GraphicsICCV 2019[code]SVGFont design
DeepSVG: A Hierarchical Generative Network for Vector Graphics AnimationNeurIPS 2020[Code] [Project]SVGVector Graphics Animation, reconstruction and interpolation
SVGformer: Representation Learning for Continuous Vector Graphics using TransformersCVPR 2023SVGReconstruction, classification, interpolation, retrieval
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesisarxiv 24.01SVGgeneration

15.2 Self-supervised or Few/Zero-shot Learning

15.3 Sketch Abstraction Learning

PaperSourceCode/Project LinkData MannerRelated Applications
Learning Deep Sketch AbstractionCVPR 2018Vector/stroke-levelFG-SBIR
Goal-Driven Sequential Data AbstractionICCV 2019Vector/stroke-levelSketch recognition
SketchAA: Abstract Representation for Abstract SketchesICCV 2021Vector/stroke-levelSketch recognition, FB-SBIR, sketch healing
Abstracting Sketches through Simple PrimitivesECCV 2022[code]Vector/stroke-levelSketch recognition, FG-SBIR
SEA: Evaluating Sketch Abstraction Efficiency via Element-level Commonsense Visual Question AnsweringCVPR 2026[code] [webpage]Pixel-level

15.4 Multi-modality Learning

15.5 Implicit Neural Representations

15.6 Miscellaneous

PaperSourceCode/Project LinkData MannerRelated Applications
Pixelor: a competitive sketching AI agent. So you think you can sketch?SIGGRAPH Asia 2020[Project] [Code]Vector/stroke-levelSketch synthesis and recognition
Learning Geometry-aware Representations by SketchingCVPR 2023[code]Vector/stroke-levelobject attribute classification, domain transfer, stroke-based generation, FG-SBIR
SketchXAI: A First Look at Explainability for Human SketchesCVPR 2023[project]Vector/stroke-levelsketch recognition
Prediction with Visual Evidence: Sketch Classification Explanation via Stroke-Level AttributionsTIP 2023Vector/stroke-level
What Sketch Explainability Really Means for Downstream TasksCVPR 2024Vector/stroke-level
Do Generalised Classifiers really work on Human Drawn Sketches?ECCV 2024Pixel-level
SketchFusion: Learning Universal Sketch Features through Fusing Foundation ModelsCVPR 2025[webpage]Pixel-levelsketch retrieval, recognition, segmentation, correspondence learning
Modeling the Visual Ambiguity of Human SketchesCVPR 2026Pixel-levelSBIR

16. Sketch and Visual Correspondence

  • Datasets
  • Methods

17. Sketch Animation/Inbetweening

Please refer to repository MarkMoHR/Awesome-2D-Animation for details.

18. Sketch and AR/VR

  • Review
  • Papers
PaperSourceCode/Project Link
Experimental Evaluation of Sketching on Surfaces in VRCHI 2017
SweepCanvas: Sketch-based 3D Prototyping on an RGB-D ImageUIST 2017[video]
Model-Guided 3D SketchingTVCG 2018[video]
SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in SituCHI 2018[webpage]
Mobi3DSketch: 3D Sketching in Mobile ARCHI 2019[video]
Interactive Body-Driven Graphics for Augmented Video PerformanceCHI 2019[webpage]
Interactive Liquid Splash Modeling by User SketchesSIGGRAPH Asia 2020[video]
Towards 3D VR-Sketch to 3D Shape Retrieval3DV 2020[code] [project]
Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionCHI 2020[project]
RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic SketchingUIST 2020[project]
3D Curve Creation on and around Physical Objects with Mobile ARTVCG 2021[video]
HandPainter - 3D Sketching in VR with Hand-based Physical ProxyCHI 2021[video]
Fine-Grained VR Sketching: Dataset and Insights3DV 2021[code]
Structure-Aware 3D VR Sketch to 3D Shape Retrieval3DV 2022[code]
GestureSurface: VR Sketching through Assembling Scaffold Surface with Non-Dominant HandTVCG 2023
3D VR Sketch Guided 3D Shape Prototyping and ExplorationICCV 2023[code]
VRsketch2Gaussian: 3D VR Sketch Guided 3D Object Generation with Gaussian Splattingarxiv 25.03
Order Matters: 3D Shape Generation from Sequential VR SketchesCVPR 2026[code] [webpage]
HolmeSketcher: Generative 3D Sketch Mapping for Spatial Reconstruction in Crime Scene Investigationarxiv 26.04

19. Sketch Quality Measurement

20. Stroke Stylization

21. Study on Drawing Behavior

sbie
sbir
sketch
sketch-app
sketch-based
sketch-based-3d-shape
sketch-based-application
sketch-based-image-retrieval
sketch-based-modeling
sketch-based-retrieval
sketch-grouping
sketch-segmentation
sketch-to-image
sketch-toolbox
sketch-to-shape

Contributors

MarkMoHR

324 commits

dasayan05

3 commits

wangqiang9

2 commits

MarkMoHR/Awesome-Sketch-Based-Applications

:books: A collection of sketch based application papers.

716

337 commits

updated Aug 21, 2026

See the code

README

Awesome-Sketch-Based-Applications

A collection of sketch based applications.

Feel free to create a PR or an issue.

Outline


0. Survey & Toolkit

  • Survey
  • Toolkit
PaperSourceCode/Project Link
SketchKit2026[code]

1. Sketch Based Image Synthesis

1.1 Automatic Synthesis

  • Natural Image or Object
  • Human Face / Portrait / Body
  • 3D image
PaperSourceCode/Project Link
3D-aware Conditional Image SynthesisCVPR 2023[project] [code]

1.2 Style-conditioned

1.3 Text-conditioned

2. Sketch Based Image Editing

  • Arbitrary Image
  • Human Face / Portrait / Hair
  • Anime Editing
  • Video Editing

3. Sketch Based Image Retrieval (SBIR)

  • Object-level
PaperSourceCode/Project Link
Sketch Me That ShoeCVPR 2016[code-caffe] [code-tf] [project]
Deep Multi-task Attribute-driven Ranking for Fine-grained Sketch-based Image RetrievalBMVC 2016
Deep Sketch Hashing: Fast Free-hand Sketch-Based Image RetrievalCVPR 2017[code]
Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image RetrievalICCV 2017[project]
Zero-Shot Sketch-Image HashingCVPR 2018
SketchMate: Deep Hashing for Million-Scale Human Sketch RetrievalCVPR 2018
Generative Domain-Migration Hashing for Sketch-to-Image RetrievalECCV 2018[code]
A Zero-Shot Framework for Sketch Based Image RetrievalECCV 2018[code]
Generalising Fine-Grained Sketch-Based Image RetrievalCVPR 2019
Doodle to Search: Practical Zero-Shot Sketch-Based Image RetrievalCVPR 2019[project] [code]
LiveSketch: Query Perturbations for Guided Sketch-Based Visual SearchCVPR 2019
Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-Based Image RetrievalCVPR 2019[code]
Learning Structural Representations via Dynamic Object Landmarks Discovery for Sketch Recognition and RetrievalTIP 2019
Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image RetrievalICCV 2019
TC-Net for iSBIR: Triplet Classification Network for Instance-level Sketch Based Image RetrievalACM MM 2019
Sketch-Based Image Retrieval With Multi-Clustering Re-RankingTCSVT 2019
Semi-Heterogeneous Three-Way Joint Embedding Network for Sketch-Based Image RetrievalTCSVT 2019
Zero-Shot Sketch-Based Image Retrieval via Graph Convolution NetworkAAAI 2020
Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image RetrievalCVPR 2020[code]
Solving Mixed-modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image RetrievalCVPR 2020
Fine-Grained Instance-Level Sketch-Based Image RetrievalIJCV 2020
StyleMeUp: Towards Style-Agnostic Sketch-Based Image RetrievalCVPR 2021
More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch-Based Image RetrievalCVPR 2021[code]
DLA-Net for FG-SBIR: Dynamic Local Aligned Network for Fine-Grained Sketch-Based Image RetrievalACM MM 2021
Domain-Aware SE Network for Sketch-based Image Retrieval with Multiplicative Euclidean Margin SoftmaxACM MM 2021[code]
Relationship-Preserving Knowledge Distillation for Zero-Shot Sketch Based Image RetrievalACM MM 2021
Transferable Coupled Network for Zero-Shot Sketch-Based Image RetrievalTPAMI 2021[project]
TVT: Three-Way Vision Transformer through Multi-Modal Hypersphere Learning for Zero-Shot Sketch-Based Image RetrievalAAAI 2022
Sketching without Worrying: Noise-Tolerant Sketch-Based Image RetrievalCVPR 2022[code]
Sketch3T: Test-time Training for Zero-Shot SBIRCVPR 2022
Augmented Multi-Modality Fusion for Generalized Zero-Shot Sketch-based Visual RetrievalTIP 2022[code]
Adaptive Fine-Grained Sketch-Based Image RetrievalECCV 2022[code]
Conditional Stroke Recovery for Fine-Grained Sketch-Based Image RetrievalECCV 2022[code]
A Sketch Is Worth a Thousand Words: Image Retrieval with Text and SketchECCV 2022[code] [project]
Multi-Level Region Matching for Fine-Grained Sketch-Based Image RetrievalACM MM 2022[code]
Prototype-based Selective Knowledge Distillation for Zero-Shot Sketch Based Image RetrievalACM MM 2022
DLI-Net: Dual Local Interaction Network for Fine-Grained Sketch-Based Image RetrievalTCSVT 2022[code]
Data-Free Sketch-Based Image RetrievalCVPR 2023[code]
Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable StyleCVPR 2023[code]
Exploiting Unlabelled Photos for Stronger Fine-Grained SBIRCVPR 2023[project]
CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or NotCVPR 2023[project]
Cross-Domain Alignment for Zero-Shot Sketch-Based Image RetrievalTCSVT 2023
Semi-transductive Learning for Generalized Zero-Shot Sketch-Based Image RetrievalAAAI 2023
Text-to-Image Diffusion Models are Great Sketch-Photo MatchmakersCVPR 2024[project]
You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image RetrievalCVPR 2024[project]
How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?CVPR 2024[project]
Asymmetric Mutual Alignment for Unsupervised Zero-Shot Sketch-Based Image RetrievalAAAI 2024
Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex InteractionsAAAI 2024[project]
Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image RetrievalECCV 2024
Elevating All Zero-Shot Sketch-Based Image Retrieval Through Multimodal Prompt LearningECCV 2024[code]
Zero-Shot Sketch Based Image Retrieval via Modality Capacity GuidanceIJCAI-24[code]
Sketch Down the FLOPs: Towards Efficient Networks for Human SketchCVPR 2025[webpage]
Unified Category and Style Generalization for Instance-Level Sketch RetrievalSIGIR 2025[code]
  • Scene-level
  • Video Retrieval

4. Sketch Based 3D Shape Retrieval

5. Sketch Based 3D Shape Modeling

  • Survey
PaperSourceCode/Project Link
Deep Sketch-Based 3D Modeling: A SurveyCGF 2026
  • Object/Shape Generation
PaperSourceCode/Project Link
3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks3DV 2017[code] [project]
Shape Synthesis from Sketches via Procedural Models and Convolutional NetworksTVCG 2017
BendSketch: Modeling Freeform Surfaces Through 2D SketchingSIGGRAPH 2017[project]
Robust Flow-Guided Neural Prediction for Sketch-Based Freeform Surface ModelingSIGGRAPH Asia 2018[code] [project]
Monster Mash: A Single-View Approach to Casual 3D Modeling and AnimationSIGGRAPH Asia 2020[project] [code] [demo]
Interactive Liquid Splash Modeling by User SketchesSIGGRAPH Asia 2020
Towards Practical Sketch-Based 3D Shape Generation: The Role of Professional SketchesTCSVT 2020
Sketch2Model: View-Aware 3D Modeling from Single Free-Hand SketchesCVPR 2021
Sketch2Mesh: Reconstructing and Editing 3D Shapes from SketchesICCV 2021
Real-time Skeletonization for Sketch-based ModelingSMI 2021[code]
Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single SketchTVCG 2022
SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth SamplingECCV 2022[code]
Deep Reconstruction of 3D Smoke Densities from Artist SketchesEG 2022[code]
A Diffusion-ReFinement Model for Sketch-to-Point ModelingACCV 2022[code]
RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent DatasetCVPR 2023[project]
Reality3DSketch: Rapid 3D Modeling of Objects from Single Freehand SketchesTMM 2023
GA-Sketching: Shape Modeling from Multi-View Sketching with Geometry-Aligned Deep Implicit FunctionsPG 2023[code]
Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D ShapesCVPR 2024[project] [code]
SENS: Part-Aware Sketch-based Implicit Neural Shape ModelingEG 2024[code] [project]
3D Reconstruction from a Single Sketch via View-dependent Depth SamplingTPAMI 2024[code]
Sketch2Vox: Learning 3D Reconstruction from a Single Monocular SketchECCV 2024
MeshPad: Interactive Sketch Conditioned Artistic-designed Mesh Generation and EditingICCV 2025[webpage]
PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned PriorICCV 2025[webpage] [code]
Variational Neural Surfacing of 3D SketchesSIGGRAPH Asia 2025
From Sketch to Reality: Enabling High-Quality, Cross-Category 3D Model Generation from Free-Hand Sketches with Minimal DataTVCG 2026
Part-level Semantic Fusion for Sketch-based 3D Voxel ReconstructionTCSVT 2026
Sketch and Vector-Guided 3D Shape Generation via Cross-Modal DiffusionICASSP 2026
NeuralSketch2Surf: Fast Neural Surfacing of Unoriented 3D SketchesSIGGRAPH 2026[code]
  • Face/Head/Hair Generation
  • Human Pose/Motion Generation
  • Scene Generation
  • NeRF & 3DGS
  • CAD sketch
PaperSourceCode/Project Link
Lifting Freehand Concept Sketches into 3DSIGGRAPH Asia 2020[project] [code]
Sketch2CAD: Sequential CAD Modeling by Sketching in ContextSIGGRAPH Asia 2020[project] [code]
Computer-Aided Design as LanguageNeurIPS 2021[code]
Free2CAD: Parsing Freehand Drawings into CAD CommandsSIGGRAPH 2022[project] [code]
Symmetry-driven 3D Reconstruction From Concept SketchesSIGGRAPH 2022[project]
Piecewise-smooth Surface Fitting Onto Unstructured 3D SketchesSIGGRAPH 2022[project]
Vitruvion: A Generative Model of Parametric CAD SketchesICLR 2022[project] [code]
Reconstruction of Machine-Made Shapes from Bitmap SketchesSIGGRAPH Asia 2023[project]
CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided AttentionCVPR 2024
SfmCAD: Unsupervised CAD Reconstruction by Learning Sketch-based Feature Modeling OperationsCVPR 2024[code]
DAVINCI: A Single-Stage Architecture for Constrained CAD Sketch InferenceBMVC 2024[project]
PICASSO: A Feed-Forward Framework for Parametric Inference of CAD Sketches via Rendering Self-SupervisionWACV 2025[project]
Sketch2Seq: Reconstruct CAD models from Feature-based Sketch SegmentationTVCG 2025
From 2D CAD Drawings to 3D Parametric Models: A Vision-Language ApproachAAAI 2025[webpage]
DAFU-CAD: Depth-assisted Feature Unraveling for Sketch-based Robust CAD ModelingMM 2025
Sketch2Arti: Sketch-based Articulation Modeling of CAD ObjectsSIGGRAPH 2026[webpage]
Bidirectional Query-Driven Generation of Parametric CAD SketchCVPR 2026
CADrawer: Autoregressive CAD Generation from 3D SketchesEG 2026[webpage]

6. Sketch Based Garment Design

7. Sketch Completion

  • Sketch completion
  • Sketch gap / connectivity detection

8. Sketch Restoration, Retargeting and Inpainting

  • Manga
  • Hand-Drawn Drawings

9. Sketch and Shading

10. Sketch Enhancement / Beautification

  • Sketch Enhancement
  • Sketch Beautification
  • Super Resolution

11. Sketch-Guided Detection

  • Object Localization
  • Salient Object Detection
  • Re-identification
  • Keypoint Detection

12. Sketch-Guided Video Synthesis

13. Sketch Recognition

14. Sketch Segmentation and Perceptual Grouping

  • Semantic / Instance Segmentation
  • Perceptual Grouping
  • FloorPlan

15. Sketch Representation Learning

15.1 Latent Representation Learning

PaperSourceCode/Project LinkData MannerRelated Applications
A Neural Representation of Sketch Drawings (Sketch-RNN)ICLR 2018[code]Vector/stroke-levelReconstruction and interpolation
SketchHealer: A Graph-to-Sequence Network for Recreating Partial Human SketchesBMVC 2020[code]Vector/stroke-levelSketch recognition, retrieval, completion and analogy
Sketchformer: Transformer-based Representation for Sketched StructureCVPR 2020[code]Vector/stroke-levelSketch classification, SBIR, reconstruction and interpolation
CoSE: Compositional Stroke EmbeddingsNeurIPS 2020[Code]Vector/stroke-levelAuto-completing diagrams
SketchLattice: Latticed Representation for Sketch ManipulationICCV 2021[code]Lattice graphSketch healing and image-to-sketch synthesis
SketchODE: Learning neural sketch representation in continuous timeICLR 2022[Project]Vector/Stroke-levelContinuous-time representation, reconstruction & interpolation
Linking Sketch Patches by Learning Synonymous Proximity for Graphic Sketch RepresentationAAAI 2023[code]Vector/Stroke-levelSketch synthesis and sketch healing
SketchKnitter: Vectorized Sketch Generation with Diffusion ModelsICLR 2023[code]Vector/Stroke-levelvectorized sketch generation
ChiroDiff: Modelling chirographic data with Diffusion ModelsICLR 2023[Project]Vector/Stroke-levelvectorization, de-noising/healing, abstraction
Enhance Sketch Recognition's Explainability via Semantic Component-Level ParsingAAAI 2024[code]Vector/Stroke-levelrecognition and segmentation
Modelling complex vector drawings with stroke-cloudsICLR 2024[code]Vector/Stroke-levelreconstruction and generation
Sketchformer++: A Hierarchical Transformer Architecture for Vector Sketch RepresentationCVM 2024Vector/Stroke-levelreconstruction, recognition and semantic segmentation
VQ-SGen: A Vector Quantized Stroke Representation for Creative Sketch GenerationICCV 2025[webpage]Vector/Stroke-levelgeneration and completion
PaperSourceCode/Project LinkData MannerRelated Applications
A Learned Representation for Scalable Vector GraphicsICCV 2019[code]SVGFont design
DeepSVG: A Hierarchical Generative Network for Vector Graphics AnimationNeurIPS 2020[Code] [Project]SVGVector Graphics Animation, reconstruction and interpolation
SVGformer: Representation Learning for Continuous Vector Graphics using TransformersCVPR 2023SVGReconstruction, classification, interpolation, retrieval
StrokeNUWA: Tokenizing Strokes for Vector Graphic Synthesisarxiv 24.01SVGgeneration

15.2 Self-supervised or Few/Zero-shot Learning

15.3 Sketch Abstraction Learning

PaperSourceCode/Project LinkData MannerRelated Applications
Learning Deep Sketch AbstractionCVPR 2018Vector/stroke-levelFG-SBIR
Goal-Driven Sequential Data AbstractionICCV 2019Vector/stroke-levelSketch recognition
SketchAA: Abstract Representation for Abstract SketchesICCV 2021Vector/stroke-levelSketch recognition, FB-SBIR, sketch healing
Abstracting Sketches through Simple PrimitivesECCV 2022[code]Vector/stroke-levelSketch recognition, FG-SBIR
SEA: Evaluating Sketch Abstraction Efficiency via Element-level Commonsense Visual Question AnsweringCVPR 2026[code] [webpage]Pixel-level

15.4 Multi-modality Learning

15.5 Implicit Neural Representations

15.6 Miscellaneous

PaperSourceCode/Project LinkData MannerRelated Applications
Pixelor: a competitive sketching AI agent. So you think you can sketch?SIGGRAPH Asia 2020[Project] [Code]Vector/stroke-levelSketch synthesis and recognition
Learning Geometry-aware Representations by SketchingCVPR 2023[code]Vector/stroke-levelobject attribute classification, domain transfer, stroke-based generation, FG-SBIR
SketchXAI: A First Look at Explainability for Human SketchesCVPR 2023[project]Vector/stroke-levelsketch recognition
Prediction with Visual Evidence: Sketch Classification Explanation via Stroke-Level AttributionsTIP 2023Vector/stroke-level
What Sketch Explainability Really Means for Downstream TasksCVPR 2024Vector/stroke-level
Do Generalised Classifiers really work on Human Drawn Sketches?ECCV 2024Pixel-level
SketchFusion: Learning Universal Sketch Features through Fusing Foundation ModelsCVPR 2025[webpage]Pixel-levelsketch retrieval, recognition, segmentation, correspondence learning
Modeling the Visual Ambiguity of Human SketchesCVPR 2026Pixel-levelSBIR

16. Sketch and Visual Correspondence

  • Datasets
  • Methods

17. Sketch Animation/Inbetweening

Please refer to repository MarkMoHR/Awesome-2D-Animation for details.

18. Sketch and AR/VR

  • Review
  • Papers
PaperSourceCode/Project Link
Experimental Evaluation of Sketching on Surfaces in VRCHI 2017
SweepCanvas: Sketch-based 3D Prototyping on an RGB-D ImageUIST 2017[video]
Model-Guided 3D SketchingTVCG 2018[video]
SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in SituCHI 2018[webpage]
Mobi3DSketch: 3D Sketching in Mobile ARCHI 2019[video]
Interactive Body-Driven Graphics for Augmented Video PerformanceCHI 2019[webpage]
Interactive Liquid Splash Modeling by User SketchesSIGGRAPH Asia 2020[video]
Towards 3D VR-Sketch to 3D Shape Retrieval3DV 2020[code] [project]
Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionCHI 2020[project]
RealitySketch: Embedding Responsive Graphics and Visualizations in AR through Dynamic SketchingUIST 2020[project]
3D Curve Creation on and around Physical Objects with Mobile ARTVCG 2021[video]
HandPainter - 3D Sketching in VR with Hand-based Physical ProxyCHI 2021[video]
Fine-Grained VR Sketching: Dataset and Insights3DV 2021[code]
Structure-Aware 3D VR Sketch to 3D Shape Retrieval3DV 2022[code]
GestureSurface: VR Sketching through Assembling Scaffold Surface with Non-Dominant HandTVCG 2023
3D VR Sketch Guided 3D Shape Prototyping and ExplorationICCV 2023[code]
VRsketch2Gaussian: 3D VR Sketch Guided 3D Object Generation with Gaussian Splattingarxiv 25.03
Order Matters: 3D Shape Generation from Sequential VR SketchesCVPR 2026[code] [webpage]
HolmeSketcher: Generative 3D Sketch Mapping for Spatial Reconstruction in Crime Scene Investigationarxiv 26.04

19. Sketch Quality Measurement

20. Stroke Stylization

21. Study on Drawing Behavior

sbie
sbir
sketch
sketch-app
sketch-based
sketch-based-3d-shape
sketch-based-application
sketch-based-image-retrieval
sketch-based-modeling
sketch-based-retrieval
sketch-grouping
sketch-segmentation
sketch-to-image
sketch-toolbox
sketch-to-shape

Contributors

MarkMoHR

324 commits

dasayan05

3 commits

wangqiang9

2 commits