A list of papers and other resources on computer vision and deep learning.
26
5 commits
updated Sep 16, 2020
A list of papers and other resources on computer vision and deep learning.
SegLoss: A collection of loss functions for medical image segmentation
Efficient-Segmentation-Networks
三维语义分割概述及总结 [Page]
Unpooling/unsampling deconvolution [Note]
Some basic points: align_corners
Review
arXiv
Journal/Proceedings
[2019IJCV] AdapNet++: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation [Code]
[2019NIPS] Zero-Shot Semantic Segmentation [Code]
[2019NIPS] Grid Saliency for Context Explanations of Semantic Segmentation [github]
[2019NIPS] Region Mutual Information Loss for Semantic Segmentation
[2019NIPS] Improving Semantic Segmentation via Dilated Affinity
[2019NIPS] Correlation Maximized Structural Similarity Lossfor Semantic Segmentation
[2019NIPS] Multi-source Domain Adaptation for Semantic Segmentation
[2019ICCV] Boundary-Aware Feature Propagation for Scene Segmentation
[2019ICCV] [Adaptive-sampling] Efficient Segmentation: Learning Downsampling Near Semantic Boundaries [github] (Reference: LIP: Local Importance-based Pooling, ICCV2019 [github] [Notes])
[2019ICCV] Selectivity or Invariance: Boundary-aware Salient Object Detection [Proj&Code]
[2019ICCV] Recurrent U-Net for Resource-Constrained Segmentation
[2019ICCV] Gated-SCNN: Gated Shape CNNs for Semantic Segmentation [Code] [Proj]
[2019ICCV] Visualizing the Invisible: Occluded Vehicle Segmentation and Recovery
[2019ICCV] ACE: Adapting to Changing Environments for Semantic Segmentation
[2019ICCV] Asymmetric Non-local Neural Networks for Semantic Segmentation
[2019ICCV] DADA: Depth-Aware Domain Adaptation in Semantic Segmentation
[2019ICCV] ACFNet: Attentional Class Feature Network for Semantic Segmentation
[2019ICCV] [EMANet] Expectation-Maximization Attention Networks for Semantic Segmentation [github]
[2019ICCV] CCNet : Criss-Cross Attention for Semantic Segmentation [github]
[2019ICCV] Gated-SCNN: Gated Shape CNNs for Semantic Segmentation
[2019CVPR] ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network [Code]
[2019CVPR] Not All Areas Are Equal: Transfer Learning for Semantic Segmentation via Hierarchical Region Selection
[2019CVPR] Beyond Gradient Descent for Regularized Segmentation Losses [Code]
[2019CVPR] Co-occurrent Features in Semantic Segmentation
[2019CVPR] Context-aware Spatio-recurrent Curvilinear Structure Segmentation [line structure seg]
[2019CVPR] Dual attention network for scene segmentation
[2019CVPR] Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation.
[2019AAAI] Learning Fully Dense Neural Networks for Image Semantic Segmentation
[2019MICCAI] ET-Net: A Generic Edge-Attention Guidance Network for Medical Image Segmentation [Code]
[2019MICCAI] Attention Guided Network for Retinal Image Segmentation [Code]
[2019MICCAIW] CU-Net: Cascaded U-Net with Loss Weighted Sampling for Brain Tumor Segmentation
[2018CVPR] [EncNet] Context Encoding for Semantic Segmentation (oral) [Code-Pytorch] [Slides]
[2018CVPR] Learning a Discriminative Feature Network for Semantic Segmentation
[2018CVPR] DenseASPP for Semantic Segmentation in Street Scenes [Code]
[2018CVPR] Dense Decoder Shortcut Connections for Single-Pass Semantic Segmentation
[2018ECCV] ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
[2018ECCV] ICNet for Real-Time Semantic Segmentation on High-Resolution Images [Proj] [Code]
[2018ECCV] PSANet: Point-wise Spatial Attention Network for Scene Parsing
[2018ECCV] Bisenet: Bilateral segmentation network for real-time semantic segmentation [Code]
[2018ECCV] [DeepLabv3+] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [Code]
[2018BMVC] Pyramid Attention Network for Semantic Segmentation
[2018DLMIA] UNet++: A Nested U-Net Architecture for Medical Image Segmentation [Code]
[2018MIDL] Attention U-Net: Learning Where to Look for the Pancreas
[2017arXiv] [DeepLabv3] Rethinking Atrous Convolution for Semantic Image Segmentation
[2017PAMI] [DeepLabv2] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
[2017PAMI] SegNet: A deep convolutional encoder-decoder architecture for image segmentation
[2017CVPR] [GCN] Large Kernel Matters-Improve Semantic Segmentation by Global Convolutional Network [Code] [Note]
[2017CVPR] [PSPNet] Pyramid Scene Parsing Network
[2017CVPR] RefineNet: Multi-path refinement networks for high-resolution semantic segmentation
[2017CVPR] [FCIS] Fully convolutional instance-aware semantic segmentation
[2017CVPR] [FRRN] Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes [Code]
[2017CVPRW] The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation [Code]
[2017ICRA] AdapNet: Adaptive semantic segmentation in adverse environmental conditions [Code]
[2016ICLR] Multi-Scale Context Aggregation by Dilated Convolutions
[2016ICLR] ParseNet: Looking Wider to See Better
[2016CVPR] Instance-aware semantic segmentation via multi-task network cascades
[2016CVPR] Attention to Scale: Scale-Aware Semantic Image Segmentation
[2016ECCV] What's the Point: Semantic Segmentation with Point Supervision
[2016ECCV] Instance-sensitive fully convolutional networks
[2016DLMIA] [UNet+ResNet] The Importance of Skip Connections in Biomedical Image Segmentation
[2015ICLR] [DeepLabv1] Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
[2015ICCV] Conditional random fields as recurrent neural networks
[2015ICCV] [DeconvNet] Learning Deconvolution Network for Semantic Segmentation
[2015MICCAI] U-Net: Convolutional networks for biomedical image segmentation [Note]
[2015CVPR/2017PAMI] [FCN] Fully convolutional networks for semantic segmentation
PanopticSeg
Real-Time Panoptic Segmentation from Dense Detections, arXiv2019.12
Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation, arXiv2019.12
PanDA: Panoptic Data Augmentation, arXiv2019.11
Learning Instance Occlusion for Panoptic Segmentation, arXiv2019.11
Panoptic Edge Detection, arXiv2019.6
[2020ICRA] DS-PASS: Detail-Sensitive Panoramic Annular Semantic Segmentation through SwaftNet for Surrounding Sensing [Code]
[2020AAAI] SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
[2019CVPR] Panoptic Segmentation
[2019CVPR] Attention-guided Unified Network for Panoptic Segmentation
[2019CVPR] Panoptic Feature Pyramid Networks (oral) [unofficial code] [detectron2]
[2019CVPR] UPSNet: A Unified Panoptic Segmentation Network [Code]
[2019CVPR] [OANet] An End-to-end Network for Panoptic Segmentation
[2019CVPR] DeeperLab: Single-Shot Image Parser (oral) [project] [code]
[2019CVPR] Interactive Full Image Segmentation by Considering All Regions Jointly
[2019CVPR] Seamless Scene Segmentation [code]
awesome image-based 3D reconstruction
[Blog] 基于单目视觉的三维重建算法综述
[Bolg] 三维视觉、SLAM方向全球顶尖实验室汇总
BigSFM: Reconstructing the World from Internet Photos, summary of Noah Snavely works [Proj&Code] (Bundler, 1DSfM, sfm-dismbig, DISCO, LocalSymmetry, dataset ...)
A Survey on Deep Leaning Architectures for Image-based Depth Reconstruction, arXiv2019.6
[2019PAMI] Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
[2017Robot] Keyframe-based monocular SLAM: design, survey, and future directions, Robotics and Autonomous Systems
[2017WACV] Pano2CAD: Room Layout From A Single Panorama Image
[2014ECCV] PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding, Oral [Homepage&Code] [PanoBasic]
Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mapping, arXiv2019.12 [Code]
Rotation Invariant Point Cloud Classification: Where Local Geometry Meets Global Topology, arXiv2019.11
SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Driving, arXiv2019.9 [Code]
Going Deeper with Point Networks, arXiv2019.7 [Code]
[2020GRSM] A Review of Point Cloud Semantic Segmentation
[2019NIPS] [PVCNN] Point-Voxel CNN for Efficient 3D Deep Learning (Spotlight) [Proj] [Code]
[2019IROS] RangeNet++: Fast and Accurate LiDAR Semantic Segmentation [Code]
[2019ICCV] SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
[2019ICCV] Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation
[2019ICCV] Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion (oral)
[2019CVPR] ClusterNet: Deep Hierarchical Cluster Network With Rigorously Rotation-Invariant Representation for Point Cloud Analysis
[2018NIPS] PointCNN: Convolution On X-Transformed Points [Code]
[2018ECCV] Efficient Semantic Scene Completion Network with Spatial Group Convolution [Code]
[2017NIPS] PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space [Code]
[2017CVPR] PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation [Code]
Tutorial&Reviews
RAW
Super-Resolution
[Blog] [深入浅出深度学习超分辨率](https://mp.weixin.qq.com/s/o-I6T8f4AcETJqlDNZs9ug
A Deep Journey into Super-resolution: A survey, arXiv2019.9
[2020PAMI] Deep Learning for Image Super-resolution: A Survey
[2019IJAC] Deep Learning Based Single Image Super-resolution: A Survey
Densely Residual Laplacian Super-resolution, arXiv2019.7 [Code]
Lightweight Image Super-Resolution with Adaptive Weighted Learning Network, arXiv2019.4 [Code]
[2019SIGG] Handheld Multi-Frame Super-Resolution
[2019CVPR] Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels
[2019CVPR] Zoom To Learn, Learn To Zoom [ProjPage] [Code]
[2019CVPR] Towards Real Scene Super-Resolution with Raw Images [Code]
[2019CVPR] 3D Appearance Super-Resolution with Deep Learning [Code]
[2019CVPR] Learning Parallax Attention for Stereo Image Super-Resolution [Code]
[2019CVPR] Meta-SR: A Magnification-Arbitrary Network for Super-Resolution [github]
[2019CVPRW] Hierarchical Back Projection Network for Image Super-Resolution [Code]
[2019ICCVW] Edge-Informed Single Image Super-Resolution [Code]
[2017CVPRW] Enhanced Deep Residual Networks for Single Image Super-Resolution [Code]
[2016PAMI] [SRCNN] Image Super-Resolution Using Deep Convolutional Networks
[2016NIPS] Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections
[2016CVPR] [ESPCN] Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network
[2016CVPR] [VDSR] Accurate Image Super-Resolution Using Very Deep Convolutional Networks
[2016ECCV] [FSRCNN] Accelerating the Super-Resolution Convolutional Neural Network
[2014ECCV] [SRCNN] Learning a Deep Convolutional Network for Image Super-Resolution
Enhancement
Reflection Removal
Denoising
Deblurring
Deraining
Completion
Image/Video Transfer
Style Transfer Scholar: Dongdong Chen Dmitry Ulyanov
[2018TOG] Progressive Color Transfer with Dense Semantic Correspondences ⭐️⭐️⭐️⭐️
[2017CVPR] Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis
[2016ICML] Texture Networks: Feed-forward Synthesis of Textures and Stylized Images [IN] [Code] [Slides]
[2016CVPR] Image Style Transfer Using Convolutional Neural Networks, Gatys [Code]
[2016ECCV] Perceptual Losses for Real-Time Style Transfer and Super-Resolution
[2015] A neural algorithm of artistic style, Gatys, arXiv2015.9 [Code]
Blending/Fusion
PedestrainDetection
Deep Learning for Person Re-identification: A Survey and Outlook, arXiv2020.1 [Code]
Pedestrain Attribute Recognition: A Survey, arXiv2019.1 [Proj]
CrowdHuman: A Benchmark for Detecting Human in a Crowd, arXiv201804 [Proj] [Note]
PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes, arXiv2019.9
[2020TMM/2019CVPRW] Bag of Tricks and A Strong Baseline for Deep Person Re-identification [Code]
[2019ICCV] Mask-Guided Attention Network for Occluded Pedestrian Detection [Code]
[2019CVPR] VRSTC: Occlusion-Free Video Person Re-Identification [occlusion]
[2018CVPR] Repulsion Loss: Detecting Pedestrians in a Crowd, CVPR2018 [occlusion]
[2016ECCV] Stacked Hourglass Networks for Human Pose Estimation
CrowdCounting
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detection, arXiv2019.6 [Code]
W-Net: Reinforced U-Net for Density Map Estimation, arXiv2019.3 [Unofficial Code]
[2019TIP] HA-CCN: Hierarchical Attention-based Crowd Counting Network
[2019ICCV] Bayesian Loss for Crowd Count Estimation with Point Supervision [Code]
[2019ICCV] Crowd Counting with Deep Structured Scale Integration Network (oral) [github]
[2019ICCV] Learning Spatial Awareness to Improve Crowd Counting (oral)
[2019ICCV] Perspective-Guided Convolution Networks for Crowd Counting [Code] [Dataset]
[2019ICCV] Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting
[2019ICCV] Pushing the Frontiers of Unconstrained Crowd Counting: New Dataset and Benchmark Method
[2019ICCV] Counting with Focus for Free [Code]
[2019ICCVW] Crowd Counting on Images with Scale Variation and Isolated Clusters
[2019CVPR] Learning from Synthetic Data for Crowd Counting in the Wild [Homepage] [Dataset]
[2019MMM] Improving the Learning of Multi-column Convolutional Neural Network for Crowd Counting
[2019ICME] Locality-constrained Spatial Transformer Network for Video Crowd Counting
[2019SciAdvance] Number detectors spontaneously emerge ina deep neural network designed for visual object recognition [Note]
[2019TII] Automated Steel Bar Counting and Center Localization with Convolutional Neural Networks [Code]
[2018MICCAIW] Microscopy Cell Counting with Fully Convolutional Regression Networks [Code]
[2010NIPS] Learning to count objects in images [Code]
GAN学习路线图:论文、应用、课程、书籍大总结 [Page]
深度学习中最常见GAN模型概览: GAN,DCGAN,CGAN,infoGAN,ACGAN,CycleGAN,StackGAN ...
Training Tricks
How to Train a GAN? Tips and tricks to make GANs work [Page]
Start from NIPS2016, 17 GAN tricks, by Soumith Chintala, Emily Denton, Martin Arjovsky, Michael Mathieu. How to Train a GAN, NeurIPS2016
Top highlight Advances in Generative Adversarial Networks (GANs): A summary of the latest advances in Generative Adversarial Networks [Page] [Note]
Keep Calm and train a GAN. Pitfalls and Tips on training Generative Adversarial Networks [Page]
Image Augmentations for GAN Training. arXiv202006
Papers
[Blogg] A Beginner's Guide to Generative Adversarial Networks (GANs), 2019
Generative Adversarial Networks: A Survey and Taxonomy, arXiv2020.2 [GANReview]
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications, arXiv202001
[2019ACMCS] How Generative Adversarial Networks and Their Variants Work: An Overview
StarGAN v2: Diverse Image Synthesis for Multiple Domains. arXiv201912 [Code]
This dataset does not exist: training models from generated images, arXiv2019.11
Landmark Assisted CycleGAN for Cartoon Face Generation. arXiv201907
Maximum Entropy Generators for Energy-Based Models, arXiv2019.5 [Code]
[2019NIPS] Few-shot Video-to-Video Synthesis [Code]
[2019NIPS] [vid2vid] Video-to-Video Synthesis [Code]
[2019CVPR] Semantic Image Synthesis with Spatially-Adaptive Normalization [Proj] [Code]
[2019CVPR] [seg2vid] Video Generation from Single Semantic Label Map [Code]
[2019BMVC] The Art of Food: Meal Image Synthesis from Ingredients
[2018ICLR] Spectral Normalization for Generative Adversarial Networks [Code] [Supp1] [Supp2]
[2018CVPR] [pix2pixHD] High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
[2018CVPR] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation (oral) [Code]
[2018ECCV] [FE-GAN] Fashion Editing with Multi-scale Attention Normalization [Notes]
[2018ECCV] Image Inpainting for Irregular Holes Using Partial Convolutions [Code] [Code2] [used for DeepNude]
[2017ICCV] [CycleGAN] Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks [Proj]
[2017CVPR] [Pix2Pix] Image-to-Image Translation with Conditional Adversarial Networks [Demo]
[2016ICLR] [DCGAN] Unsupervised representation learning with deep convolutional generative adversarial networks
[2016ICML] A Theory of Generative ConvNet [S-C Zhu] [Proj/Code]
[2014NIPS] Generative Adversarial Nets
[YOWO] You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localization arXiv201911 [Code]
[2019CVPR] Learning Video Representations from Correspondence Proposals
现有的视频深度学习架构通常依赖于三维卷积、自相关、非局部模块等运算,这些运算难以捕捉视频中帧间的长程运动/相关性,该文提出的CPNet学习视频中图片之间的长程对应关系,来解决现有方法在处理视频长程运动中的局限性.
Video Object Detection
Video Object segmentation
[2016CVPR] A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
[2019ICCV] RANet: Ranking Attention Network for Fast Video Object Segmentation
[2019CVPR] See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks [Code]
[2019CVPR] Improving Semantic Segmentation via Video Propagation and Label Relaxation [Code]
Optimization for deep learning: theory and algorithms. arXiv201912 [[OptimizationCourse]](Optimization Theory for Deep Learning)
Why Adam Beats SGD for Attention Models. arXiv201912
Momentum Contrast for Unsupervised Visual Representation Learning, Kaiming He arXiv2019.11
Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources, Amazon, arXiv2019.5
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, arXiv2018.4 [Notes]
[2019NIPS] Uniform convergence may be unable to explain generalization in deep learning
[2019NIPS] Understanding the Role of Momentum in Stochastic Gradient Methods
[2019NIPS] Lookahead optimizer: k steps forward, 1 step back [Code] [Pytorch] [TF]
[2019ICLR] [AdaBound] Adaptive gradient methods with dynamic bound of learning rate [Pytorch] [TF-example]
AdaBound combines SGD and Adam to make it fast as Adam at training start and convergence like SGD later. Usage: require Python 3.6+, and pip install: pip install adabound, and then: optimizer = adabound.AdaBound(model.parameters(), lr=1e-3, final_lr=0.1). Version of TensorFlow is coming.
[2019CVPRW] The Indirect Convolution Algorithm
[2019ISCAW] Accelerated CNN Training Through Gradient Approximation
Fast training for neural networks, You Yang, Jiangmen Talk [Video]
Activation
[Blog] 深度学习中的激活函数
Dead Relu [Notes]
[2019CVPR] Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem (oral) [Code]
[2018] [GELU] Gaussian Error Linear Units (GELUs). arXiv201811 [Note]
# GELU in GPT-2: def gelu(x): return 0.5*x*(1+tf.tanh(np.sqrt(2/np.pi)*(x+0.044715*tf.pow(x, 3))))
[2016ICML] [CReLU] Understanding and improving convolutional neural networks via concatenated rectified linear units
[2015ICCV] [PReLU-Net/msra Initilization] Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Normalization
Normalization Scholar: Ping Luo
[Blog] Introduction to Normalization [Page] [Note]
[Blog] Introduction to BN/LN/IN/GN [Page] [Page2]
[Talk] Devils in BatchNorm, Jiangmen Talk, 2019 [Page]
[Blog] An Overview of Normalization Methods in Deep Learning, 2018.11 [Page]
Attentive Normalization. [Tianfu Wu] arXiv2019.11 [Code]
Network Deconvolution. [a alternative to Batch Normalization]. arXiv2019.9 [Proj]
Weight Standardization. arXiv2019.3 [Code]
[IN] Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv2017.11 [Code]
[LN] Layer Normalization. [Hinton] arXiv2016.7 [Note]
[2019NIPS] Understanding and Improving Layer Normalization
[2018NIPS] How Does Batch Normalization Help Optimization? [arXiv19v] [Ref]
[2018NIPS] [BIN] Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks [Code]
[2018ECCV] [GN] Group normalization
[2017NIPS] Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models
[2016NIPS] [WN] Weight normalization: A simple reparameterization to accelerate training of deep neural networks
[2015ICML] [BN] Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Dropout
[2014JMLR] Dropout: a simple way to prevent neural networks from overfitting
[2012NIPS] ImageNet Classification with Deep Convolutional Neural Networks
Augmentation
[Blog] Research Guide: Data Augmentation for Deep Learning. 201910
[Blog] Data Augmentation: How to use Deep Learning when you have Limited Data. 201805 [Page]
[2019JBD] A survey on Image Data Augmentation for Deep Learning. [PDF] [Notes]
Data Augmentation Revisited: Rethinking the Distribution Gap between Clean and Augmented Data. arXiv2019.11
FMix: Enhancing Mixed Sample Data Augmentation arXiv202006 [Code]
GridMask Data Augmentation. arXiv202001 [Code] [Note]
Let’s Get Dirty: GAN Based Data Augmentation for Soiling and Adverse Weather Classification in Autonomous Driving. arXiv2019.12
PanDA: Panoptic Data Augmentation, arXiv2019.11
Faster AutoAugment: Learning augmentation strategies using backpropagation. arXiv201911
Automatic Data Augmentation by Learning the Deterministic Policy. arXiv201910
Greedy AutoAugment, arXiv2019.8
Safe Augmentation: Learning Task-Specific Transformations from Data, arXiv2019.7 [Code]
Learning Data Augmentation Strategies for Object Detection. arXiv201906 [Code]
[2020ICLR] AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty [Code]
[2019NIPS] Implicit Semantic Data Augmentation for Deep Networks
[2019NIPS] Fast AutoAugment
[2019ICML] Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules [Code] [Examples]
[2019ICCV] CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features [Code]
[2019ICCVW] Occlusions for Effective Data Augmentation in Image Classification
[2019ICCVW] Style Augmentation: Data Augmentation via Style Randomization
[2019CVPR] AutoAugment: Learning Augmentation Policies from Data [Code]
[2018ICLR] Mixup: Beyond empirical risk minimization
[2018ACML] RICAP: Random Image Cropping and Patching Data Augmentation for Deep CNNs [Code]
[2018ICANN] Further advantages of data augmentation on convolutional neural networks (best paper)
[Blog] 从Softmax到AMSoftmax
[Blog] Convolutional Neural Networks Structure
[Blog] A Survey of the Recent Architectures of Deep Convolutional Neural Networks, 2019
[Blog] CNN下/上采样详析
Module
Pooling:
ViP: Virtual Pooling for Accelerating CNN-based Image Classification and Object Detection, arXiv201906
Learning Spatial Pyramid Attentive Pooling in Image Synthesis and Image-to-Image Translation, arXiv201901
[2020AAAI] Revisiting Bilinear Pooling: A coding Perspective [Note]
[2019ICCV] LIP: Local Importance-based Pooling [Code] [Notes]
[2018ECCV] Grassmann Pooling as Compact Homogeneous Bilinear Pooling for Fine-Grained Visual Classification
[2017CVPR] Low-rank bilinear pooling for fine-grained classification
[2016EMNLP] Multimodal compact bilinear pooling for visual question answering and visual grounding
[2016CVPR] Compact bilinear pooling
[2015ICCV] [bilinear pooling] Bilinear CNN Models for Fine-grained Visual Recognition
[2012ECCV] Semantic segmentation with second-order pooling
Dynamic Convolutions: Exploiting Spatial Sparsity for Faster Inference arXiv201912
Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator, arXiv201911
Rethinking the Number of Channels for the Convolutional Neural Network, arXiv201909
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks, arXiv201909 [Code]
Mapped Convolutions. [For 2D/3D/Spherical]. arXiv201906 [Code]
Spatial Group-wise Enhance: Enhancing Semantic Feature Learning in Convolutional Networks. arXiv201905 [Code] [Note]
[2019ICCV] ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks [Code]
[2019CVPRW] Convolutions on Spherical Images
[2017ICML] Warped Convolutions: Efficient Invariance to Spatial Transformations
Attention module
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks, arXiv201910 [Code] [Chinese]
[2020ICLR] On the Relationship between Self-Attention and Convolutional Layers [Proj] [Code] [Intro]
[2019TIP] Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition [Code]
[2017CVPR] SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning
Backbone
Light-weightCNN
[Blog] Introduction of light-weight CNN
[Blog] Lightweight convolutional neural network: SqueezeNet、MobileNet、ShuffleNet、Xception
SeesawNet: Convolution Neural Network With Uneven Group Convolution. arXiv201912 [Code]
HGC: Hierarchical Group Convolution for Highly Efficient Neural Network, arXiv201906
[2020CVPR] GhostNet: More Features from Cheap Operations [Code]
[2019CVPR] ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network [Code]
[2018ECCV] ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
[2019CVPRW] Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks
[2019BMVC] MixNet: Mixed Depthwise Convolutional Kernels [Code] [Notes]
[2018NIPS] ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions [Code]
[2018NIPS] Learning Versatile Filters for Efficient Convolutional Neural Networks [Code]
[2018BMVC] IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks [Code] [Pytorch]
[2018CVPR] IGCV2: Interleaved Structured Sparse Convolutional Neural Networks
[2017ICCV] [IGVC1] Interleaved Group Convolutions for Deep Neural Networks
MobileNet Series:
[Blog] Introduction for MobileNet and Its Variants
[2019ICCV] Searching for MobileNetV3. [Note]
[2018CVPR] MobileNetV2: Inverted Residuals and Linear Bottlenecks. [Note]
[2017] MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv201704
ShuffleNet Series [Note]
[Code] ShuffleNet Series by Megvii: ShuffleNetV1, V2/V2+/V2.Large/V2.ExLarge, OneShot, DetNAS
[2018ECCV] ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
[2018CVPR] ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
[Blog] 深度神经网络可解释性方法汇总(附TF代码实现)
RetinaFace: Single-stage Dense Face Localisation in the Wild. arXiv201905 [Code-MXNet] [Code-TF]
[2019CVPR] Group Sampling for Scale Invariant Face Detection [Note]
[2019ICCV] Learning to Paint with Model-based Deep Reinforcement Learning [Code] [Note]
[2019ICCV] Fashion++: Minimal Edits for Outfit Improvement (FAIR) [Proj] [Code]
[2019ICCV] SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition [Code&Dataset]
[2018BMVC] Learning Geo-Temporal Image Features [Proj]
AI+Music
Unsupervised Learning
Pose
AI+Application
5 commits
A list of papers and other resources on computer vision and deep learning.
26
5 commits
updated Sep 16, 2020
A list of papers and other resources on computer vision and deep learning.
SegLoss: A collection of loss functions for medical image segmentation
Efficient-Segmentation-Networks
三维语义分割概述及总结 [Page]
Unpooling/unsampling deconvolution [Note]
Some basic points: align_corners
Review
arXiv
Journal/Proceedings
[2019IJCV] AdapNet++: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation [Code]
[2019NIPS] Zero-Shot Semantic Segmentation [Code]
[2019NIPS] Grid Saliency for Context Explanations of Semantic Segmentation [github]
[2019NIPS] Region Mutual Information Loss for Semantic Segmentation
[2019NIPS] Improving Semantic Segmentation via Dilated Affinity
[2019NIPS] Correlation Maximized Structural Similarity Lossfor Semantic Segmentation
[2019NIPS] Multi-source Domain Adaptation for Semantic Segmentation
[2019ICCV] Boundary-Aware Feature Propagation for Scene Segmentation
[2019ICCV] [Adaptive-sampling] Efficient Segmentation: Learning Downsampling Near Semantic Boundaries [github] (Reference: LIP: Local Importance-based Pooling, ICCV2019 [github] [Notes])
[2019ICCV] Selectivity or Invariance: Boundary-aware Salient Object Detection [Proj&Code]
[2019ICCV] Recurrent U-Net for Resource-Constrained Segmentation
[2019ICCV] Gated-SCNN: Gated Shape CNNs for Semantic Segmentation [Code] [Proj]
[2019ICCV] Visualizing the Invisible: Occluded Vehicle Segmentation and Recovery
[2019ICCV] ACE: Adapting to Changing Environments for Semantic Segmentation
[2019ICCV] Asymmetric Non-local Neural Networks for Semantic Segmentation
[2019ICCV] DADA: Depth-Aware Domain Adaptation in Semantic Segmentation
[2019ICCV] ACFNet: Attentional Class Feature Network for Semantic Segmentation
[2019ICCV] [EMANet] Expectation-Maximization Attention Networks for Semantic Segmentation [github]
[2019ICCV] CCNet : Criss-Cross Attention for Semantic Segmentation [github]
[2019ICCV] Gated-SCNN: Gated Shape CNNs for Semantic Segmentation
[2019CVPR] ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network [Code]
[2019CVPR] Not All Areas Are Equal: Transfer Learning for Semantic Segmentation via Hierarchical Region Selection
[2019CVPR] Beyond Gradient Descent for Regularized Segmentation Losses [Code]
[2019CVPR] Co-occurrent Features in Semantic Segmentation
[2019CVPR] Context-aware Spatio-recurrent Curvilinear Structure Segmentation [line structure seg]
[2019CVPR] Dual attention network for scene segmentation
[2019CVPR] Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation.
[2019AAAI] Learning Fully Dense Neural Networks for Image Semantic Segmentation
[2019MICCAI] ET-Net: A Generic Edge-Attention Guidance Network for Medical Image Segmentation [Code]
[2019MICCAI] Attention Guided Network for Retinal Image Segmentation [Code]
[2019MICCAIW] CU-Net: Cascaded U-Net with Loss Weighted Sampling for Brain Tumor Segmentation
[2018CVPR] [EncNet] Context Encoding for Semantic Segmentation (oral) [Code-Pytorch] [Slides]
[2018CVPR] Learning a Discriminative Feature Network for Semantic Segmentation
[2018CVPR] DenseASPP for Semantic Segmentation in Street Scenes [Code]
[2018CVPR] Dense Decoder Shortcut Connections for Single-Pass Semantic Segmentation
[2018ECCV] ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
[2018ECCV] ICNet for Real-Time Semantic Segmentation on High-Resolution Images [Proj] [Code]
[2018ECCV] PSANet: Point-wise Spatial Attention Network for Scene Parsing
[2018ECCV] Bisenet: Bilateral segmentation network for real-time semantic segmentation [Code]
[2018ECCV] [DeepLabv3+] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [Code]
[2018BMVC] Pyramid Attention Network for Semantic Segmentation
[2018DLMIA] UNet++: A Nested U-Net Architecture for Medical Image Segmentation [Code]
[2018MIDL] Attention U-Net: Learning Where to Look for the Pancreas
[2017arXiv] [DeepLabv3] Rethinking Atrous Convolution for Semantic Image Segmentation
[2017PAMI] [DeepLabv2] DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
[2017PAMI] SegNet: A deep convolutional encoder-decoder architecture for image segmentation
[2017CVPR] [GCN] Large Kernel Matters-Improve Semantic Segmentation by Global Convolutional Network [Code] [Note]
[2017CVPR] [PSPNet] Pyramid Scene Parsing Network
[2017CVPR] RefineNet: Multi-path refinement networks for high-resolution semantic segmentation
[2017CVPR] [FCIS] Fully convolutional instance-aware semantic segmentation
[2017CVPR] [FRRN] Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes [Code]
[2017CVPRW] The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation [Code]
[2017ICRA] AdapNet: Adaptive semantic segmentation in adverse environmental conditions [Code]
[2016ICLR] Multi-Scale Context Aggregation by Dilated Convolutions
[2016ICLR] ParseNet: Looking Wider to See Better
[2016CVPR] Instance-aware semantic segmentation via multi-task network cascades
[2016CVPR] Attention to Scale: Scale-Aware Semantic Image Segmentation
[2016ECCV] What's the Point: Semantic Segmentation with Point Supervision
[2016ECCV] Instance-sensitive fully convolutional networks
[2016DLMIA] [UNet+ResNet] The Importance of Skip Connections in Biomedical Image Segmentation
[2015ICLR] [DeepLabv1] Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
[2015ICCV] Conditional random fields as recurrent neural networks
[2015ICCV] [DeconvNet] Learning Deconvolution Network for Semantic Segmentation
[2015MICCAI] U-Net: Convolutional networks for biomedical image segmentation [Note]
[2015CVPR/2017PAMI] [FCN] Fully convolutional networks for semantic segmentation
PanopticSeg
Real-Time Panoptic Segmentation from Dense Detections, arXiv2019.12
Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation, arXiv2019.12
PanDA: Panoptic Data Augmentation, arXiv2019.11
Learning Instance Occlusion for Panoptic Segmentation, arXiv2019.11
Panoptic Edge Detection, arXiv2019.6
[2020ICRA] DS-PASS: Detail-Sensitive Panoramic Annular Semantic Segmentation through SwaftNet for Surrounding Sensing [Code]
[2020AAAI] SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
[2019CVPR] Panoptic Segmentation
[2019CVPR] Attention-guided Unified Network for Panoptic Segmentation
[2019CVPR] Panoptic Feature Pyramid Networks (oral) [unofficial code] [detectron2]
[2019CVPR] UPSNet: A Unified Panoptic Segmentation Network [Code]
[2019CVPR] [OANet] An End-to-end Network for Panoptic Segmentation
[2019CVPR] DeeperLab: Single-Shot Image Parser (oral) [project] [code]
[2019CVPR] Interactive Full Image Segmentation by Considering All Regions Jointly
[2019CVPR] Seamless Scene Segmentation [code]
awesome image-based 3D reconstruction
[Blog] 基于单目视觉的三维重建算法综述
[Bolg] 三维视觉、SLAM方向全球顶尖实验室汇总
BigSFM: Reconstructing the World from Internet Photos, summary of Noah Snavely works [Proj&Code] (Bundler, 1DSfM, sfm-dismbig, DISCO, LocalSymmetry, dataset ...)
A Survey on Deep Leaning Architectures for Image-based Depth Reconstruction, arXiv2019.6
[2019PAMI] Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
[2017Robot] Keyframe-based monocular SLAM: design, survey, and future directions, Robotics and Autonomous Systems
[2017WACV] Pano2CAD: Room Layout From A Single Panorama Image
[2014ECCV] PanoContext: A Whole-room 3D Context Model for Panoramic Scene Understanding, Oral [Homepage&Code] [PanoBasic]
Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mapping, arXiv2019.12 [Code]
Rotation Invariant Point Cloud Classification: Where Local Geometry Meets Global Topology, arXiv2019.11
SalsaNet: Fast Road and Vehicle Segmentation in LiDAR Point Clouds for Autonomous Driving, arXiv2019.9 [Code]
Going Deeper with Point Networks, arXiv2019.7 [Code]
[2020GRSM] A Review of Point Cloud Semantic Segmentation
[2019NIPS] [PVCNN] Point-Voxel CNN for Efficient 3D Deep Learning (Spotlight) [Proj] [Code]
[2019IROS] RangeNet++: Fast and Accurate LiDAR Semantic Segmentation [Code]
[2019ICCV] SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
[2019ICCV] Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation
[2019ICCV] Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion (oral)
[2019CVPR] ClusterNet: Deep Hierarchical Cluster Network With Rigorously Rotation-Invariant Representation for Point Cloud Analysis
[2018NIPS] PointCNN: Convolution On X-Transformed Points [Code]
[2018ECCV] Efficient Semantic Scene Completion Network with Spatial Group Convolution [Code]
[2017NIPS] PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space [Code]
[2017CVPR] PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation [Code]
Tutorial&Reviews
RAW
Super-Resolution
[Blog] [深入浅出深度学习超分辨率](https://mp.weixin.qq.com/s/o-I6T8f4AcETJqlDNZs9ug
A Deep Journey into Super-resolution: A survey, arXiv2019.9
[2020PAMI] Deep Learning for Image Super-resolution: A Survey
[2019IJAC] Deep Learning Based Single Image Super-resolution: A Survey
Densely Residual Laplacian Super-resolution, arXiv2019.7 [Code]
Lightweight Image Super-Resolution with Adaptive Weighted Learning Network, arXiv2019.4 [Code]
[2019SIGG] Handheld Multi-Frame Super-Resolution
[2019CVPR] Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels
[2019CVPR] Zoom To Learn, Learn To Zoom [ProjPage] [Code]
[2019CVPR] Towards Real Scene Super-Resolution with Raw Images [Code]
[2019CVPR] 3D Appearance Super-Resolution with Deep Learning [Code]
[2019CVPR] Learning Parallax Attention for Stereo Image Super-Resolution [Code]
[2019CVPR] Meta-SR: A Magnification-Arbitrary Network for Super-Resolution [github]
[2019CVPRW] Hierarchical Back Projection Network for Image Super-Resolution [Code]
[2019ICCVW] Edge-Informed Single Image Super-Resolution [Code]
[2017CVPRW] Enhanced Deep Residual Networks for Single Image Super-Resolution [Code]
[2016PAMI] [SRCNN] Image Super-Resolution Using Deep Convolutional Networks
[2016NIPS] Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections
[2016CVPR] [ESPCN] Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network
[2016CVPR] [VDSR] Accurate Image Super-Resolution Using Very Deep Convolutional Networks
[2016ECCV] [FSRCNN] Accelerating the Super-Resolution Convolutional Neural Network
[2014ECCV] [SRCNN] Learning a Deep Convolutional Network for Image Super-Resolution
Enhancement
Reflection Removal
Denoising
Deblurring
Deraining
Completion
Image/Video Transfer
Style Transfer Scholar: Dongdong Chen Dmitry Ulyanov
[2018TOG] Progressive Color Transfer with Dense Semantic Correspondences ⭐️⭐️⭐️⭐️
[2017CVPR] Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis
[2016ICML] Texture Networks: Feed-forward Synthesis of Textures and Stylized Images [IN] [Code] [Slides]
[2016CVPR] Image Style Transfer Using Convolutional Neural Networks, Gatys [Code]
[2016ECCV] Perceptual Losses for Real-Time Style Transfer and Super-Resolution
[2015] A neural algorithm of artistic style, Gatys, arXiv2015.9 [Code]
Blending/Fusion
PedestrainDetection
Deep Learning for Person Re-identification: A Survey and Outlook, arXiv2020.1 [Code]
Pedestrain Attribute Recognition: A Survey, arXiv2019.1 [Proj]
CrowdHuman: A Benchmark for Detecting Human in a Crowd, arXiv201804 [Proj] [Note]
PedHunter: Occlusion Robust Pedestrian Detector in Crowded Scenes, arXiv2019.9
[2020TMM/2019CVPRW] Bag of Tricks and A Strong Baseline for Deep Person Re-identification [Code]
[2019ICCV] Mask-Guided Attention Network for Occluded Pedestrian Detection [Code]
[2019CVPR] VRSTC: Occlusion-Free Video Person Re-Identification [occlusion]
[2018CVPR] Repulsion Loss: Detecting Pedestrians in a Crowd, CVPR2018 [occlusion]
[2016ECCV] Stacked Hourglass Networks for Human Pose Estimation
CrowdCounting
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detection, arXiv2019.6 [Code]
W-Net: Reinforced U-Net for Density Map Estimation, arXiv2019.3 [Unofficial Code]
[2019TIP] HA-CCN: Hierarchical Attention-based Crowd Counting Network
[2019ICCV] Bayesian Loss for Crowd Count Estimation with Point Supervision [Code]
[2019ICCV] Crowd Counting with Deep Structured Scale Integration Network (oral) [github]
[2019ICCV] Learning Spatial Awareness to Improve Crowd Counting (oral)
[2019ICCV] Perspective-Guided Convolution Networks for Crowd Counting [Code] [Dataset]
[2019ICCV] Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting
[2019ICCV] Pushing the Frontiers of Unconstrained Crowd Counting: New Dataset and Benchmark Method
[2019ICCV] Counting with Focus for Free [Code]
[2019ICCVW] Crowd Counting on Images with Scale Variation and Isolated Clusters
[2019CVPR] Learning from Synthetic Data for Crowd Counting in the Wild [Homepage] [Dataset]
[2019MMM] Improving the Learning of Multi-column Convolutional Neural Network for Crowd Counting
[2019ICME] Locality-constrained Spatial Transformer Network for Video Crowd Counting
[2019SciAdvance] Number detectors spontaneously emerge ina deep neural network designed for visual object recognition [Note]
[2019TII] Automated Steel Bar Counting and Center Localization with Convolutional Neural Networks [Code]
[2018MICCAIW] Microscopy Cell Counting with Fully Convolutional Regression Networks [Code]
[2010NIPS] Learning to count objects in images [Code]
GAN学习路线图:论文、应用、课程、书籍大总结 [Page]
深度学习中最常见GAN模型概览: GAN,DCGAN,CGAN,infoGAN,ACGAN,CycleGAN,StackGAN ...
Training Tricks
How to Train a GAN? Tips and tricks to make GANs work [Page]
Start from NIPS2016, 17 GAN tricks, by Soumith Chintala, Emily Denton, Martin Arjovsky, Michael Mathieu. How to Train a GAN, NeurIPS2016
Top highlight Advances in Generative Adversarial Networks (GANs): A summary of the latest advances in Generative Adversarial Networks [Page] [Note]
Keep Calm and train a GAN. Pitfalls and Tips on training Generative Adversarial Networks [Page]
Image Augmentations for GAN Training. arXiv202006
Papers
[Blogg] A Beginner's Guide to Generative Adversarial Networks (GANs), 2019
Generative Adversarial Networks: A Survey and Taxonomy, arXiv2020.2 [GANReview]
A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications, arXiv202001
[2019ACMCS] How Generative Adversarial Networks and Their Variants Work: An Overview
StarGAN v2: Diverse Image Synthesis for Multiple Domains. arXiv201912 [Code]
This dataset does not exist: training models from generated images, arXiv2019.11
Landmark Assisted CycleGAN for Cartoon Face Generation. arXiv201907
Maximum Entropy Generators for Energy-Based Models, arXiv2019.5 [Code]
[2019NIPS] Few-shot Video-to-Video Synthesis [Code]
[2019NIPS] [vid2vid] Video-to-Video Synthesis [Code]
[2019CVPR] Semantic Image Synthesis with Spatially-Adaptive Normalization [Proj] [Code]
[2019CVPR] [seg2vid] Video Generation from Single Semantic Label Map [Code]
[2019BMVC] The Art of Food: Meal Image Synthesis from Ingredients
[2018ICLR] Spectral Normalization for Generative Adversarial Networks [Code] [Supp1] [Supp2]
[2018CVPR] [pix2pixHD] High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
[2018CVPR] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation (oral) [Code]
[2018ECCV] [FE-GAN] Fashion Editing with Multi-scale Attention Normalization [Notes]
[2018ECCV] Image Inpainting for Irregular Holes Using Partial Convolutions [Code] [Code2] [used for DeepNude]
[2017ICCV] [CycleGAN] Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks [Proj]
[2017CVPR] [Pix2Pix] Image-to-Image Translation with Conditional Adversarial Networks [Demo]
[2016ICLR] [DCGAN] Unsupervised representation learning with deep convolutional generative adversarial networks
[2016ICML] A Theory of Generative ConvNet [S-C Zhu] [Proj/Code]
[2014NIPS] Generative Adversarial Nets
[YOWO] You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localization arXiv201911 [Code]
[2019CVPR] Learning Video Representations from Correspondence Proposals
现有的视频深度学习架构通常依赖于三维卷积、自相关、非局部模块等运算,这些运算难以捕捉视频中帧间的长程运动/相关性,该文提出的CPNet学习视频中图片之间的长程对应关系,来解决现有方法在处理视频长程运动中的局限性.
Video Object Detection
Video Object segmentation
[2016CVPR] A Benchmark Dataset and Evaluation Methodology for Video Object Segmentation
[2019ICCV] RANet: Ranking Attention Network for Fast Video Object Segmentation
[2019CVPR] See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks [Code]
[2019CVPR] Improving Semantic Segmentation via Video Propagation and Label Relaxation [Code]
Optimization for deep learning: theory and algorithms. arXiv201912 [[OptimizationCourse]](Optimization Theory for Deep Learning)
Why Adam Beats SGD for Attention Models. arXiv201912
Momentum Contrast for Unsupervised Visual Representation Learning, Kaiming He arXiv2019.11
Dynamic Mini-batch SGD for Elastic Distributed Training: Learning in the Limbo of Resources, Amazon, arXiv2019.5
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, arXiv2018.4 [Notes]
[2019NIPS] Uniform convergence may be unable to explain generalization in deep learning
[2019NIPS] Understanding the Role of Momentum in Stochastic Gradient Methods
[2019NIPS] Lookahead optimizer: k steps forward, 1 step back [Code] [Pytorch] [TF]
[2019ICLR] [AdaBound] Adaptive gradient methods with dynamic bound of learning rate [Pytorch] [TF-example]
AdaBound combines SGD and Adam to make it fast as Adam at training start and convergence like SGD later. Usage: require Python 3.6+, and pip install: pip install adabound, and then: optimizer = adabound.AdaBound(model.parameters(), lr=1e-3, final_lr=0.1). Version of TensorFlow is coming.
[2019CVPRW] The Indirect Convolution Algorithm
[2019ISCAW] Accelerated CNN Training Through Gradient Approximation
Fast training for neural networks, You Yang, Jiangmen Talk [Video]
Activation
[Blog] 深度学习中的激活函数
Dead Relu [Notes]
[2019CVPR] Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem (oral) [Code]
[2018] [GELU] Gaussian Error Linear Units (GELUs). arXiv201811 [Note]
# GELU in GPT-2: def gelu(x): return 0.5*x*(1+tf.tanh(np.sqrt(2/np.pi)*(x+0.044715*tf.pow(x, 3))))
[2016ICML] [CReLU] Understanding and improving convolutional neural networks via concatenated rectified linear units
[2015ICCV] [PReLU-Net/msra Initilization] Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Normalization
Normalization Scholar: Ping Luo
[Blog] Introduction to Normalization [Page] [Note]
[Blog] Introduction to BN/LN/IN/GN [Page] [Page2]
[Talk] Devils in BatchNorm, Jiangmen Talk, 2019 [Page]
[Blog] An Overview of Normalization Methods in Deep Learning, 2018.11 [Page]
Attentive Normalization. [Tianfu Wu] arXiv2019.11 [Code]
Network Deconvolution. [a alternative to Batch Normalization]. arXiv2019.9 [Proj]
Weight Standardization. arXiv2019.3 [Code]
[IN] Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv2017.11 [Code]
[LN] Layer Normalization. [Hinton] arXiv2016.7 [Note]
[2019NIPS] Understanding and Improving Layer Normalization
[2018NIPS] How Does Batch Normalization Help Optimization? [arXiv19v] [Ref]
[2018NIPS] [BIN] Batch-Instance Normalization for Adaptively Style-Invariant Neural Networks [Code]
[2018ECCV] [GN] Group normalization
[2017NIPS] Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models
[2016NIPS] [WN] Weight normalization: A simple reparameterization to accelerate training of deep neural networks
[2015ICML] [BN] Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Dropout
[2014JMLR] Dropout: a simple way to prevent neural networks from overfitting
[2012NIPS] ImageNet Classification with Deep Convolutional Neural Networks
Augmentation
[Blog] Research Guide: Data Augmentation for Deep Learning. 201910
[Blog] Data Augmentation: How to use Deep Learning when you have Limited Data. 201805 [Page]
[2019JBD] A survey on Image Data Augmentation for Deep Learning. [PDF] [Notes]
Data Augmentation Revisited: Rethinking the Distribution Gap between Clean and Augmented Data. arXiv2019.11
FMix: Enhancing Mixed Sample Data Augmentation arXiv202006 [Code]
GridMask Data Augmentation. arXiv202001 [Code] [Note]
Let’s Get Dirty: GAN Based Data Augmentation for Soiling and Adverse Weather Classification in Autonomous Driving. arXiv2019.12
PanDA: Panoptic Data Augmentation, arXiv2019.11
Faster AutoAugment: Learning augmentation strategies using backpropagation. arXiv201911
Automatic Data Augmentation by Learning the Deterministic Policy. arXiv201910
Greedy AutoAugment, arXiv2019.8
Safe Augmentation: Learning Task-Specific Transformations from Data, arXiv2019.7 [Code]
Learning Data Augmentation Strategies for Object Detection. arXiv201906 [Code]
[2020ICLR] AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty [Code]
[2019NIPS] Implicit Semantic Data Augmentation for Deep Networks
[2019NIPS] Fast AutoAugment
[2019ICML] Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules [Code] [Examples]
[2019ICCV] CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features [Code]
[2019ICCVW] Occlusions for Effective Data Augmentation in Image Classification
[2019ICCVW] Style Augmentation: Data Augmentation via Style Randomization
[2019CVPR] AutoAugment: Learning Augmentation Policies from Data [Code]
[2018ICLR] Mixup: Beyond empirical risk minimization
[2018ACML] RICAP: Random Image Cropping and Patching Data Augmentation for Deep CNNs [Code]
[2018ICANN] Further advantages of data augmentation on convolutional neural networks (best paper)
[Blog] 从Softmax到AMSoftmax
[Blog] Convolutional Neural Networks Structure
[Blog] A Survey of the Recent Architectures of Deep Convolutional Neural Networks, 2019
[Blog] CNN下/上采样详析
Module
Pooling:
ViP: Virtual Pooling for Accelerating CNN-based Image Classification and Object Detection, arXiv201906
Learning Spatial Pyramid Attentive Pooling in Image Synthesis and Image-to-Image Translation, arXiv201901
[2020AAAI] Revisiting Bilinear Pooling: A coding Perspective [Note]
[2019ICCV] LIP: Local Importance-based Pooling [Code] [Notes]
[2018ECCV] Grassmann Pooling as Compact Homogeneous Bilinear Pooling for Fine-Grained Visual Classification
[2017CVPR] Low-rank bilinear pooling for fine-grained classification
[2016EMNLP] Multimodal compact bilinear pooling for visual question answering and visual grounding
[2016CVPR] Compact bilinear pooling
[2015ICCV] [bilinear pooling] Bilinear CNN Models for Fine-grained Visual Recognition
[2012ECCV] Semantic segmentation with second-order pooling
Dynamic Convolutions: Exploiting Spatial Sparsity for Faster Inference arXiv201912
Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator, arXiv201911
Rethinking the Number of Channels for the Convolutional Neural Network, arXiv201909
AutoGrow: Automatic Layer Growing in Deep Convolutional Networks, arXiv201909 [Code]
Mapped Convolutions. [For 2D/3D/Spherical]. arXiv201906 [Code]
Spatial Group-wise Enhance: Enhancing Semantic Feature Learning in Convolutional Networks. arXiv201905 [Code] [Note]
[2019ICCV] ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks [Code]
[2019CVPRW] Convolutions on Spherical Images
[2017ICML] Warped Convolutions: Efficient Invariance to Spatial Transformations
Attention module
ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks, arXiv201910 [Code] [Chinese]
[2020ICLR] On the Relationship between Self-Attention and Convolutional Layers [Proj] [Code] [Intro]
[2019TIP] Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition [Code]
[2017CVPR] SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning
Backbone
Light-weightCNN
[Blog] Introduction of light-weight CNN
[Blog] Lightweight convolutional neural network: SqueezeNet、MobileNet、ShuffleNet、Xception
SeesawNet: Convolution Neural Network With Uneven Group Convolution. arXiv201912 [Code]
HGC: Hierarchical Group Convolution for Highly Efficient Neural Network, arXiv201906
[2020CVPR] GhostNet: More Features from Cheap Operations [Code]
[2019CVPR] ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network [Code]
[2018ECCV] ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
[2019CVPRW] Depth-wise Decomposition for Accelerating Separable Convolutions in Efficient Convolutional Neural Networks
[2019BMVC] MixNet: Mixed Depthwise Convolutional Kernels [Code] [Notes]
[2018NIPS] ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions [Code]
[2018NIPS] Learning Versatile Filters for Efficient Convolutional Neural Networks [Code]
[2018BMVC] IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks [Code] [Pytorch]
[2018CVPR] IGCV2: Interleaved Structured Sparse Convolutional Neural Networks
[2017ICCV] [IGVC1] Interleaved Group Convolutions for Deep Neural Networks
MobileNet Series:
[Blog] Introduction for MobileNet and Its Variants
[2019ICCV] Searching for MobileNetV3. [Note]
[2018CVPR] MobileNetV2: Inverted Residuals and Linear Bottlenecks. [Note]
[2017] MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv201704
ShuffleNet Series [Note]
[Code] ShuffleNet Series by Megvii: ShuffleNetV1, V2/V2+/V2.Large/V2.ExLarge, OneShot, DetNAS
[2018ECCV] ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
[2018CVPR] ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
[Blog] 深度神经网络可解释性方法汇总(附TF代码实现)
RetinaFace: Single-stage Dense Face Localisation in the Wild. arXiv201905 [Code-MXNet] [Code-TF]
[2019CVPR] Group Sampling for Scale Invariant Face Detection [Note]
[2019ICCV] Learning to Paint with Model-based Deep Reinforcement Learning [Code] [Note]
[2019ICCV] Fashion++: Minimal Edits for Outfit Improvement (FAIR) [Proj] [Code]
[2019ICCV] SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition [Code&Dataset]
[2018BMVC] Learning Geo-Temporal Image Features [Proj]
AI+Music
Unsupervised Learning
Pose
AI+Application
5 commits