References for papers that I've read so that I can easily find them again. Not exhaustive, but trying to keep it up to date.
2020, Knowledge-primed neural networks enable biologically interpretable deep learning on single-cell sequencing data [paper]
2020, Supervised Contrastive Learning, [paper]
2020, fastai: A Layered API for Deep Learning, [paper] [code]
2020, Shapley Flow: A Graph-based Approach to Interpreting Model Predictions, [paper]
2020, When Does Preconditioning Help or Hurt Generalization?, [paper]
2019, Which principal components are most sensitive to distributional changes?, [paper]
2019, Adversarial Examples Are Not Bugs, They are Features [paper]
2019, Learning Loss for Active Learning [paper]
2019, Class-Balanced Loss Based on Effective Number of Samples [paper]
2019, Lookahead Optimizer: k steps forward, 1 step back, [paper]
2019, Four Things Everyone Should Know to Improve Batch Normalization, [paper]
2019, Large Batch Optimization for Deep Learning: Training BERT in 76 minutes [paper]
2019, Predicting the Generalization Gap in Deep Networks with Margin Distributions [paper]
2017-2019, Decoupled Weight Decay Regularization [paper]
2018, Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks [paper] [tensorflow-implementation]
2017, Self-Normalizing Neural Networks, [paper]
2016, All you need is a good init [paper] [unofficial keras-code] [pytorch-implementation]
2009, Measuring classifier performance: a coherent alternative to the area under the ROC curve, [paper]
2019 (2012), High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso [paper] [code]
2019, TriMap: Large-scale Dimensionality Reduction Using Triplets, [paper] [code]
2019, NGBoost: Natural Gradient Boosting for Probabilistic Prediction [paper]
2019, KTBoost: Combined Kernel and Tree Boosting [paper] [code]
2016, Deep Neural Networks for YouTube Recommendations, [paper]
2020, ConBO: Conditional Bayesian Optimization [paper]
2019, Learning Hierarchical Priors in VAEs, [paper]
2019, BoTorch: Programmable Bayesian Optimization in PyTorch, [paper] [code]
2019, GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration, [paper] [code]
2018, Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes, [paper]
2018, A Tutorial on Bayesian Optimization, [paper]
2018, Subset-Conditioned Generation Using Variational Autoencoder With A Learnable Tensor-Train Induced Prior, [paper]
2020, FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence [paper]
2019, MixMatch: A Holistic Approach to Semi-Supervised Learning, [paper]
2019, High-Fidelity Image Generation With Fewer Labels, [paper] [code]
2021, Large Scale Image Completion via Co-Modulated Generative Adversarial Networks, [paper] [code]
2019, Free-Form Image Inpainting with Gated Convolution, [paper]
2018, Image Inpainting for Irregular Holes Using Partial Convolutions, [paper] [code]
2021, DALL·E: Creating Images from Text, [article]
2020, Analyzing and Improving the Image Quality of StyleGAN, [paper]
2019, TraVeLGAN: Image-to-image Translation by Transformation Vector Learning [paper]
2018, Learning Linear Transformations for Fast Arbitrary Style Transfer [paper] [official pytorch-code]
2017, Universal Style Transfer via Feature Transforms [paper]
2017, Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization [paper] [official pytorch-code]
2021, An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, [paper]
2020, EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, [paper]
2020, Label-free Quantification of Pharmacokinetics in Skin with Stimulated Raman Scattering Microscopy and Deep Learning [paper] Amin Feizpour, Troels Marstrand, Louise Bastholm, Stefan Eirefelt, Conor L.Evans
2020, Dense Steerable Filter CNNs for Exploiting Rotational Symmetry in Histology Images, [paper] [code]
2019, Improving Uncertainty Estimation in Convolutional Neural Networks Using Inter-rater Agreement, [paper]
2019, Learning Data Augmentation Strategies for Object Detection [paper] [code]
2019, AutoAugment: Learning Augmentation Policies from Data [paper] [code] [bayesian-version in keras]
2019, Fast AutoAugment [paper] [official pytorch-code]
2018, Bag of Tricks for Image Classification with Convolutional Neural Networks [paper]
2019, Legendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks, [paper]
2020, Contextual Embeddings: When Are They Worth It? [paper]
2020, Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer, [paper]
2019, Unsupervised word embeddings capture latent knowledge from materials science literature, [paper]
2019, BioBERT: a pre-trained biomedical language representation model for biomedical text mining,
2019, Patent Analytics Based on Feature Vector Space Model: A Case of IoT, [paper]
2019, RoBERTa: A Robustly Optimized BERT Pretraining Approach [paper] [code]
2019, XLNet: Generalized Autoregressive Pretraining for Language Understanding [paper] [code] [keras-implementation]
2018, Universal Language Model Fine-tuning for Text Classification [paper] [implementations]
2017, Attention is all you need [paper] [code] [tutorial]
2016, Enriching Word Vectors with Subword Information [paper]
2020, Geodesics in fibered latent spaces: A geometric approach to learning correspondences between conditions, [paper]
2020, High Accuracy Protein Structure Prediction Using Deep Learning [paper] [announcement] John Jumper et al., Fourteenth Critical Assessment of Techniques for Protein Structure Prediction
2019, Improved protein structure prediction using potentials from deep learning, [paper]
2019, Probabilistic variable-length segmentation of protein sequences for discriminative motif discovery (DiMotif) and sequence embedding (ProtVecX) [paper]
2019, Universal Deep Sequence Models for Protein Classification [paper]
2019, Unified rational protein engineering with sequence-only deep representation learning, [paper]
2018, SeriesNet:A Generative Time Series Forecasting Model, [paper]
2017, Conditional Time Series Forecasting with Convolutional Neural Networks [paper]
2020, TrimNet: learning molecular representation from triplet messages for biomedicine [paper]
2020, Molecular Design in Synthetically Accessible Chemical Space via Deep Reinforcement Learning [paper]
2020, Principal Neighbourhood Aggregation for Graph Nets, [paper] [code]
2020, Towards Interpretable Sparse Graph Representation Learning with Laplacian Pooling, [paper] [code]
2020, Molecular representation learning with language models and domain-relevant auxiliary tasks
2020, Domain Extrapolation via Regret Minimization [paper]
2019, Exploring Chemical Compound Space with Quantum-Based Machine Learning, [paper]
2019, Modeling Physico-Chemical ADMET Endpoints with Multitask Graph Convolutional Networks, [paper]
2019, Adaptive Deep Kernel Learning, [paper]
2019, Efficient multi-objective molecular optimization in a continuous latent space, [paper] [code]
2019, Multi-Objective De Novo Drug Design with Conditional Graph Generative Model, [paper]
2019, PharML.Bind: Pharmacologic Machine Learning for Protein-Ligand Interactions, [paper] [code]
2019, Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative Models, [paper]
2019, A Deep Learning Approach to Antibiotic Discovery [paper]
2019, Composing Molecules with Multiple Property Constraints, [paper]
2019, GraphLIME: Local Interpretable Model Explanations for Graph Neural Networks, [paper]
2019, Evaluating Scalable Uncertainty Estimation Methods for DNN-Based Molecular Property Prediction [paper]
2019, Rethinking drug design in the artificial intelligence era [paper]
2019, Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Molecules [paper]
2019, Deep learning enables rapid identification of potent DDR1 kinase inhibitors [paper]
2019, Deep learning for molecular design - a review of the state of the art [paper]
2018, Junction Tree Variational Autoencoder for Molecular Graph Generation [paper]
2017, Neural Message Passing for Quantum Chemistry, [paper] [code]
TabNet, TabNet: Attentive Interpretable Tabular Learning, [paper]
2020, Clinically applicable deep learning for diagnosis and referral in retinal disease, [paper]
2019, GNNExplainer: Generating Explanations for Graph Neural Networks [paper] [code]
2019, Functional Transparency for Structured Data: a Game-Theoretic Approach, [paper]
2019, Using attribution to decode binding mechanism in neural network models for chemistry, [paper]
2019, Interpretable Deep Learning in Drug Discovery, [paper] [code]
2019, Can You Trust This Prediction? Auditing Pointwise Reliability After Learning [paper]
2018, BayesGrad: Explaining Predictions of Graph Convolutional Networks, [paper] [code]
2017, A Unified Approach to Interpreting Model Predictions [paper]
2019, Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks [paper]
2020, Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy [paper]
2021, Accelerating high-throughput virtual screening through molecular pool-based active learning [paper]
2021, Automated discovery of noncovalent inhibitors of SARS-CoV-2 main protease by consensus Deep Docking of 40 billion small molecules [[paper](https://pubs.rsc.org/en/content/articlelanding/2021/sc/d1sc05579h
2020, Deep Docking: A Deep Learning Platform for Augmentation of Structure Based Drug Discovery [paper]
2020, An open-source drug discovery platform enables ultra-large virtual screens [paper]
2020, The upside of being a digital pharma player, [paper]
2020, The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence, [paper]
2019, 150 successful Machine Learning models: 6 lessons learned at Booking.com, [paper]
2018, The state-of-the-art on Intellectual Property Analytics (IPA): A literature review on artificial intelligence, machine learning and deep learning methods for analysing intellectual property (IP) data [paper]
2020, Algorithms for Causal Reasoning in Probability Trees, [paper] [colab]
2018, Causal Discovery with Attention-Based Convolutional Neural Networks, [paper]
2019, A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis [paper]
2019, Machine Learning with Statistical Imputation for Predicting Drug Approvals [paper]
2019, Artificial Intelligence for Clinical Trial Design, [paper]
2019, Estimating Site Performance (ESP): can trial managers predict recruitment success at trial sites? An exploratory study, [paper]
2018, Quantifying and visualizing site performance in clinical trials, [paper]
2017, Predicting enrollment performance of investigational centers in phase III multi-center clinical trials,
2011, Performance-Based Site Selection Reduces Costs and Shortens Enrollment Time [paper]
2020, Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy, [paper] [code] [medium]
2020, CURL: Contrastive Unsupervised Representations for Reinforcement Learning, [paper] [code]
2017, Rainbow: Combining Improvements in Deep Reinforcement Learning, [paper]
1998, Reinforcement Learning for Trading, [paper] John Moody and Matthew Saffell, Advances in Neural Information Processing Systems 11 (NIPS 1998)
2020, The Policy Relevance of Personality Traits, [paper] Wiebke BleidornPatrick HillMitja BackJaap DenissenMarie HenneckeChris HopwoodMarkus JokelaChristian KandlerRichard E. LucasMaike LuhmannUlrich OrthJenny WagnerCornelia WrzusJohannes ZimmermannBrent Roberts, Inpress: American Psychologist
132 commits
References for papers that I've read so that I can easily find them again. Not exhaustive, but trying to keep it up to date.
2020, Knowledge-primed neural networks enable biologically interpretable deep learning on single-cell sequencing data [paper]
2020, Supervised Contrastive Learning, [paper]
2020, fastai: A Layered API for Deep Learning, [paper] [code]
2020, Shapley Flow: A Graph-based Approach to Interpreting Model Predictions, [paper]
2020, When Does Preconditioning Help or Hurt Generalization?, [paper]
2019, Which principal components are most sensitive to distributional changes?, [paper]
2019, Adversarial Examples Are Not Bugs, They are Features [paper]
2019, Learning Loss for Active Learning [paper]
2019, Class-Balanced Loss Based on Effective Number of Samples [paper]
2019, Lookahead Optimizer: k steps forward, 1 step back, [paper]
2019, Four Things Everyone Should Know to Improve Batch Normalization, [paper]
2019, Large Batch Optimization for Deep Learning: Training BERT in 76 minutes [paper]
2019, Predicting the Generalization Gap in Deep Networks with Margin Distributions [paper]
2017-2019, Decoupled Weight Decay Regularization [paper]
2018, Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks [paper] [tensorflow-implementation]
2017, Self-Normalizing Neural Networks, [paper]
2016, All you need is a good init [paper] [unofficial keras-code] [pytorch-implementation]
2009, Measuring classifier performance: a coherent alternative to the area under the ROC curve, [paper]
2019 (2012), High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso [paper] [code]
2019, TriMap: Large-scale Dimensionality Reduction Using Triplets, [paper] [code]
2019, NGBoost: Natural Gradient Boosting for Probabilistic Prediction [paper]
2019, KTBoost: Combined Kernel and Tree Boosting [paper] [code]
2016, Deep Neural Networks for YouTube Recommendations, [paper]
2020, ConBO: Conditional Bayesian Optimization [paper]
2019, Learning Hierarchical Priors in VAEs, [paper]
2019, BoTorch: Programmable Bayesian Optimization in PyTorch, [paper] [code]
2019, GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration, [paper] [code]
2018, Dealing with Categorical and Integer-valued Variables in Bayesian Optimization with Gaussian Processes, [paper]
2018, A Tutorial on Bayesian Optimization, [paper]
2018, Subset-Conditioned Generation Using Variational Autoencoder With A Learnable Tensor-Train Induced Prior, [paper]
2020, FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence [paper]
2019, MixMatch: A Holistic Approach to Semi-Supervised Learning, [paper]
2019, High-Fidelity Image Generation With Fewer Labels, [paper] [code]
2021, Large Scale Image Completion via Co-Modulated Generative Adversarial Networks, [paper] [code]
2019, Free-Form Image Inpainting with Gated Convolution, [paper]
2018, Image Inpainting for Irregular Holes Using Partial Convolutions, [paper] [code]
2021, DALL·E: Creating Images from Text, [article]
2020, Analyzing and Improving the Image Quality of StyleGAN, [paper]
2019, TraVeLGAN: Image-to-image Translation by Transformation Vector Learning [paper]
2018, Learning Linear Transformations for Fast Arbitrary Style Transfer [paper] [official pytorch-code]
2017, Universal Style Transfer via Feature Transforms [paper]
2017, Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization [paper] [official pytorch-code]
2021, An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale, [paper]
2020, EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks, [paper]
2020, Label-free Quantification of Pharmacokinetics in Skin with Stimulated Raman Scattering Microscopy and Deep Learning [paper] Amin Feizpour, Troels Marstrand, Louise Bastholm, Stefan Eirefelt, Conor L.Evans
2020, Dense Steerable Filter CNNs for Exploiting Rotational Symmetry in Histology Images, [paper] [code]
2019, Improving Uncertainty Estimation in Convolutional Neural Networks Using Inter-rater Agreement, [paper]
2019, Learning Data Augmentation Strategies for Object Detection [paper] [code]
2019, AutoAugment: Learning Augmentation Policies from Data [paper] [code] [bayesian-version in keras]
2019, Fast AutoAugment [paper] [official pytorch-code]
2018, Bag of Tricks for Image Classification with Convolutional Neural Networks [paper]
2019, Legendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks, [paper]
2020, Contextual Embeddings: When Are They Worth It? [paper]
2020, Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer, [paper]
2019, Unsupervised word embeddings capture latent knowledge from materials science literature, [paper]
2019, BioBERT: a pre-trained biomedical language representation model for biomedical text mining,
2019, Patent Analytics Based on Feature Vector Space Model: A Case of IoT, [paper]
2019, RoBERTa: A Robustly Optimized BERT Pretraining Approach [paper] [code]
2019, XLNet: Generalized Autoregressive Pretraining for Language Understanding [paper] [code] [keras-implementation]
2018, Universal Language Model Fine-tuning for Text Classification [paper] [implementations]
2017, Attention is all you need [paper] [code] [tutorial]
2016, Enriching Word Vectors with Subword Information [paper]
2020, Geodesics in fibered latent spaces: A geometric approach to learning correspondences between conditions, [paper]
2020, High Accuracy Protein Structure Prediction Using Deep Learning [paper] [announcement] John Jumper et al., Fourteenth Critical Assessment of Techniques for Protein Structure Prediction
2019, Improved protein structure prediction using potentials from deep learning, [paper]
2019, Probabilistic variable-length segmentation of protein sequences for discriminative motif discovery (DiMotif) and sequence embedding (ProtVecX) [paper]
2019, Universal Deep Sequence Models for Protein Classification [paper]
2019, Unified rational protein engineering with sequence-only deep representation learning, [paper]
2018, SeriesNet:A Generative Time Series Forecasting Model, [paper]
2017, Conditional Time Series Forecasting with Convolutional Neural Networks [paper]
2020, TrimNet: learning molecular representation from triplet messages for biomedicine [paper]
2020, Molecular Design in Synthetically Accessible Chemical Space via Deep Reinforcement Learning [paper]
2020, Principal Neighbourhood Aggregation for Graph Nets, [paper] [code]
2020, Towards Interpretable Sparse Graph Representation Learning with Laplacian Pooling, [paper] [code]
2020, Molecular representation learning with language models and domain-relevant auxiliary tasks
2020, Domain Extrapolation via Regret Minimization [paper]
2019, Exploring Chemical Compound Space with Quantum-Based Machine Learning, [paper]
2019, Modeling Physico-Chemical ADMET Endpoints with Multitask Graph Convolutional Networks, [paper]
2019, Adaptive Deep Kernel Learning, [paper]
2019, Efficient multi-objective molecular optimization in a continuous latent space, [paper] [code]
2019, Multi-Objective De Novo Drug Design with Conditional Graph Generative Model, [paper]
2019, PharML.Bind: Pharmacologic Machine Learning for Protein-Ligand Interactions, [paper] [code]
2019, Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative Models, [paper]
2019, A Deep Learning Approach to Antibiotic Discovery [paper]
2019, Composing Molecules with Multiple Property Constraints, [paper]
2019, GraphLIME: Local Interpretable Model Explanations for Graph Neural Networks, [paper]
2019, Evaluating Scalable Uncertainty Estimation Methods for DNN-Based Molecular Property Prediction [paper]
2019, Rethinking drug design in the artificial intelligence era [paper]
2019, Machine Learning for Scent: Learning Generalizable Perceptual Representations of Small Molecules [paper]
2019, Deep learning enables rapid identification of potent DDR1 kinase inhibitors [paper]
2019, Deep learning for molecular design - a review of the state of the art [paper]
2018, Junction Tree Variational Autoencoder for Molecular Graph Generation [paper]
2017, Neural Message Passing for Quantum Chemistry, [paper] [code]
TabNet, TabNet: Attentive Interpretable Tabular Learning, [paper]
2020, Clinically applicable deep learning for diagnosis and referral in retinal disease, [paper]
2019, GNNExplainer: Generating Explanations for Graph Neural Networks [paper] [code]
2019, Functional Transparency for Structured Data: a Game-Theoretic Approach, [paper]
2019, Using attribution to decode binding mechanism in neural network models for chemistry, [paper]
2019, Interpretable Deep Learning in Drug Discovery, [paper] [code]
2019, Can You Trust This Prediction? Auditing Pointwise Reliability After Learning [paper]
2018, BayesGrad: Explaining Predictions of Graph Convolutional Networks, [paper] [code]
2017, A Unified Approach to Interpreting Model Predictions [paper]
2019, Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks [paper]
2020, Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy [paper]
2021, Accelerating high-throughput virtual screening through molecular pool-based active learning [paper]
2021, Automated discovery of noncovalent inhibitors of SARS-CoV-2 main protease by consensus Deep Docking of 40 billion small molecules [[paper](https://pubs.rsc.org/en/content/articlelanding/2021/sc/d1sc05579h
2020, Deep Docking: A Deep Learning Platform for Augmentation of Structure Based Drug Discovery [paper]
2020, An open-source drug discovery platform enables ultra-large virtual screens [paper]
2020, The upside of being a digital pharma player, [paper]
2020, The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence, [paper]
2019, 150 successful Machine Learning models: 6 lessons learned at Booking.com, [paper]
2018, The state-of-the-art on Intellectual Property Analytics (IPA): A literature review on artificial intelligence, machine learning and deep learning methods for analysing intellectual property (IP) data [paper]
2020, Algorithms for Causal Reasoning in Probability Trees, [paper] [colab]
2018, Causal Discovery with Attention-Based Convolutional Neural Networks, [paper]
2019, A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis [paper]
2019, Machine Learning with Statistical Imputation for Predicting Drug Approvals [paper]
2019, Artificial Intelligence for Clinical Trial Design, [paper]
2019, Estimating Site Performance (ESP): can trial managers predict recruitment success at trial sites? An exploratory study, [paper]
2018, Quantifying and visualizing site performance in clinical trials, [paper]
2017, Predicting enrollment performance of investigational centers in phase III multi-center clinical trials,
2011, Performance-Based Site Selection Reduces Costs and Shortens Enrollment Time [paper]
2020, Deep Reinforcement Learning for Automated Stock Trading: An Ensemble Strategy, [paper] [code] [medium]
2020, CURL: Contrastive Unsupervised Representations for Reinforcement Learning, [paper] [code]
2017, Rainbow: Combining Improvements in Deep Reinforcement Learning, [paper]
1998, Reinforcement Learning for Trading, [paper] John Moody and Matthew Saffell, Advances in Neural Information Processing Systems 11 (NIPS 1998)
2020, The Policy Relevance of Personality Traits, [paper] Wiebke BleidornPatrick HillMitja BackJaap DenissenMarie HenneckeChris HopwoodMarkus JokelaChristian KandlerRichard E. LucasMaike LuhmannUlrich OrthJenny WagnerCornelia WrzusJohannes ZimmermannBrent Roberts, Inpress: American Psychologist
132 commits