dl.md

Deep Learning

Deep learning

• Accelerating Stochastic Gradient Descent. arxiv ⭐
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour. url
• Activation Ensembles for Deep Neural Networks. arxiv
• A Generalization of Convolutional Neural Networks to Graph-Structured Data. arxiv keras
• A GPU-Based Solution to Fast Calculation of Betweenness Centrality on Large Weighted Networks. arxiv
• A Deep Convolutional Auto-Encoder with Pooling - Unpooling Layers in Caffe. arxiv
• Alignment of dynamic networks. arxiv
• A Matrix Factorization Approach for Learning Semidefinite-Representable Regularizers. arxiv
• AMPNet: Asynchronous Model-Parallel Training for Dynamic Neural Networks. arxiv
• A Probabilistic Framework for Location Inference from Social Media. arxiv
• A Saddle Point Approach to Structured Low-rank Matrix Learning in Large-scale Applications. arxiv
• A simple neural network module for relational reasoning. arxiv ⭐
• Automated Curriculum Learning for Neural Networks. arxiv ⭐
• Autoencoder Regularized Network For Driving Style Representation Learning. arxiv
• Backprop without Learning Rates Through Coin Betting. arxiv code
• Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models. arxiv ⭐
• Billion-scale similarity search with GPUs. arxiv code ⭐
• Complex Networks: from Classical to Quantum. arxiv
• Concrete Dropout. arxiv
• Conversation Modeling on Reddit using a Graph-Structured LSTM. arxiv ⭐
• Convolutional Sequence to Sequence Learning. pdf torch ⭐
• Coordinating Filters for Faster Deep Neural Networks. arxiv caffle
• Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks. arxiv
• DAGER: Deep Age, Gender and Emotion Recognition Using Convolutional Neural Network. arxiv
• Dance Dance Convolution. arxiv
• Deep Alignment Network: A convolutional neural network for robust face alignment. arxiv code
• Deep and Hierarchical Implicit Models. arxiv
• DeepArchitect: Automatically Designing and Training Deep Architectures. arxiv code
• DeepFM: A Factorization-Machine based Neural Network for CTR Prediction. arxiv
• [GcForest] Towards An Alternative to Deep Neural Networks. arxiv code ⭐
• Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection. arxiv code ⭐
• Deep Learning: A Bayesian Perspective. arxiv
• Deep Learning for Time-Series Analysis. arxiv
• Deep Learning With Dynamic Computation Graphs. pdf
• DeepNAT: Deep Convolutional Neural Network for Segmenting Neuroanatomy. arxiv caffe
• Deep Network Guided Proof Search. arxiv
• DeepXplore: Automated Whitebox Testing of Deep Learning Systems. arxiv
• Deformable Convolutional Networks. arxiv ⭐
• [Edward] Deep Probabilistic Programming. arxiv Web ⭐
• Deep Sketch Hashing: Fast Free-hand Sketch-Based Image Retrieval. code
• Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction. pdf code] ⭐
• [DeepStack] Expert-Level Artificial Intelligence in No-Limit Poker. arxiv ⭐
• Dense Transformer Networks. arxiv
• Diabetic Retinopathy Detection via Deep Convolutional Networks for Discriminative Localization and Visual Explanation. arxiv code
• Diagonal RNNs in Symbolic Music Modeling. arxiv tensorflow
• Dilated Residual Networks. arxiv ⭐
• Distributed Online Learning of Event Definitions. arxiv
• [DyNet] The Dynamic Neural Network Toolkit. arxiv code ⭐
• Efficient Information Flow Maximization in Probabilistic Graphs. arxiv
• Encouraging LSTMs to Anticipate Actions Very Early. arxiv
• Ensemble Sales Forecasting Study in Semiconductor Industry. arxiv code
• Evolving Deep Neural Networks. arxiv ⭐
• Fast-Slow Recurrent Neural Networks. arxiv tensorflow
• Forward Thinking: Building Deep Random Forests. arxiv tensorflow
• Fully Convolutional Architectures for Multi-Class Segmentation in Chest Radiographs. arxiv
• Gated Orthogonal Recurrent Units: On Learning to Forget. arxiv
• Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks. arxiv
• Good Semi-supervised Learning that Requires a Bad GAN. arxiv
• Graffinity: Visualizing Connectivity In Large Graphs. arxiv code
• Graph Structure Learning from Unlabeled Data for Event Detection. arxiv
• Hidden Community Detection in Social Networks. arxiv
• Holistic Interstitial Lung Disease Detection using Deep Convolutional Neural Networks: Multi-label Learning and Unordered Pooling. arxiv
• Interpretable Explanations of Black Boxes by Meaningful Perturbation. arxiv
• Learning Chained Deep Features and Classifiers for Cascade in Object Detection. arxiv
• Learning Deep Nearest Neighbor Representations Using Differentiable Boundary Trees. arxiv ⭐
• Learning Gradient Descent: Better Generalization and Longer Horizons. arxiv code
• Learning to Acquire Information. arxiv
• Learning to Invert: Signal Recovery via Deep Convolutional Networks. arxiv
• Learning to Remember Rare Events. pdf tensorflow] ⭐
• LipNet: Sentence-level Lipreading. pdf torch
• Lucid Data Dreaming for Object Tracking. arxiv
• Machine Learning on Sequential Data Using a Recurrent Weighted Average. arxiv tensorflow
• Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy. arxiv code
• Mask R-CNN. arxiv ⭐
• Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games. arxiv
• Multi-Scale Dense Convolutional Networks for Efficient Prediction. arxiv code
• Multiscale Hierarchical Convolutional Networks. arxiv tensorflow
• Natasha: Faster Stochastic Non-Convex Optimization via Strongly Non-Convex Parameter. arxiv
• Network Backboning with Noisy Data. arxiv
• Neural Decision Trees. arxiv
• Neural Message Passing for Quantum Chemistry. arxiv code ⭐
• Neural Ranking Models with Weak Supervision. arxiv
• On weight initialization in deep neural networks. arxiv code
• Opening the Black Box of Deep Neural Networks via Information. arxiv ⭐
• Optimization as a Model for Few-Shot Learning. pdf torch ⭐
• OptNet: Differentiable Optimization as a Layer in Neural Networks. arxiv code ⭐
• Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. arxiv
• [PathNet] Evolution Channels Gradient Descent in Super Neural Networks. arxiv tensorflow⭐
• pix2code: Generating Code from a Graphical User Interface Screenshot. arxiv code
• PixelNet: Representation of the pixels, by the pixels, and for the pixels. arxiv code
• Privileged Multi-label Learning. arxiv
• QCD-Aware Recursive Neural Networks for Jet Physics. arxiv code
• QuickNet: Maximizing Efficiency and Efficacy in Deep Architectures. arxiv
• Recurrent Additive Networks. arxiv pytorch ⭐
• Reducing Reparameterization Gradient Variance. arxiv code
• Scaling the Scattering Transform: Deep Hybrid Networks. arxiv torch
• See, Hear, and Read: Deep Aligned Representations. arxiv
• Self-Normalizing Neural Networks. arxiv code ⭐
• Semi-Supervised Deep Learning for Monocular Depth Map Prediction. arxiv
• Semi-Supervised Endmember Identification In Nonlinear Spectral Mixtures Via Semantic Representation. arxiv
• Shake-Shake regularization. arxiv code
• ShaResNet: reducing residual network parameter number by sharing weights. arxiv code
• ShortFuse: Biomedical Time Series Representations in the Presence of Structured Information. arxiv
• Simplified Gating in Long Short-term Memory (LSTM) Recurrent Neural Networks. arxiv code ⭐
• Sparse canonical correlation analysis. arxiv
• Statistical inference for network samples using subgraph counts. arxiv
• Steerable CNNs. pdf
• Stochastic L-BFGS Revisited: Improved Convergence Rates and Practical Acceleration Strategies. arxiv
• Stochastic Subsampling for Factorizing Huge Matrices. arxiv code
• Submanifold Sparse Convolutional Networks. arxiv
• The Future of Ad Blocking: An Analytical Framework and New Techniques. arxiv code
• The Power of Sparsity in Convolutional Neural Networks. arxiv
• Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation. arxiv ⭐
• To Boost or Not to Boost? On the Limits of Boosted Trees for Object Detection. arxiv
• Towards "AlphaChem": Chemical Synthesis Planning with Tree Search and Deep Neural Network Policies. arxiv
• Towards a New Interpretation of Separable Convolutions. arxiv
• Towards Deeper Understanding of Variational Autoencoding Models. arxiv code
• Training Quantized Nets: A Deeper Understanding. arxiv
• Train longer, generalize better: closing the generalization gap in large batch training of neural networks. arxiv pytorch
• Trust Region Policy Optimization. arxiv pytorch
• Two-Bit Networks for Deep Learning on Resource-Constrained Embedded Devices. arxiv
• Understanding deep learning requires rethinking generalization. arxiv ⭐
• Understanding the Effective Receptive Field in Deep Convolutional Neural Networks. arxiv
• Understanding trained CNNs by indexing neuron selectivity. arxiv
• Variational Inference using Implicit Distributions. arxiv
• Who Said What: Modeling Individual Labelers Improves Classification. arxiv ⭐

Computer vision

• Abnormal Event Detection in Videos using Spatiotemporal Autoencoder. arxiv
• Accurate Single Stage Detector Using Recurrent Rolling Convolution. arxiv code
• [AENet] Learning Deep Audio Features for Video Analysis. arxiv code ⭐
• A network of deep neural networks for distant speech recognition. arXiv ⭐
• A New Convolutional Network-in-Network Structure and Its Applications in Skin Detection, Semantic Segmentation, and Artifact Reduction. arxiv
• CortexNet: a Generic Network Family for Robust Visual Temporal Representations. arXiv code
• CSVideoNet: A Real-time End-to-end Learning Framework for High-frame-rate Video Compressive Sensing. arXiv caffe
• Cost-Effective Active Learning for Deep Image Classification. arxiv
• Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks. arxiv caffe
• DCT-like Transform for Image Compression Requires 14 Additions Only. arxiv
• Deep Convolutional Neural Networks for Pairwise Causality. arxiv
• DeepFix: Fixing Common C Language Errors by Deep Learning. pdf code
• Deep Learning Features at Scale for Visual Place Recognition. arxiv
• Deep Learning for Tumor Classification in Imaging Mass Spectrometry. arxiv
• Deep Hybrid Similarity Learning for Person Re-identification. arxiv
• DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing. arxiv
• Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Car. arxiv ⭐
• Face Detection using Deep Learning: An Improved Faster RCNN Approach. arxiv
• Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation. arxiv
• Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis. arxiv code
• Joint auto-encoders: a flexible multi-task learning framework. arxiv
• Large-Scale Evolution of Image Classifiers. arxiv pytorch
• Learning a Mixture of Deep Networks for Single Image Super-Resolution. arxiv code]
• Learning a time-dependent master saliency map from eye-tracking data in videos. arxiv code
• Learning Deep Representations for Scene Labeling with Semantic Context Guided Supervision. arxiv
• Learning to Estimate 3D Hand Pose from Single RGB Images. arxiv tensorflow
• Learning to Estimate Pose by Watching Videos. arxiv
• Learning to Generate Posters of Scientific Papers by Probabilistic Graphical Models. arxiv
• Learning to Learn from Noisy Web Videos. arxiv ⭐
• Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image. arxiv
• Linear Disentangled Representation Learning for Facial Actions. arxiv code
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arxiv pytorch
• Modeling Relational Data with Graph Convolutional Networks. arxiv ⭐
• [MobileNets] Efficient Convolutional Neural Networks for Mobile Vision Applications. arxiv keras ⭐
• MonoCap: Monocular Human Motion Capture using a CNN Coupled with a Geometric Prior. arxiv
• Negative Results in Computer Vision: A Perspective. arxiv
• Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs. arxiv code
• Optimizing Deep CNN-Based Queries over Video Streams at Scale. arxiv tensorflow
• Perceptually Optimized Image Rendering. arxiv
• Pixel Recursive Super Resolution. arxiv ⭐
• Putting a Face to the Voice: Fusing Audio and Visual Signals Across a Video to Determine Speakers. arxiv
• SfM-Net: Learning of Structure and Motion from Video. arxiv ⭐
• SLAM with Objects using a Nonparametric Pose Graph. arxiv code
• Soft + Hardwired Attention: An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection. arxiv
• SSPP-DAN: Deep Domain Adaptation Network for Face Recognition with Single Sample Per Person.arxiv
• StreetStyle: Exploring world-wide clothing styles from millions of photos. arxiv
• Supervised Multilayer Sparse Coding Networks for Image Classification. arxiv
• [Tacotron] Towards End-to-End Speech Synthesis. arxiv code ⭐
• Towards a Principled Integration of Multi-Camera Re-Identification and Tracking through Optimal Bayes Filters. arxiv
• Training object class detectors with click supervision. arxiv
• Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the US. arxiv ⭐
• Unsupervised Learning by Predicting Noise. arxiv ⭐
• Unsupervised Learning of Long-Term Motion Dynamics for Videos. arxiv
• Video-based Person Re-identification with Accumulative Motion Context. arxiv
• ViP-CNN: A Visual Phrase Reasoning Convolutional Neural Network for Visual Relationship Detection. arxiv
• Visualizing LSTM decisions. arxiv
• Visual Discovery at Pinterest. arxiv
• Visualizing Residual Networks. arxiv ⭐
• Wide-Residual-Inception Networks for Real-time Object Detection. arxiv ⭐
• YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video. arxiv code
• Zoom Out-and-In Network with Recursive Training for Object Proposal. arxiv

Attention and memory

• Attention-based Extraction of Structured Information from Street View Imagery. arxiv ⭐
• Attention-Based Multimodal Fusion for Video Description. arxiv
• Attention Is All You Need. arxiv ⭐
• Deep Memory Networks for Attitude Identification. arxiv
• Dynamic Computational Time for Visual Attention(DT-RAM). arxiv torch ⭐
• End-to-End Attention based Text-Dependent Speaker Verification. arxiv
• [HRAN] Hierarchical Recurrent Attention Network for Response Generation. arxiv code ⭐
• Residual Attention Network for Image Classification. arxiv
• Sequential Attention. arxiv
• Structural Attention Neural Networks for improved sentiment analysis. arxiv
• Structured Attention Networks. arxiv github

Generative learning

• [AdaGAN] Boosting Generative Models. arxiv ⭐
• Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods. arxiv code
• Adversarial Generator-Encoder Networks. pdf code
• Adversarial Variational Bayes: Unifying Variational Autoencoders and Generative Adversarial Networks. arxiv tensorflow
• Age Progression/Regression by Conditional Adversarial Autoencoder. arxiv tensorflow
• An Online Learning Approach to Generative Adversarial Networks. arxiv
• ArtGAN: Artwork Synthesis with Conditional Categorial GANs.arxiv
• Adversarial Attacks on Neural Network Policies. pdf ⭐
• Adversarial Discriminative Domain Adaptation. arxiv
• Adversarial Networks for the Detection of Aggressive Prostate Cancer. arxiv
• Aspect-augmented Adversarial Networks for Domain Adaptation. arxiv
• Automatic Generation of Typographic Font from a Small Font Subset. arxiv ⭐
• Bayesian GAN. arxiv ⭐
• [BEGAN] Boundary Equilibrium Generative Adversarial Networks. arxiv pytorch tensorflow ⭐
• Boosted Generative Models. arxiv
• Counterfactual Control for Free from Generative Models. arxiv code
• Deep adversarial neural decoding. arxiv ⭐
• Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning. arxiv
• DeLiGAN : Generative Adversarial Networks for Diverse and Limited Data. arxiv code
• Dense Associative Memory is Robust to Adversarial Inputs. arxiv
• Denoising Adversarial Autoencoders. arxiv code ⭐
• Expecting the Unexpected: Training Detectors for Unusual Pedestrians with Adversarial Imposters. arxiv tensorflow
• Face Aging With Conditional Generative Adversarial Networks. arxiv
• Face Super-Resolution Through Wasserstein GANs. arxiv tensorflow
• Face Synthesis from Facial Identity Features. arxiv
• Fisher GAN. arxiv
• Gang of GANs: Generative Adversarial Networks with Maximum Margin Ranking. arxiv
• Geometric GAN. arxiv
• GeneGAN: Learning Object Transfiguration and Attribute Subspace from Unpaired Data. arxiv code
• Generative Adversarial Active Learning. arxiv
• Generative Adversarial Networks recover features in astrophysical images of galaxies beyond the deconvolution limit.arxiv code
• Generative Adversarial Residual Pairwise Networks for One Shot Learning. arxiv
• Generative Cooperative Net for Image Generation and Data Augmentation. arxiv
• Generative Face Completion. arxiv
• Generative Temporal Models with Memory. arxiv
• Generalization and Equilibrium in Generative Adversarial Nets (GANs). arxiv
• GP-GAN: Towards Realistic High-Resolution Image Blending. arxiv code
• How to Train Your DRAGAN. arxiv code
• Image De-raining Using a Conditional Generative Adversarial Network. arxiv caffe
• Image Generation and Editing with Variational Info Generative Adversarial Networks. arxiv
• Improved Training of Wasserstein GANs. arxiv tensorflow pytorch ⭐
• Improved Semi-supervised Learning with GANs using Manifold Invariances. arxiv
• InfoVAE: Information Maximizing Variational Autoencoders. arxiv
• Learning Hierarchical Features from Generative Models. arxiv tensorflow
• Learning Texture Manifolds with the Periodic Spatial GAN. arxiv code
• Lifelong Generative Modeling. arxiv code
• Learning Disentangled Representations with Semi-Supervised Deep Generative Models. arxiv
• [DiscoGAN] Learning to Discover Cross-Domain Relations with Generative Adversarial Networks. arxiv code ⭐
• Learning to Draw Dynamic Agent Goals with Generative Adversarial Networks. arxiv
• Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities. arxiv code
• Mastering Sketching: Adversarial Augmentation for Structured Prediction. arxiv ⭐
• [MADGAN] Multi-Agent Diverse Generative Adversarial Networks. arxiv code
• Multi-space Variational Encoder-Decoders for Semi-supervised Labeled Sequence Transduction. arxiv code
• Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders. arxiv tensorflow ⭐
• On the Effects of Batch and Weight Normalization in Generative Adversarial Networks. arxiv code
• Parseval Networks: Improving Robustness to Adversarial Examples. arxiv
• Reconstruction of three-dimensional porous media using generative adversarial neural networks. arxiv code
• [SalGAN] Visual Saliency Prediction with Generative Adversarial Networks. arxiv code ⭐
• Scene Graph Generation by Iterative Message Passing. arxiv tensorflow
• SEGAN: Speech Enhancement Generative Adversarial Network. arxiv tensorflow
• Softmax GAN. arxiv
• Steganographic Generative Adversarial Networks. arxiv code
• TextureGAN: Controlling Deep Image Synthesis with Texture Patches. arxiv
• The Cramer Distance as a Solution to Biased Wasserstein Gradients. arxiv ⭐
• Towards Diverse and Natural Image Descriptions via a Conditional GAN. arxiv
• Towards Principled Methods for Training Generative Adversarial Networks. arxiv ⭐
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. arxiv torch ⭐
• Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery. arxiv
• Unsupervised Diverse Colorization via Generative Adversarial Networks. arxiv
• Unsupervised Image-to-Image Translation with Generative Adversarial Networks. arxiv
• VAE with a VampPrior. arxiv code
• [WGAN] Wasserstein GAN. arxiv pytorch tensorflow ⭐
• Wasserstein Learning of Deep Generative Point Process Models. arxiv
• WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images. arxiv code

Transfer learning

• Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks. arxiv
• An Interpretable Knowledge Transfer Model for Knowledge Base Completion. arxiv
• Arbitrary Style Transfer In Real-Time With Adaptive Instance Normalization . pdf code
• Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning. arxiv
• Bringing Impressionism to Life with Neural Style Transfer in Come Swim. arxiv
• Characterizing and Improving Stability in Neural Style Transfer. arxiv
• DSSD : Deconvolutional Single Shot Detector. arxiv
• Deep Photo Style Transfer. arxiv torch
• Demystifying Neural Style Transfer. arxiv
• Massive Exploration of Neural Machine Translation Architectures. arxiv code
• Multi-style Generative Network for Real-time Transfer. arxiv torch ⭐
• One-Shot Imitation Learning. arxiv ⭐
• PathNet: Evolution Channels Gradient Descent in Super Neural Networks.arxiv ⭐
• Question Answering through Transfer Learning from Large Fine-grained Supervision Data. arxiv
• Son of Zorn's Lemma: Targeted Style Transfer Using Instance-aware Semantic Segmentation. arxiv
• StyleBank: An Explicit Representation for Neural Image Style Transfer. arxiv
• Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN. arxiv
• Style Transfer Generative Adversarial Networks: Learning To Play Chess Differently. pdf
• The Space of Transferable Adversarial Examples. arxiv
• Transferring Face Verification Nets To Pain and Expression Regression. arxiv code
• Transfer Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network. arxiv code
• Transfer learning for music classification and regression tasks. arxiv keras
• Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networks. arxiv
• Unsupervised Image-to-Image Translation Networks. arxiv
• Visual Attribute Transfer through Deep Image Analogy. arxiv code