ML Life Resources

Summary of what articles/videos/courses I study

Started recording these activities after I was comfortable with machine learning

Machine learning in production

Click here to expand

• Blog: Machine Learning in Production: Why You Should Care About Data and Concept Drift
• Article: Monitoring Machine Learning Models in Production
• Paper: Towards ML Engineering: A Brief History Of TensorFlow Extended (TFX)
• Paper: Challenges in Deploying Machine Learning: a Survey of Case Studies
• Paper: Hidden Technical Debt in Machine Learning Systems

Machine learning

Click here to expand

• Article: Clustering overview

Mathematics

• Article: Covariance: definition, formula and practical examples

Feature engineering

• Article: Think twice before dropping that first one-hot encoded column
• Video: Median absolute deviation

Visualization

• Blog: Dive deep into principal component analysis
• Article: The Ultimate Guide to 12 Dimensionality Reduction Techniques

Algorithms

• Paper: Using KNN to predict student performance in an online course environment
• Blog: Voting classifier
• Blog: Random forest and decision tree from scratch
• Blog: Adaboost classifier from scratch
• Article: KD Tree
• Article: Locally weighted linear regression
• Blog: Everything you need to know about decision trees
• Blog: Introduction to regression splines in python

Evaluation

• Blog: AUC ROC: In-depth
• Blog: F1, Accuracy, ROC-AUC and PR-AUC: Which to choose
• Blog: R-squared explained
• Article: Difference between R-squared and adjusted R-squared

Deep Learning

Click here to expand

Model selection

• Paper: Small Data, Big Decisions: Model Selection in the Small-Data Regime

Optimization

• Blog: An overview of gradient descent optimization algorithms
• Article: Weight decay: Regularization technique

Autoencoders

• Blog: Introduction to autoencoders

Meta DL

• Paper: Meta-Dataset: A dataset for datasets for learning to learn from few examples

Natural Language Processing

Click here to expand

Tokenization

• Blog: Tokenizers: How machines read

Embedding

• Blog: Illustrated word2vec

Conversational AI

• Playlist: Rasa Masterclass
• Paper: Pchatbot: A Large-Scale Dataset for Personalized Chatbot

Computer Vision

Click here to expand

• Blog: Intuitive understanding of convolution for deep learning
• Blog: What is transposed convolution
• Blog: Understanding 2D dilated convolutions
• Blog: Understanding grouped channels in filters in convolution layer

Object detection

• Article: Object Detection and Tracking in 2020

Object Segmentation

• Paper: ASPP (atrous spatial pyrmaid pooling)

Video prediction

• Paper: ST-ResNet

Reinforcement learning

Click here to expand

• Paper: Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems

Hyperparameter Optimization

Click here to expand

• Video: End-to-End: Automated Hyperparameter Tuning For Deep Neural Networks
• Video: Hyperparameter Optimization: This Tutorial Is All You Need
• Article: Tuning ML Hyperparameters - LASSO and Ridge Examples
• Blog: Complete guide to parameter tuning for GBM in python
• Blog: Adaboost ensemble in pytohn
• Blog: Complete guide to parameter tuning xgboost

Time series

Click here to expand

• Blog: Anomaly detection using median absolute deviation

Questions/Tests

• Website: Machine Learning Engineering Guide
• Blog: 30 questions KNN for data scientist
• Blog: 40 interview questions asked at startup in ML

Courses

• Course: NLP Course | For you
• Course: Stanford CS229: Machine Learning