Contribute!
  • How to contribute a guide to ml4a
Fundamentals of machine learning
  • What is machine learning?
  • Vectors, matrices, and tensors
  • Functions, derivatives, and gradient descent
Ordinary neural networks
  • Architecture of simple neural net
  • Training a neural net on toy data
Convolutional neural networks
  • Building neural networks with convolutional and pooling layers for image processing
  • Train a convnet to classify MNIST handwritten digits
Transfer learning
  • Using powerful pre-trained networks as feature extractors
  • Training own image classifier on top of a pre-trained network
Recurrent neural networks
  • RNNs, LSTMs, and context
  • Setting up an LSTM to predict characters in text
Sequence to sequence models
  • How RNNs operate on sequences on both ends
  • Training LSTM for language translation
Reverse image search
  • Extract feature vectors from images with convnets
  • Find most similar images to query image
Find shortest path between two images
  • Construct a graph of images connected via k nearest neighbors
  • Determine shortest path through the graph between two query images
Clustering images with t-SNE
  • Extract feature vectors from images with convnets
  • Embed images in 2d space using a t-SNE over their feature vectors
Clustering sounds with t-SNE
  • Extract feature vectors from audio clips with librosa
  • Embed audio clips in 2d with a t-SNE over their feature vectors
Reverse text search
  • Text representation: bag-of-words, tf-idf
  • Latent semantic analysis
  • Search for similar documents
Neural net painter
  • Regression of x,y -> r,g,b from an image
  • Generating "paintings" from learned model
  • Making videos by interpolating between multiple painters
Word vectors
  • Embedding words in vector space
  • Geometric operations in word-vector space and analogies
  • Generate a t-SNE from a trained word2vec embedding
Eigenfaces
  • Run principal component analysis to compress a dataset of faces
  • Generate new faces by inverting the projection
Q-Learning
  • Introduction to the reinforcement learning problem
  • Implementing a Q-Learner for an agent
Deep Q-Networks
  • Deep Q-Networks for larger state spaces
  • Implementing and training DQN for paddle-ball game
Audio classifier
  • Analyze MFCC distribution of incoming microphone audio
  • Train a real-time multi-class classifier of sounds
Audio t-SNE viewer
  • Navigate an interactive playback application of audio samples embedded in 2d via t-SNE algorithm (pre-analyzed)
ConvnetOSC
  • Extract feature vector from real-time webcam stream
  • Send image feature vector over OSC
Convnet classifier
  • Extract feature vectors from incoming webcam stream
  • Train a real-time multi-class classifier of images
Convnet regressor
  • Extract feature vectors from incoming webcam stream
  • Control a set of sliders via regression over feature vectors
Convnet viewer
  • Analyze an image or webcam stream with a convnet
  • View the network's activation maps layer-by-layer
Doodle classifier
  • Train an image classifier to recognize different categories of your drawings (doodles)
  • Send classification results over OSC to drive some interactive application
Face classifier
  • Use face tracker to analyze facial expressions or poses
  • Train a real-time multi-class classifier of facial expressions
Face regressor
  • Use face tracker to analyze facial expressions or poses
  • Train real-time regression to control sliders according to facial expression
Gobot
  • Scrape screen pixels and detect Go board position
  • Have a convnet make move recommendations for human player
Image t-SNE viewer
  • Navigate an interactive viewer of images embedded in 2d via t-SNE algorithm (pre-analyzed)
Image t-SNE live
  • t-SNE and assign to grid a dataset of images (in-application)
  • Navigate an interactive viewer containing the arranged images
pix2pix tutorial
  • A tutorial on neural image translation with pix2pix
  • A survey of creative works using pix2pix
Reverse image search (fast)
  • Extract feature vector in real-time from an image/video/webcam/screengrabber
  • Quickly retrieve k nearest neighbors to that image
Reverse object search
  • Detect salient objects in image/video/webcam stream
  • Quickly retrieve k nearest neighbors of each detected object
Yolo (fast object detection) live
  • Detect salient objects in image/video/webcam/screengrabber