The Neural Aesthetic @ ITP-NYU, Fall 2018

Syllabus        Lectures

10 Sep 2018
The whole class "in 60 minutes"
Description
  • Course goals, logistics, and resources
  • Introduction to AI, machine learning, and deep learning
  • The whole class "in 60 minutes"
Supplementary / links
11 Sep 2018
Neural networks
Description
  • How convolutional neural networks work (forward pass)
  • Transfer learning
  • Demos and applications of transfer learning
Supplementary / links
18 Sep 2018
How neural nets are trained
Description
  • How neural nets are trained (backward pass)
  • Overfitting, regularization, optimization
  • ml4a-ofx demos: ConvnetPredictor, AudioClassifier, DoodleClassifier
Practical
Supplementary / links
25 Sep 2018
Applications of neural nets
Description
  • Feature extraction
  • Reverse image search and shortest paths
  • t-SNE & visualization
  • Transfer learning
16 Oct 2018
Interactive machine learning
Description
  • Training neural nets on sensors and cameras
  • Object detection, dense captioning
Practical
Supplementary / links
23 Oct 2018
Audio & text learning
Description
  • Audio feature extraction & classification
  • Document analysis and retrieval
  • Word vectors
Supplementary / links
30 Oct 2018
Optimization-based pixel art
Description
  • Visualization of neural networks
  • Deepdream
  • Texture synthesis & style transfer
06 Nov 2018
Generative models I
Description
  • Autoencoders
  • Generative adversarial networks
Practical
Supplementary / links
  • Garbage in, treasure out: a field guide to compiling datasets on a messy internet [planned]
  • From PCA to Puppyslugs
13 Nov 2018
Generative models II
Description
  • Image-to-image translation
  • Super-resolution, denoising
  • WaveNets + SampleRNN
  • Progressive GANs
Supplementary / links
27 Nov 2018
Reinforcement Learning
Description
  • Agent-environment systems
  • Games simulation
  • AlphaGo, AlphaZero, DOTA
Supplementary / links
04 Dec 2018
Decentralized AI
Description
  • Building blocks: cryptography, peer-to-peer networks, blockchains
  • Decentralized autonomous organizations & AI DAOs
  • Decentralizing machine learning
Practical
Supplementary / links
11 Dec 2018
TBD
Description
Practical
Supplementary / links
The whole class "in 60 minutes"
10 Sep 2018 [slides]
  • Course goals, logistics, and resources
  • Introduction to AI, machine learning, and deep learning
  • The whole class "in 60 minutes"
Neural networks
11 Sep 2018 [slides]
  • How convolutional neural networks work (forward pass)
  • Transfer learning
  • Demos and applications of transfer learning
How neural nets are trained
18 Sep 2018 [slides]
  • How neural nets are trained (backward pass)
  • Overfitting, regularization, optimization
  • ml4a-ofx demos: ConvnetPredictor, AudioClassifier, DoodleClassifier