The Neural Aesthetic @ ITP-NYU, Fall 2018

Syllabus        Lectures

10 Sep 2018
The whole class "in 60 minutes"
Description
  • Course goals, logistics, and resources
  • Introduction to AI, machine learning, and deep learning
  • The whole class "in 60 minutes"
Supplementary / links
11 Sep 2018
Neural networks
Description
  • How convolutional neural networks work (forward pass)
  • Transfer learning
  • Demos and applications of transfer learning
18 Sep 2018
How neural nets are trained
Description
  • How neural nets are trained (backward pass)
  • Overfitting, regularization, optimization
  • ml4a-ofx demos: ConvnetPredictor, AudioClassifier, DoodleClassifier
Supplementary / links
25 Sep 2018
Applications of neural nets
Description
  • Feature extraction
  • Reverse image search and X degrees
  • t-SNE of images/sounds & visualization
  • Transfer learning
16 Oct 2018
Visualization, deepdream, style & texture synthesis
Description
  • Visualizing convnet features
  • Pixel-optimization, Deepdream, neural-synth
  • Style transfer and textur synthesis
Practical
17 Oct 2018
Terminal velocity
Description
  • Basic terminal navigation
  • Python shell and bash scripting
  • Connecting to remote VM
23 Oct 2018
Generative models
Description
  • Autoencoders & Generative adversarial networks
  • Compiling, scraping, and processing datasets
  • Training DCGANs
Supplementary / links
  • Garbage in, treasure out: a field guide to compiling datasets on a messy internet [planned]
  • From PCA to Puppyslugs
30 Oct 2018
Conditional generative models
Description
  • Image-to-image translation (pix2pix/CycleGAN)
  • Scraping and preparing parallel datasets
  • YOLO & dense captioning
Supplementary / links
06 Nov 2018
Recurrent neural networks
Description
  • Recurrent networks & LSTMs
  • Sequence-to-sequence applications
  • im2txt, Sketch-RNN, char-rnn tutorials
13 Nov 2018
Music information retrieval, BIGGAN & GLOW
Description
  • GLOW and reversible generative models
  • BigGAN tutorial
  • Music information retrieval
27 Nov 2018
Reinforcement Learning & Natural Language Processing
Description
  • Agent-environment systems & games
  • AlphaGo, AlphaZero, DOTA
  • Natural language processing
Supplementary / links
04 Dec 2018
Autonomous artificial artist
Description
  • Building blocks: cryptography, peer-to-peer networks, blockchains
  • Decentralized autonomous organizations & AI DAOs
  • Decentralizing machine learning
Practical
Supplementary / links
11 Dec 2018
Final presentations
Description
Practical
Supplementary / links
The whole class "in 60 minutes"
10 Sep 2018 [slides]
  • Course goals, logistics, and resources
  • Introduction to AI, machine learning, and deep learning
  • The whole class "in 60 minutes"
Neural networks
11 Sep 2018 [slides]
  • How convolutional neural networks work (forward pass)
  • Transfer learning
  • Demos and applications of transfer learning
How neural nets are trained
18 Sep 2018 [slides]
  • How neural nets are trained (backward pass)
  • Overfitting, regularization, optimization
  • ml4a-ofx demos: ConvnetPredictor, AudioClassifier, DoodleClassifier
Applications of neural nets
25 Sep 2018 [slides]
  • Feature extraction
  • Reverse image search and X degrees
  • t-SNE of images/sounds & visualization
  • Transfer learning
Visualization, deepdream, style & texture synthesis
16 Oct 2018 [slides]
  • Visualizing convnet features
  • Pixel-optimization, Deepdream, neural-synth
  • Style transfer and textur synthesis
Terminal velocity
17 Oct 2018
  • Basic terminal navigation
  • Python shell and bash scripting
  • Connecting to remote VM
Generative models
23 Oct 2018 [slides]
  • Autoencoders & Generative adversarial networks
  • Compiling, scraping, and processing datasets
  • Training DCGANs
Conditional generative models
30 Oct 2018 [slides]
  • Image-to-image translation (pix2pix/CycleGAN)
  • Scraping and preparing parallel datasets
  • YOLO & dense captioning
Recurrent neural networks
6 Nov 2018 [slides]
  • Recurrent networks & LSTMs
  • Sequence-to-sequence applications
  • im2txt, Sketch-RNN, char-rnn tutorials
Music information retrieval, BIGGAN & GLOW
13 Nov 2018 [slides]
  • GLOW and reversible generative models
  • BigGAN tutorial
  • Music information retrieval