Skip to content

Commit a104e10

Browse files
lfanginkevinzakka
authored andcommitted
update a3 to index
1 parent f997852 commit a104e10

File tree

2 files changed

+16
-10
lines changed

2 files changed

+16
-10
lines changed

assignments/2020/assignment3.md

Lines changed: 11 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -29,21 +29,20 @@ This assignment is due on **Wednesday, May 27 2020** at 11:59pm PDT.
2929

3030
### Goals
3131

32-
In this assignment you will implement recurrent networks, and apply them to image captioning on Microsoft COCO. You will also explore methods for visualizing the features of a pretrained model on ImageNet, and also this model to implement Style Transfer. Finally, you will train a Generative Adversarial Network to generate images that look like a training dataset!
32+
In this assignment, you will implement recurrent neural networks and apply them to image captioning on the Microsoft COCO data. You will also explore methods for visualizing the features of a pretrained model on ImageNet, and use this model to implement Style Transfer. Finally, you will train a Generative Adversarial Network to generate images that look like a training dataset!
3333

3434
The goals of this assignment are as follows:
3535

36-
- Understand the architecture of recurrent neural networks (RNNs) and how they operate on sequences by sharing weights over time
36+
- Understand the architecture of recurrent neural networks (RNNs) and how they operate on sequences by sharing weights over time.
3737
- Understand and implement both Vanilla RNNs and Long-Short Term Memory (LSTM) networks.
38-
- Understand how to combine convolutional neural nets and recurrent nets to implement an image captioning system
38+
- Understand how to combine convolutional neural nets and recurrent nets to implement an image captioning system.
3939
- Explore various applications of image gradients, including saliency maps, fooling images, class visualizations.
4040
- Understand and implement techniques for image style transfer.
4141
- Understand how to train and implement a Generative Adversarial Network (GAN) to produce images that resemble samples from a dataset.
4242

43-
4443
### Setup
4544

46-
You should be able to use your setup from assignment 3.
45+
You should be able to use your setup from assignments 1 and 2.
4746

4847
You can work on the assignment in one of two ways: **remotely** on Google Colaboratory or **locally** on your own machine.
4948

@@ -82,21 +81,23 @@ Complete each notebook, then once you are done, go to the [submission instructio
8281

8382
### Q1: Image Captioning with Vanilla RNNs (29 points)
8483

85-
The Jupyter notebook `RNN_Captioning.ipynb` will walk you through the implementation of an image captioning system on MS-COCO using vanilla recurrent networks.
84+
The notebook `RNN_Captioning.ipynb` will walk you through the implementation of an image captioning system on MS-COCO using vanilla recurrent networks.
8685

8786
### Q2: Image Captioning with LSTMs (30 points)
8887

89-
The Jupyter notebook `LSTM_Captioning.ipynb` will walk you through the implementation of Long-Short Term Memory (LSTM) RNNs, and apply them to image captioning on MS-COCO.
88+
The notebook `LSTM_Captioning.ipynb` will walk you through the implementation of Long-Short Term Memory (LSTM) RNNs, and apply them to image captioning on MS-COCO.
9089

9190
### Q3: Network Visualization: Saliency maps, Class Visualization, and Fooling Images (15 points)
9291

93-
The Jupyter notebooks `NetworkVisualization-TensorFlow.ipynb` /`NetworkVisualization-PyTorch.ipynb` will introduce the pretrained SqueezeNet model, compute gradients with respect to images, and use them to produce saliency maps and fooling images. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awardeded if you complete both notebooks.
92+
The notebooks `NetworkVisualization-TensorFlow.ipynb`, and `NetworkVisualization-PyTorch.ipynb` will introduce the pretrained SqueezeNet model, compute gradients with respect to images, and use them to produce saliency maps and fooling images. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awardeded if you complete both notebooks.
9493

9594
### Q4: Style Transfer (15 points)
96-
In the Jupyter notebooks `StyleTransfer-TensorFlow.ipynb`/`StyleTransfer-PyTorch.ipynb` you will learn how to create images with the content of one image but the style of another. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awardeded if you complete both notebooks.
95+
96+
In thenotebooks `StyleTransfer-TensorFlow.ipynb` or `StyleTransfer-PyTorch.ipynb` you will learn how to create images with the content of one image but the style of another. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awardeded if you complete both notebooks.
9797

9898
### Q5: Generative Adversarial Networks (15 points)
99-
In the Jupyter notebooks `GANS-TensorFlow.ipynb`/`GANS-PyTorch.ipynb` you will learn how to generate images that match a training dataset, and use these models to improve classifier performance when training on a large amount of unlabeled data and a small amount of labeled data. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awarded if you complete both notebooks.
99+
100+
In the notebooks `GANS-TensorFlow.ipynb` or `GANS-PyTorch.ipynb` you will learn how to generate images that match a training dataset, and use these models to improve classifier performance when training on a large amount of unlabeled data and a small amount of labeled data. Please complete only one of the notebooks (TensorFlow or PyTorch). No extra credit will be awarded if you complete both notebooks.
100101

101102
### Submitting your work
102103

index.html

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,11 @@
2424
Assignment #2: Fully-Connected Nets, BatchNorm, Dropout, ConvNets, Tensorflow/Pytorch
2525
</a>
2626
</div>
27+
<div class="materials-item">
28+
<a href="assignments2020/assignment3/">
29+
Assignment #3: Image Captioning with Vanilla RNNs and LSTMs, Neural Net Visualization, Style Transfer, Generative Adversarial Networks
30+
</a>
31+
</div>
2732
<!--
2833
<div class="materials-item">
2934
<a href="assignments2019/assignment2/">

0 commit comments

Comments
 (0)