AI Experience Laboratory

Fall 2024

Schedule: Mon/Wed 4:00pm-6:30pm
Location: GIST College Building A (N4), Room 227 (Zoom Online) / Class Colab

Instructor: Ue-Hwan, Kim (uehwan@gist.ac.kr)
Office: GIST Central Research Facilities (C11) 407
Office Hour: Tue 4pm-5pm or by appointment

TAs:
Jae-Woo, Kim (kjw01124@gm.gist.ac.kr)
Won-Sic, Jang (wonsicjang@gm.gist.ac.kr)

Notice

  • Review report format available here
  • Recitations start from September 11 :)
  • We do not have recitation on October 9 (we will cover the material on October 16).
  • [Midterm] Date: Oct. 28, 4pm-6pm / Location: GIST Oryong Hall (W1) Room 203
    • The exam is closed book, closed notes, closed computer, and closed calculator
    • Just need to bring your pen, pencil and erasers in addition to your student ID card
    • Coverage: Session 00 ~ Session 05 (including recitations)
    • Result released! Check this document
      • Claim during Dec. 3, 7pm-8pm C11 Room 410
  • We do not have recitation on November 6
  • RR Result (~midterm)
    • Check the result here
    • The meaning of scores
      • 0.50: not sufficient amount of content
      • 0.25: link is broken
    • RR claim will be on Nov. 20 after the recitation
      • You can claim for the broken link showing the edit history
  • [Final Exam] Date: Dec. 16, 4pm-6pm / Location: GIST College Building C (N6) Room 104
    • The exam is closed book, closed notes, closed computer, and closed calculator
    • Just need to bring your pen, pencil and erasers in addition to your student ID card
    • Coverage: Session 06 ~ Session 10 (including recitations)

Introduction

This course will showcase various methods in machine learning and deep learning. Throughout the semester, emphasis will be put on practical use cases. Examples of specific methods this course covers includes convolutional neural networks, recurrent neural networks, transformers and generative adversarial networks. Further, we will use Google Colab as our development environment.

References

  • Introduction to Deep Learning @ CMU Link
  • Deep Learning @ Eberhard Karls Universität Tübingen Link
  • Introduction to Deep Learning @ UW Link
  • Deep Learning for Computer Vision @ Stanford Link
  • Natural Language Processing with Deep Learning @ Stanford Link
  • Learn PyTorch for Deep Learning @ ZTM Link
  • Deep Learning from Scratch Link
  • Dive into Deep Learning (Aston Zhang et al., 2019) Link

Schedule

Date Topic Materials Recitations
09-02 [Session 00.0]  Introduction Lecture Slides Submit Result
09-04 [Session 01.0]  Preliminary Lecture Slides Submit Result
09-09 [Session 01.1]  Preliminary (cont'd) Lecture Slides Submit Result
09-11 [Session 02.0]  Perceptrons Lecture Slides Submit Result Exercises solution
09-16 No Lecture (National Holiday)
09-18 No Lecture (National Holiday)
09-23 [Session 02.1]  Perceptrons (cont'd) Lecture Slides Submit Result
09-25 [Session 03.0]  Loss functions Lecture Slides Submit Result Exercises solution
09-30 [Session 03.1]  Loss functions (cont'd) Lecture Slides Submit Result
10-02 [Session 04.0]  Backpropagation Lecture Slides Submit Result Exercises solution
10-07 [Session 04.1]  Backpropagation (cont'd) Lecture Slides Submit Result
10-09 No Lecture (National Holiday) Exercises solution
10-14 [Session 04.2]  Backpropagation (cont'd) Lecture Slides Submit Result
10-16 [Session 05.0]  Optimization Lecture Slides Submit Result Exercises solution
10-21 [Session 05.1]  Optimization (cont'd) Lecture Slides Submit Result
10-23 [Session 99.0]  Midterm review (Q&A) Exercises solution
10-28 [Session 99.1]  Midterm
10-30 No Lecture (Midterm Period)
11-04 [Session 06.0]  CNNs Lecture Slides Submit Result
11-06 [Session 00.1]  AI Days Lecture Slides Submit Result
11-11 [Session 06.1]  CNNs (cont'd) Lecture Slides Submit Result
11-13 [Session 07.0]  Word vectors Lecture Slides Submit Result Exercises solution
11-18 [Session 07.1]  Word vectors (cont'd) Lecture Slides Submit Result
11-20 [Session 08.0]  RNNs Lecture Slides Submit Result Exercises solution
11-25 [Session 08.1]  RNNs (cont'd) Lecture Slides Submit Result
11-27 [Session 09.0]  Seq2Seq Lecture Slides Submit Result Exercises solution
12-02 [Session 09.1]  Seq2Seq (cont'd) Lecture Slides Submit Result
12-04 [Session 10.0]  Transformers Lecture Slides Submit Result Exercises solution
12-09 [Session 10.1]  Transformers (cont'd) Lecture Slides Submit Result
12-11 [Session 99.2]  Final exam review (Q&A) Exercises solution
12-16 [Session 99.3]  Final exam
12-18 No Lecture (Final Exam Period)