Overview

Goal

1. Students will be able to critically read, assess, and discuss research work in Trustworthy Machine Learning (TML).
2. Students will gain the technical background to implement basic TML techniques in a deep learning framework.
3. Students will be ready to conduct their own research in TML and make contributions to the research community.

Prerequisites

• Familiarity with Python and PyTorch coding.
• A pass grade from the Deep Learning Course (or equivalent).
• Basic knowledge of machine learning concepts.
• Basic maths: multivariate calculus, linear algebra, probability, statistics, and optimisation.

TML Book

Last year’s course materials are now a book. You can find it here: https://trustworthyml.io/. It’s also on arXiv: https://arxiv.org/abs/2310.08215.

Special thanks to Bálint for the majority of the work. Also, kudos to last year’s tutors: Alex, Elisa, and Michael.

Note: The course materials are updated yearly to stay aligned with the latest research. The book will be useful for the TML23/24 course. However, it won’t cover new topics added to the course.

Policies

Registration & Exercise 0

The registration link is here: https://forms.gle/NQ8ZgqZhZadkG1dq6. We start accepting registration from 29 September 2023 at 12:00 pm (noon) Central European Time (Berlin time).

Upon registration, you will get access to Exercise 0. The Exercise 0 is an individual exercise and will be based on the prerequisite materials for the course. Students who wish to enrol must submit their work on Exercise 0. The necessary prerequisite materials will be taught in the first lecture. Exercise 0 serves two purposes:

• For us to admit students who are sufficiently motivated for the course.
• For you to gauge your own readiness for the course.

Submit Exercise 0 by 22 October 2023. If you do not submit Exercise 0, we’ll assume that you do not wish to register for the course and the exams.

The timeline for registration is as follows:

• Now-28.09.2023: Decide whether to take the lecture.Check time & location for the course.
• 29.09.2023 at 12:00: Register for the course (link).
• 29.09.2023-22.10.2023: Work on Exercise 0 and submit.

Grading policy

The final grade is essentially based on your exam performance. However, to encourage the participation in the exercises, we award top-ups on the final grade based on the exercise performance. We make sure, though, that it is still possible to get the maximal perfomance (grade 1,0) even without any top-up from the exercises.

Exercise 0

• Submission of Exercise 0 is the minimal requirement for taking the exam.

Exercise 1-3 average score E (0 - 100%)

• Average score from Exercises 1-3.
• Exercises 1-3 are group exercises.

Admission to exam

• When you have submitted Exercise 0 and the average score for Exercises 1-3 is $E\geq 60$%, you are granted the right to sit the exam.

Exam score X (0 - 100%)

• Based on your performance on your exam.
• The pass threshold for the course will be $X\geq 50$% on the exam, independent of the exercise performance.
• There will be two exams: Exam 1 and Exam 2.
  • Case A: Sit Exam 1 and pass → Exam 1 score will be final (cannot sit Exam 2).
  • Case B: Sit Exam 1 and fail → You may sit Exam 2; Exam 2 score will be final.
  • Case C: Choose to skip Exam 1 and take Exam 2 → Exam 2 score will be final.

Final score S (0 - 100%)

• The final score is your exam score with possible increments from your exercise performance.
• Top-up from exercise: $T=(E-60$%$)/40$%$\times 10$%p, where $E$ is your average exercise score.
• The final score is clipped at 100%: $S=\min (100$%$, X+T)$.
• Examples:
  • If $E=100$% and $X=100$%, there will be no further top-up from the exercise scores $S=100$%.
  • If $E=100$% and $X=80$%, you will get $T=$ 10%p additional points on top of your exam grade $S=90$%.
  • If $E=100$% and $X=45$%, you may still fail the course because of the minimal requirement for passing the exam $X\geq 50$%.
  • If $E=60$%, no additional points will be awarded $T=0$.
  • If $E< 60$%, you will not be admitted to the exam.

Final grade G (1,0 - 5,0)

• The mapping from final score to final grade $S\mapsto G$ is determined after each exam, taking the overall difficulty of the exam into account.

Use of Language Models

Students may use language models for exercises. If you choose to do so, please follow the guideline below.

• Transparency: Clearly specify the language models you’ve used. Identify the text or code generated by these models.
• Verification and Academic Integrity: Validate the model’s output rigorously. Ensure it reflects your intentions and understanding of the subject. You’re responsible for its accuracy. In case the model’s output contains someone else’s work, failing to provide appropriate references will breach academic integrity rules.
• Diversity and Personal Touch: Language models often yield less diverse responses. Add your unique perspectives and solutions to enrich your work. This reduces the risk of identical solutions, which could lead to suspicions of copied work among students.
• Critical Thinking: Language models can reinforce existing thoughts, even incorrect ones. Don’t use them as your primary source for verification.

Communication

Lecturer

• Seong Joon Oh

Tutors

• Arnas Uselis
• Bálint Mucsányi
• Evgenii Kortukov

Central email

Please use the STAI group email stai.there@gmail.com to

• Submit your Colab exercises;
• Ask questions; and
• Send us feedback.

Discord forum

For those who’re registered for the course, ask the lecturer or tutors to add you to the Discord channel. We need your name and email address. Use it for

• Asking questions;
• Sending us feedback;
• Receiving official announcements; and
• Communicating others (e.g. finding exercise group members).

When & where

Lecture & tutorial location and time

Lecture: Hörsaal N09 (Hörsaalzentrum Morgenstelle)

• Mondays
• 1st session: 08:15-09:00
• 5-min break: 09:00-09:05
• 2nd session: 09:05-09:50

Tutorial: Hörsaal 7E02 (Hörsaalzentrum Morgenstelle)

• Mondays 10:00-12:00 (will take place upon prior notice)

Exam dates and locations

• Exam 1: 12:00 - 14:00, Monday 12.02.2023, Hörsaal N10 (Hörsaalzentrum Morgenstelle)
• Exam 2: 12:00 - 14:00, Tuesday 02.04.2023, Hörsaal N10 (Hörsaalzentrum Morgenstelle)

Schedule & exercises