Security of Machine Learning

Overview

SemesterSummer 2023
Course typeLecture
LecturerJun.-Prof. Dr. Wressnegger
AudienceInformatik Master & Bachelor
Credits3 ECTS
Time15:45–17:15
Room-101 (50.34)
LanguageEnglish
Linkhttps://ilias.studium.kit.edu/goto.php?target=crs%5F2081072&client_id=produktiv
RegistrationTBA (registration is only necessary for the final exam)

Description

This lecture explicitly focuses on the security of machine learning algorithms. In learning-based systems, often only average-case performances are considered to show the effectiveness of AI methods. Worse-case scenarios triggered by viciously crafted inputs, however, can be exploited by an adversary to cause devastating damage in the application area. It thus is of utmost importance to investigate, research, and know about the security properties of machine learning methods.

The module introduces students to theoretic and practical aspects of security of machine learning algorithms and methods. In the first part, we cover offensive aspects of the topic. We will learn about different attack types such as adversarial examples (both white-box and black-box) or data poisoning and explicitly address problem-space constraints. In the second part, we explicitly focus on defensive mechanisms, such as adversarial training and network pruning. Finally, we will also cover methods for explaining learning-based algorithms to assist analysis and securing of machine learning methods.

Mode of Operation

This year we are going to do this in a flipped class-room setting. The lecture contents are distributed via video recordings, in a way that you can learn at your own speed. Additionally, we are meeting up for discussions, Q&A, and exercises at university. This way, we hopefully get the best from both worlds.

Schedule

DateTopicSlidesRecording
24. AprilIntroductionLIVE!
01. MayNo lecture (Labor Day)
08. MayPrimer on Neural Networks, ,
15. MayAdversarial Examples, , ,
22. MayAdversarial Training, , ,
29. MayNo lecture (Whit Monday)
05. JuneBackdooring Attacks, , ,
12. JuneModel Stealing, , ,
19. JuneMembership Inference, , ,
26. JuneGuest Lecture
03. JulyFoundations of XAI, , ,
10. JulyConcept-based Explanations, , ,
17. JulyAttacks against Explanations, , ,
24. JulySummary and OutlookLIVE!
14. AugustWritten Exam

Matrix Chat

News about the lecture, potential updates to the schedule, and additional material are distributed using the course's matrix room. Moreover, matrix enables students to discuss topics and solution approaches.

You find the link to the matrix room on ILIAS.