Master Project - Generative AI (infMPGAI-01a)

Abstract

This master project provides the opportunity to apply and advance the theoretical knowledge of training deep neural networks and generative AI approaches to a concrete practical problem. At the start of the semester students will pick concrete projects, for which they work together through the semester in small teams to achieve the goals.

Learning Objectives

Students will learn to work on a complex problem with a focus on machine learning and generative AI. This includes the use of the required software libraries (Tensorflow, Pytorch, Python) and the required frameworks for training neural networks. A key goal of the project is to either use existing state-of-the-art neural network architectures, to develop novel architectures, or to apply AI models to applications toward medical diagnostics, manufacturing, and autonomous agents. Specifically, the projects are setup to leverage deep learning models for image generation, 3D shape processing, or learning models for time-series data. Students will also practice to work in a team, to analyze the requirements for a practical project, and to plan the steps to achieve the goals.

Course Content

Advanced concepts of Generative AI, including Generative Adversarial Networks, Diffusion Models, Domain Adaptation and Style Transfer, Neural Radiance Fields (NeRFs), and Synthetic Data Generation. The project will be implemented in Physthon or in conjunction with state-of-the-art rendering engines (e.g. Unreal Engine 5 with C++).

Further Requirements

This master project targets students that have ideally completed the class NNDL or GenAI or those who have equivalent knowledge such that they understand advanced concepts of modeling and rendering.

Exam

Presentations including demonstration, report and the completed software system (incl. documentation).

Teaching and Learning Methods

Students will work on an individually defined project.

Literature

Deep Learning, Ian Goodfellow and Yoshua Bengio and Aaron Courville, 2016, MIT Press
Generative AI - Teaching Machines to Paint, Write, Compose and Play, David Foster, 2019, O'Reily