This seminar introduces the foundations of multimodal machine learning and their applications on simulated and actual robot platforms. It covers basics of machine learning, preliminary concepts of sensors (e.g., depth and colour cameras, IMU, position encoders, etc.), sensor fusion techniques, specifications of robot platforms (e.g., Nao and the Pepper) and simulators.
Students will work in teams on a topic in (deep) multimodal learning for robotics, and present their experimental results in oral presentations and written reports.
Some experience with machine learning, programming and robotics — though not necessarily all of them — is required.