In this course, students will learn about multi-channel data and the use of multimodal analysis to understand the teaching-learning process. The course content will include:
- Motivation behind multimodal data analysis: a literature review of current research
- Capturing verbal and non-verbal communication during the learning process.
- Capture, process, and analysis of data from multiple channels:
- Affective computing using facial emotion analysis and GSR
- Focus and attention analysis using eye-gaze data
- Cognitive load detection using pupillometry and EEG
- Align and interpret data from multiple channels
- Ethics and experiment design
- Project management