Session-Based Behaviour Detection in Educational Contexts

Ab0ut this course

This course covers the entire process of designing and developing session-based detection of user behaviour for educational environments. Using a real-world case study, an application designed to train clinicians during simulated patient appointments, students will explore how multimodal analytics (facial movement, body language, and speech) and basic tools (computer vision, speech tools) can be used to provide communication performance analytics. Rather than diving deep into machine learning or complex signal processing, this course covers Emotion AI in educational environments as a human-AI interaction design problem. Students will learn how to transition raw behavioral data into intuitive visual feedback while navigating the UX design process, interdisciplinary collaboration, and critical ethical considerations like privacy and technical limitations. Course covers topics such as user centric design, user research methods, idea development, prototyping, user testing, and system evaluation.

Course structure

• Covers fundamentals of session-based detection in educational settings, focusing on both verbal and nonverbal behavior
• Introduces basic tools, data visualization techniques, and the end-to-end design of analysis pipelines
• Showcases real-world use-case, including behaviour detection and automated feedback system
• Guides students through user research, defining system requirements, ideation, prototyping, testing, and evaluation
• Examines technical constraints, and ethical/privacy considerations

Learning outcomes

After the course, students will:

• Understand user research activities for developing session-based detection applications
• Apply a human-centered design process to prototype systems that transform complex behavioral analytics into effective user feedback
• Understand the methods and processes used to test session-based detection systems
• Understand the multidisciplinary aspects of developing session-based detection systems, bridging technical engineering and user experience design
• Integrate ethical and privacy considerations in the design of session-based detection systems