Unit I

Unit I: Audio-Visual Interaction via Smartphone and Tablet
Case Study: Spoken Language Learning.
Gamification, bite-size learning strategies.
Student Project: Design a mini-game for teaching a specific topic, demonstrating the alignment of interaction and pedagogical principles.

Unit II

Unit II: AR/VR and Haptic Interaction
Analysis of case studies of Ammachi Labs projects such as motorcycle maintenance, bar bending, construction, etc.
Structure and design of Immersive environments
Student Project – students design their own mini-VR interaction to teach a specific topic, with a clear articulation of how the interaction and pedagogy map.

Unit III

Unit III: Text-Based AI trainer
Case Study: Using LLMs as a skills trainer.
Learning theories in the context of dialogs, the role of questioning in learning,
Strengths and limitations of text-based learning.
Study Project: Design a text-based AI ‘persona’ capable of guiding learning through question-answering.

Prerequisite: none

Summary:
Building upon foundational knowledge from previous courses, this advanced course dives into three major interaction modalities—audio-visual touchscreen interfaces for phones and tablets, AR/VR and haptic interfaces, and text-based AI interactions. Focused on optimizing these interfaces for various pedagogical approaches, students will critically analyze the opportunities and limitations inherent to each modality, considering the cognitive needs of learners to design effective educational technologies.

Course Objectives:

Students will learn to:

To analyze the interaction modalities of audio-visual touchscreens, AR/VR and haptic, and text-based AI.
To understand the cognitive needs of learners in relation to different technological interfaces.
To apply theoretical knowledge in designing optimized interfaces for specific pedagogical approaches.

Course Outcomes:

CO1:Design and evaluate audio-visual touchscreen interfaces for educational purposes.
CO2: Conceptualize and develop immersive learning experiences using AR/VR and haptic technologies.
CO3: Create effective text-based AI trainers tailored to specific learning outcomes.

Skills:

• Design and development of interactive learning technologies.
• Critical analysis of interface design in the context of learner engagement and pedagogy.
• Practical application of design principles to create customized educational experiences.

Program outcome PO – Course Outcomes CO Mapping

Evaluation Pattern:

*CA – Can be Quizzes, Assignment, Projects, and Reports, and Seminar

• Dirksen, J. (2015). Design for how people learn. New Riders.
• Kapp, K. M., & O’Driscoll, T. (2009). Learning in 3D: Adding a new dimension to enterprise learning and collaboration. John Wiley & Sons.
• Plass, J. L., Mayer, R. E., & Homer, B. D. (Eds.). (2020). Handbook of game-based learning. Mit Press.
• Mayer, R. E. (2005). Cognitive theory of multimedia learning. The Cambridge handbook of multimedia learning, 41, 31-48.
• Muir, A. (2021, May). Where HCI meets the spiritual path: The three yogas of the Bhagavad Gītā. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (pp.
• 1-9).
• Norman, D. A. (2013). The design of everyday things: Revised and expanded edition. Basic Books. Norman, D. (2004). Emotional design: Why we love (or hate) everyday things.
• Ramesh, M. V., Muir, A., Nandanan, K., Bhavani, R. R., & Mohan, R. (2022). HCI curricula for sustainable innovation: The humanitarian focus at Amrita Vishwa Vidyapeetham. Interactions, 29(1), 54-57.
• Sachith, K. P., Gopal, A., Muir, A., & Bhavani, R. R. (2017). Contextualizing ICT based vocational education for rural communities: Addressing ethnographic issues and assessing design principles. In Human-Computer Interaction-INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25-29, 2017, Proceedings, Part II 16 (pp. 3-12). Springer International Publishing.
• Unnikrishnan, R., Amrita, N., Muir, A., & Rao, B. (2016, June). Of elephants and nested loops: How to introduce computing to youth in rural India. In Proceedings of the The 15th International Conference on Interaction Design and Children (pp. 137-146).