Vertically Integrated Projects
Designing AI Technologies for Brain Activities
Recent advances in extended reality (XR), embracing Virtual/Augmented/Mixed Reality (VR/AR/MR) with Artificial intelligence (AI), mutually provide benefits in solving real-world problems across various domains. Our research team aims to generate individual adaptive XR platforms for enhanced experience and task performance in education, training, agriculture, and healthcare.
To enable customized XR experiences, we aim to create a holistic mental model that encompasses emotion, cognition, attention, and perception through non-invasive biometric data, including brain activities, physiological signals, and non-verbal behaviors such as eye gaze and facial expressions, using cutting-edge AI technology. Exploring the use of this model will be investigated and utilized to significantly enhance user experience and task performance, incorporating the results into the real world to improve human life quality and advance science.
Experienced Gained
We plan to conduct the following high-level research activities in this project, which will help students gain desired skills in their respective fields.
- Conduct high-impact research to develop a real-life XR and AI solution with the human mental models.
- Designing, developing, and deploying XR and AI algorithms and applications with human mental models.
- Programming in-game engine (Unity/Unreal/Nvidia Omniverse and C++, C#, python).
- Design experiments, data collection, analysis, and interpret experimental data.
- Understand non-invasive multimodal data, e.g., facial expression, eye behavior, and physiological signals.
- Disseminating research outcomes to the internal and external venues (symposium, conference, workshop, journal).
