Explore the Possibilities

Give Now

 

 

XRAI – Extended Reality with Artificial Intelligence

Goals

Recent advances in extended reality (XR), embracing Virtual/Augmented/Mixed Reality (VR/AR/MR) with Artificial intelligence (AI), mutually provide benefits in solving real-world problems across various domains. Our research team aims to generate individual adaptive XR platforms for enhanced experience and task performance in education, training, agriculture, and healthcare.

To enable customized XR experiences, we aim to create a holistic mental model that encompasses emotion, cognition, attention, and perception through non-invasive biometric data, including brain activities, physiological signals, and non-verbal behaviors such as eye gaze and facial expressions, using cutting-edge AI technology. Exploring the use of this model will be investigated and utilized to significantly enhance user experience and task performance, incorporating the results into the real world to improve human life quality and advance science.

Experienced Gained

We plan to conduct the following high-level research activities in this project, which will help students gain desired skills in their respective fields.

  • Conduct high-impact research to develop a real-life XR and AI solution with the human mental models.
  • Designing, developing, and deploying XR and AI algorithms and applications with human mental models.
  • Programming in-game engine (Unity/Unreal/Nvidia Omniverse and C++, C#, python)
  • Design experiments, data collection, analysis, and interpret experimental data.
  • Understand non-invasive multimodal data, e.g., facial expression, eye behavior, and physiological signals.
  • Disseminating research outcomes to the internal and external venues (symposium, conference, workshop, journal).

Majors and Interests Needed

  • Computer Science 
  • Game Design and Development
  • Software engineering
  • Information Technology/Systems
  • Data Science
  • Social Sciences
  • Psychology
  • Nursing
  • Health Sciences
  • All Engineering

Team Advisors

  • Name
    Title
    Email
  • Sungchul Jung 
    Assistant Professor, Game Design and Development  
    Director of Immersive Empathic Interface (IEI) Lab  
  • Joy Li
    Associate Professor, Computer Game Design and Development, Research Director of the Realities Lab
  • Taeyeong Choi
    Assistant Professor, Information Technology
  • Rifatul Islam
    Assistant Professor, Computer Science
  • Lei Zhang
    Assistant Professor, Game Development

 

©