[TMP-022] Autobiographical Recall in Virtual Reality

Contact person: Albrecht Schmidt, Robin Welsch (albrecht.schmidt@ifi.lmu.de; robin.welsch@aalto.fi) 

Internal Partners:

1. Ludwig-Maximilians-Universität München (LMU), Albrecht Schmidt
2. German Research Centre for Artificial Intelligence (DFKI), Paul Lukowicz and Patrick Gebhard  

We proposed to research how autobiographical recall can be detected in virtual reality (VR). In particular, we experimentally investigate what physiological parameters accompany interaction with autobiographical memories in VR. We consider VR as one important representation of Human-AI collaboration. For this, we plan to: (1) record an EEG data set of people’s reaction and responses when recalling an autobiographical memory, (2) label the data set, and (3) do an initial analysis of the dataset to inform the design of autobiographical VR experiences. We would try to automate data collection as much as possible to make it easy to add more data over time. This contributes to a longer-term effort in model and theory formation.

Tangible Outcomes

1.  Dataset: Pilot dataset – Kunal Gupta & Mark Billinghurst https://github.com/kgupta2789/AMinVR
2. Dataset: eye tracking data during encoding phase https://github.com/kgupta2789/AMinVR/tree/main/data/pupil
3. Workshop on Human Memory and AI – Albrecht Schmidt, Antti Oulasvirta, Robin Welsch & Kashyap Todi https://www.humane-ai.eu/event/ai-and-human-memory/
4. Video presentation explaining the project and the VR experience – Robin Welsch, Kunal Gupta & Albrecht Schmidt https://www.youtube.com/watch?v=mGb7Oi5CHNc&ab_channel=KunalGupta
5. Experimental video for the encoding phase showing the CR experience https://www.youtube.com/watch?v=mGb7Oi5CHNc