Exploiting sensing devices availability in AR/VR deployments to foster engagement

Abstract:


Currently, in all augmented reality (AR) or virtual reality (VR) educational experiences, the evolution of the experience (game, exercise or other) and the assessment of the user’s performance are based on her/his (re)actions which are continuously traced/sensed. In this paper, we propose the exploitation of the sensors available in the AR/VR systems to enhance the current AR/VR experiences, taking into account the users’ affect state that changes in real time. Adapting the difficulty level of the experience to the users’ affect state fosters their engagement which is a crucial issue in educational environments and prevents boredom and anxiety. The users’ cues are processed enabling dynamic user profiling. The detection of the affect state based on different sensing inputs, since diverse sensing devices exist in different AR/VR systems, is investigated, and techniques that have been undergone validation using state-of-the-art sensors are presented.


  • N. Vretos, P. Daras, S. Asteriadis, E. Hortal, E. Ghaleb, E. Spyrou, H. C. Leligou, P. Karkazis, P. Trakadas, K. Assimakopoulos, "Exploiting sensing devices availability in AR/VR deployments to foster engagement", Springer Virtual Reality (2018) https://doi.org/10.1007/s10055-018-0357-0

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Principal Researcher Grade Α
    1st km Thermi – Panorama, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164
    Email: daras@iti.gr