3D liVe Immerse Video Audio iNteractive mulTimedia

3D VIVANT is an FP7 specific targeted research project (STREP) aiming to capture events automatically in three dimensional (3D) space and deliver them for realistic, interactive, fatigue-free and immersive play back to home users-viewers.

The central idea of this project is the “holoscopic content”, a new form of 3D video and audio multimedia content expanding audiovisual sensation. Holoscopic content brings together 3D and high definition (HD) TV combined 3D space sound. It allows fatigue-free viewing (without special glasses, viewing constraints or head tracking) in high definition displays and in real time.

During the project a world first single aperture ultra-high definition 3D holoscopic imaging camera will be constructed which will permit live capture of 3D holoscopic content. Recorded material will be coded appropriately so that it can be rendered in holographic displays or commercially available autostereoscopic displays combined with binaural sky sound systems to increase immersive experience. Holoscopic content will be interactive and therefore 3D VIVANT will offer the means for extracting and accessing 3D objects hence providing the user with the capabilities searching and retrieving the desired 3D content, hyperlinking and navigating through holoscopic content while playing.

ITI will be mainly involved in the development of the search and retrieval module of the 3D VIVANT framework but it will also assist in depth reconstruction from holoscopic content.