3D reconstruction using multiple kinects

The problem of robust, realistic and especially fast 3-D reconstruction of objects, although extensively studied, is still a challenging research task. Most of the state-of-the-art approaches that target real-time applications, such as immersive reality, address mainly the problem of synthesizing intermediate views for given view-points, rather than generating a single complete 3-D surface. In this work, we present a multiple-Kinect capturing system and a novel methodology for the creation of accurate, realistic, full 3-D reconstructions of moving foreground objects, e.g., humans, to be exploited in real-time applications. The proposed method generates multiple textured meshes from multiple RGB-Depth streams, applies a coarse-to-fine registration algorithm and finally merges the separate meshes into a single 3-D surface. Although the Kinect sensor has attracted the attention of many researchers and home enthusiasts and has already appeared in many applications over the Internet, none of the already presented works can produce full 3-D models of moving objects from multiple Kinect streams in real-time. We present the capturing setup, the methodology for its calibration and the details of the proposed algorithm for real-time fusion of multiple meshes. The presented experimental results verify the effectiveness of the approach with respect to the 3-D reconstruction quality, as well as the achieved frame rates.

Demonstrations

May 2015



 

Dec. 2014

Oct. 2014

May 2012


Oct. 2011

Relevant Projects

REVERIE
REal and Virtual Engagement in Realistic Immersive Environments.

 

RePLAYreplay_inv

Reusable low-cost platform for digitizing and preserving traditional participative sports.

 

 

Relevant Publications

D. Alexiadis, G. Kordelas, K. Apostolakis, J. Agapito, J. Vegas, E. Izquierdo, P. Daras, Reconstruction for 3D Immersive Virtual Worlds“, WIAMIS 2012: The 13th International Workshop on Image Analysis for Multimedia Interactive Services, 23rd – 25th May 2012, Dublin City University, Ireland

R. Mekuria, D. Alexiadis, P. Daras, P. Cesar, Real-time encoding of live reconstructed mesh sequences for 3D Tele-Immersion“, IEEE International Conference on Multimedia and Expo (ICME 2013), San Jose, California, USA, 2013

D. Alexiadis, D. Zarpalas, P. Daras, Real-time, Realistic Full-body 3D Reconstruction and Texture Mapping from Multiple Kinects“, 11th IEEE IVMSP Workshop: 3D Image/Video Technologies and Applications, Yonsei University, Seoul, Korea, 10-12 June 2013, best paper award

D. Alexiadis, D. Zarpalas, P. Daras, Real-time, full 3-D reconstruction of moving foreground objects from multiple consumer depth cameras“, IEEE Transactions on Multimedia, VOL. 15, NO. 2, pp. 339-358, February 2013, IEEE Distinguished paper, IEEE MMTC R-Letter Vol 4, No 3, June2013