Low-cost Accurate Skeleton Tracking Based on Fusion of Kinect and Wearable Inertial Sensors

Abstract:


In this paper, we present a novel multi-sensor fusion method to build a human skeleton. We propose to fuse the joint position information obtained from the popular Kinect sensor with more precise estimation of body segment orientations provided by a small number of wearable inertial sensors. The use of inertial sensors can help to address many of the well known limitations of the Kinect sensor. The precise calculation of joint angles potentially allows the quantification of movement errors in technique training, thus facilitating the use of the low-cost Kinect sensor for accurate biomechanical purposes e.g. the improved human skeleton could be used in visual feedback-guided motor learning, for example. We compare our system to the gold standard Vicon optical motion capture system, proving that the fused skeleton achieves a very high level of accuracy.


  • F. Destelle, A. Ahmadi, A. Chatzitofis, D. Zarpalas, N.E. O’Connor, K. Moran, P. Daras, "Low-cost Accurate Skeleton Tracking Based on Fusion of Kinect and Wearable Inertial Sensors", 22nd European Signal Processing Conference (EUSIPCO 2014), Lisbon, Portugal, 2-5 Sept. 2014

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Research Director
    6th km Charilaou – Thermi Rd, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164
    Email: daras(at)iti(dot)gr