Person Tracking Association Using Multi-modal Systems

Abstract:


In this paper, a novel multi-modal method for person identification in indoor environments is presented. This approach relies on matching the skeletons detected by a Kinect v2 device with wearable devices equipped with inertial sensors. Movement features such as yaw and pitch changes are employed to associate a particular Kinect skeleton to a person using the wearable. The entire process of sensor calibration, feature extraction, synchronization and matching is detailed in this work. Six detection scenarios were defined to assess the proposed method. Experimental results have shown a high accuracy in the association process.


  • A. Belmonte-Hernandez, V. Solachidis, T. Theodoridis, G. Hernandez, G. Conti, N. Vretos, P. Daras, F. Alvarez, "Person Tracking Association Using Multi-modal Systems", 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Lecce, Italy, 29 Aug – 1 Sept, 2017

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Principal Researcher Grade Α
    1st km Thermi – Panorama, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164
    Email: daras@iti.gr