Motion Analysis: Action Detection, Recognition and Evaluation based on motion capture data

Abstract:


A novel framework, for real-time action detection, recognition and evaluation of motion capture data, is presented in this paper. Pose and kinematics information is used for data description. Automatic and dynamic weighting, altering joint data significance based on action involvement, and Kinetic energy-based descriptor sampling are employed for efficient action segmentation and labelling. The automatically segmented and recognized action instances are subsequently fed to the framework action evaluation component, which compares them with the corresponding reference ones, estimating their similarity. Exploiting fuzzy logic, the framework subsequently gives semantic feedback with instructions on performing the actions more accurately. Experimental results on MSR-Action3D and MSRC12 benchmarking datasets and a new, publicly available one, provide evidence that the proposed framework compares favourably to state-of-the-art methods by 0.5-6% in all three datasets, showing that the proposed method can be effectively used for unsupervised gesture/action training.


  • F. Patrona, A. Chatzitofis, D. Zarpalas, P. Daras, "Motion Analysis: Action Detection, Recognition and Evaluation based on motion capture data", Pattern Recognition, Special Issue on Articulated Motion and Deformable Objects, Volume 76, Pages 612-622, DOI: 10.1016/j.patcog.2017.12.007 April 2018

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Principal Researcher Grade Α
    1st km Thermi – Panorama, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164
    Email: daras@iti.gr