Action Detection, Recognition and Evaluation based on motion capture data


A novel framework, for real-time action detection, recognition and evaluation of motion capture data, is presented in this paper. Pose and kinematics information is used for data description. Automatic and dynamic weighting, altering joint data significance based on action involvement, and Kinetic energy-based descriptor sampling are employed for efficient action segmentation and labelling. The automatically segmented and recognized action instances are subsequently fed to the framework action evaluation component, which compares them with the corresponding reference ones, estimating their similarity. Exploiting fuzzy logic, the framework subsequently gives semantic feedback with instructions on performing the actions more accurately. Experimental results on MSR-Action3D and MSRC12 benchmarking datasets and a new, publicly available one, provide evidence that the proposed framework compares favourably to state-of-the-art methods by 0.5-6% in all three datasets, showing that the proposed method can be effectively used for unsupervised gesture/action training.

  • F. Patrona, A. Chatzitofis, D. Zarpalas, P. Daras, "Action Detection, Recognition and Evaluation based on motion capture data", Pattern Recognition, Special Issue on Articulated Motion and Deformable Objects, 2017, DOI: 10.1016/j.patcog.2017.12.007

  • Full document available here.
    Contact Information

    Dr. Petros Daras, Principal Researcher Grade Α
    1st km Thermi – Panorama, 57001, Thessaloniki, Greece
    P.O.Box: 60361
    Tel.: +30 2310 464160 (ext. 156)
    Fax: +30 2310 464164