A framework for large-scale analysis of video 'in the Wild' to assist digital forensic examination

Abstract

Digital forensics departments usually have to analyse vast amounts of audio-visual content, such as videos collected from street CCTV footage, hard drives or online resources. The framework presented in this article, which has been developed in the context of the EU-funded project LASIE, aims to assist investigators in their everyday tasks, through the provision of innovative tools for image and video analysis, object detection and tracking and event detection. These tools exploit the latest advances in machine learning, including deep neural networks, to handle the challenges in processing content from real-world data sources. The framework is enhanced with advanced inference and recommendation capabilities, which filter-out inconsistencies and recommend additional evidence. An intuitive user interface allows exploiting the capabilities of the available tools in a user-friendly manner. The framework supports distributed processing, with easy deployment of the services in clusters of multiple workstations, making the proposed solution appropriate for big data analytics tasks.