Human-enhanced time-aware multimedia search (2011: FP7 ICT – IP)

Multimedia search engines today are “black-box” systems. This closed architecture makes it difficult for technology providers, application integrators, and end-users to try out novel approaches for multimedia content and query processing, because there is no place where one can deploy content, components, and processes, integrate them with complementary technologies, and assess the results in a real and scalable environment.

The key technical principle of CUBRIK is to create a “white-box” version of a multimedia content & query processing system, by unbundling its functionality into a set of search processing pipelines, i.e., orchestrations of open source and third-party components instantiating current algorithms for multimedia content analysis, query processing, and relevance feedback evaluation. Examples will be pipelines for extracting metadata from media collections using the software mix that best fits application requirements, for processing multimodal queries, and for analysing user’s feedback in novel ways.

CUBRIK aims at constructing an open platform for multimedia search practitioners, researchers and end-users, where different classes of contributors can meet and advance the state-of-the-art by joining forces. Important scientific contributions will be the systematic integration of human and social computation in the design and execution of pipelines, and the enrichment of multimedia content and query processing with temporal and spatial entities.

On the business side, CUBRIK will endorse an ecosystem where a multitude of actors will concur to implement real application scenarios that validate the platform features in real world conditions and for vertical search domains. The CUBRIK community will bring together technology developers, software integrators, social network and crowdsourcing providers, content owners and SMEs, to promote the open search paradigm for the creation of search solutions tailored to user needs in vertical domains.