×

Large scale video search using queries that define relationships between objects

  • US 10,275,656 B2
  • Filed: 11/20/2015
  • Issued: 04/30/2019
  • Est. Priority Date: 11/21/2014
  • Status: Active Grant
First Claim
Patent Images

1. A relationship-based video server system, programmed to provide a platform for large scale video search based on relationships between objects in video segments, the platform executing search based on probabilistically discriminative objects and relationships, wherein the server system is configured to run processes that:

  • for each video segment received for storage in a video database,analyze image data in the video segment to (1) recognize objects that are represented in the video segment and (2) identify relationships between the objects,determine, based on probabilities of occurrence for the recognized objects and identified relationships, at least one of (1) the most discriminative object or (2) the most discriminative relationship in the video segment,configure, based on at least one of the most discriminative object or the most discriminative relationship, a data structure that includes the recognized objects and identified relationships of the video segment;

    store the data structure in the video database;

    receive a video search query defining relationships between a plurality of objects;

    determine, based on probabilities of occurrence for the objects and relationships of the video search query, at least one of the most discriminative object or the most discriminative relationship of the video search query;

    identify, based on at least one of the most discriminative object or the most discriminative relationship of the video search query, a subset of the data structures to search for video segments;

    determine, for each video segment represented in the subset of the data structures, a score based on similarity between the objects and the relationships in the video search query and the objects and the relationships associated with the video segment; and

    display representations of video segments with the highest scores.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×