Instantly indexed databases for multimedia content analysis and retrieval
DCFirst Claim
1. A method for use in indexing, in a database, data associated with a domain-specific event, the method comprising the steps of:
- processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
obtaining pre-existing data associated with the domain-specific event; and
indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data.
10 Assignments
Litigations
0 Petitions
Accused Products
Abstract
Techniques for indexing multimedia data substantially concurrently or contemporaneously with its capture to convert a real world event into an accessible database in real time are provided. The present invention introduces a new paradigm of converting a real world event in real time into a rich multimedia database by processing data from multiple sensors observing the event. Real time analysis of the sensor data, coupled with domain knowledge, results in instant indexing of multimedia data at capture time itself. This yields the semantic information to answer complex queries about the content, and the ability to extract portions of data that correspond to complex actions performed in the real world.
-
Citations
25 Claims
-
1. A method for use in indexing, in a database, data associated with a domain-specific event, the method comprising the steps of:
-
processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event; obtaining pre-existing data associated with the domain-specific event; and indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. Apparatus for use in indexing, in a database, data associated with a domain-specific event, the apparatus comprising:
at least one processor operative to;
(i) process sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
(ii) obtain pre-existing data associated with the domain-specific event; and
(iii) index data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing operation further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data.- View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
23. A database system, comprising:
-
at least one processor operative to;
(i) process sensor data obtained in accordance with a domain-specific event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event;
(ii) obtain pre-existing data associated with the domain-specific event; and
(iii) index data associated with the domain-specific event, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing operation further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data; anda database structure, coupled to the at least one processor, for storing the data in accordance with the indexing operation.
-
-
24. An article of manufacture for use in indexing, in a database, data associated with a domain-specific event, the article comprising a machine readable medium containing one or more programs which when executed implement the steps of:
-
processing sensor data obtained in accordance with the event in real time, the sensor data comprising motion data of one or more objects or one or more people associated with the domain-specific event; obtaining pre-existing data associated with the domain-specific event; and indexing data associated with the domain-specific event in the database, contemporaneous with capture of the data associated with the domain-specific event being indexed, based on at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data, wherein the indexing step further comprises generating an index usable to retrieve at least a portion of the data associated with the domain-specific event by creating one or more cross-indexes between at least a portion of the processed real time sensor data and at least a portion of the obtained pre-existing data. - View Dependent Claims (25)
-
Specification