Virtual Video Clipping and Ranking Based on Spatio-Temporal Metadata

• US 20090136208A1
• Filed: 11/28/2007
• Published: 05/28/2009
• Est. Priority Date: 11/28/2007
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Yehudai, Zvi, Gilboa-Solomon, Flora
• Application Number:
  US11/946,067
• Publication Number:
  US 20090136208A1
• Time in Patent Office: Days
• US Class Current: 386/248
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

A video data and metadata storage and retrieval system including storage apparatus for storing a plurality of recorded video portions and metadata describing a plurality of geographical locations and corresponding times at which the video portions were recorded, and a computer configured to query the stored metadata, identify a plurality of the recorded video portions that correspond to the metadata resulting from the query, and group any of the identified video portions together into a video clip that are separated by less than a predefined clip gap.

Claims

1. A video data and metadata storage and retrieval system comprising:

storage apparatus for storing a plurality of recorded video portions and metadata describing a plurality of geographical locations and corresponding times at which said video portions were recorded; and

a computer configured to

query said stored metadata, identify a plurality of said recorded video portions that correspond to said metadata resulting from said query, and

group into a video clip any of said identified video portions together into a video clip that are separated by less than a predefined clip gap.

2. A system according to claim 1 wherein said clip gap is defined as a length of time separating any of said identified video portions and its next nearest identified video portion.

3. A system according to claim 1 wherein said computer is configured to group into said video clip at least two of said identified video portions bounding at least one intermediate video portion not among said identified video portions.

4. A system according to claim 1 wherein said computer is configured to group any of said identified video portions together into a plurality of video clips, and rank said video clips according to a relevance measure.

5. A system according to claim 4 wherein said relevance measure is expressed as the number of said identified video portions in any of said clips divided by the total number of video portions in said clip, wherein any of said video clips includes a video portion not among said identified video portions.

6. A system according to claim 1 wherein said computer is configured to receive a video data stream of said recorded video portions and a metadata stream of said metadata.

7. A system according to claim 1 wherein said metadata includes a description of a first geographical region and a first time stamp associated with a first video recording, and of a second geographical region and a second time stamp associated with a second video recording.

8. A system according to claim 6 wherein said video data stream is received from an aerial reconnaissance vehicle performing ground surveillance.

9. A system according to claim 6 wherein said metadata stream is provided in synchrony with said video data stream such that as said metadata are received they describe any of said recorded video portions that are received at the same time.

10. A system according to claim 7 wherein said descriptions of said geographical regions include geographic coordinates.

11. A system according to claim 7 wherein said descriptions of said geographical regions include a single geographic point which represents the center of a predefined shape of a predefined size.

12. A method for storing and retrieving video data and metadata, the method comprising:

storing a plurality of recorded video portions and metadata describing a plurality of geographical locations and corresponding times at which said video portions were recorded;

querying said video and metadata to identify a plurality of said recorded video portions that correspond to said metadata; and

grouping into a video clip any of said identified video portions together into a video clip that are separated by less than a predefined clip gap.

13. A method according to claim 12 wherein said grouping step comprises grouping where said clip gap is defined as a length of time separating any of said identified video portions and its next nearest identified video portion.

14. A method according to claim 12 wherein said grouping step comprises grouping into said video clip at least two of said identified video portions bounding at least one intermediate video portion not among said identified video portions.

15. A method according to claim 12 wherein said grouping step comprises grouping any of said identified video portions together into a plurality of video clips, and further comprising ranking said video clips according to a relevance measure.

16. A method according to claim 15 wherein said ranking step comprises ranking where said relevance measure is expressed as the number of said identified video portions in any of said clips divided by the total number of video portions in said clip, wherein any of said video clips includes a video portion not among said identified video portions.

17. A method according to claim 12 and further comprising receiving a video data stream of said recorded video portions and a metadata stream of said metadata.

18. A method according to claim 12 wherein said storing step includes storing as said metadata a description of a first geographical region and a first time stamp associated with a first video recording, and of a second geographical region and a second time stamp associated with a second video recording.

19. A method according to claim 17 wherein said receiving step comprises receiving said video data stream from an aerial reconnaissance vehicle performing ground surveillance.

20. A method according to claim 17 wherein said receiving step comprises receiving where said metadata stream is provided in synchrony with said video data stream such that as said metadata are received they describe any of said recorded video portions that are received at the same time.

21. A method according to claim 18 wherein said storing step comprises storing as said metadata descriptions of said geographical regions that include geographic coordinates.

22. A method according to claim 18 wherein said storing step comprises storing as said metadata descriptions of said geographical regions that include a single geographic point which represents the center of a predefined shape of a predefined size.

23. A computer program embodied on a computer-readable medium, the computer program comprising:

a first code segment operative to store a plurality of recorded video portions and metadata describing a plurality of geographical locations and corresponding times at which said video portions were recorded;

a second code segment operative to query said video and metadata to identify a plurality of said recorded video portions that correspond to said metadata; and

a third code segment operative to group into a video clip any of said identified video portions together into a video clip that are separated by less than a predefined minimum clip gap.