System and method for creation of video annotations

• US 20040221227A1
• Filed: 04/30/2003
• Published: 11/04/2004
• Est. Priority Date: 04/30/2003
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Wu, Peng
• Granted Patent: US 7,334,186 B2
• Time in Patent Office: Days
• US Class Current: 715/512
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

A system and method for annotating a video data stream integrates geographic location data into the video data stream. A site name is mapped from the geographic location data, and the site name is automatically assigned as a text label to the associated portion of the video data stream.

Claims

1. A method for annotating a video data stream, at least one portion of the video data stream having associated geographic location data, the method comprising:

creating a video document by integrating geographic location data into the video data stream;

mapping a site name from the geographic location data; and

automatically assigning the site name as a text label to the at least one portion of the video data stream.

2. The method of claim 1, wherein the at least one portion corresponds to a plurality of video sequences, and wherein creating a video document further comprises integrating geographic data associated with each video sequence into the video data stream, and wherein automatically assigning further comprises automatically assigning the site name as a text label to each video sequence.

3. The method of claim 1, further comprising extracting a plurality of keyframes from the video data stream, each keyframe having associated geographic location data, and wherein automatically assigning further comprises automatically assigning the site name as a text label to each keyframe.

4. The method o f claim 1, wherein mapping the geographic location data further comprises translating the geographic location data to map location data and extracting the site name from the map location.

5. A method for creating a text label for a video sequence comprising:

integrating geographic location data into a video data stream;

determining a site name using the geographic location data; and

using the site name as a text label for the video sequence.

6. The method of claim 5, further comprising extracting at least one keyframe from the video data stream.

7. The method of claim 5, wherein determining a site name using the geographic location data includes providing the geographic location data to a mapping application.

8. The method of claim 5, further comprising interfacing a video camera with a global positioning system receiving device to provide geographic location data to the video data stream.

9. The method of claim 5, wherein integrating geographic location data includes recording latitude and longitude data in the video data stream.

10. The method of claim 5, wherein integrating geographic location data includes manually entering geographic location data into the video data stream.

11. The method of claim 5, wherein integrating geographic location data includes automatically entering geographic location data into the video data stream.

12. The method of claim 5, wherein integrating geographic location data comprises continuously integrating geographic location data into the video data stream.

13. A method for creating a summarization of a video document comprising:

extracting a plurality of keyframes from video data having associated geographic location data;

determining a site name for each of the extracted keyframes using the associated geographic location data; and

annotating the extracted keyframes with the corresponding site name.

14. The method of claim 13, further comprising:

recording a video data stream; and

integrating geographic location data into the video data stream during recording.

15. The method of claim 14, wherein integrating geographic location data into the video data stream during recording includes integrating geographic location data continuously into the video data stream.

16. The method of claim 14, wherein integrating geographic location data into the video data stream during recording includes integrating geographic location data intermittently into the video data stream.

17. The method of claim 14, wherein integrating geographic location data into the video data stream during recording includes:

receiving a GPS signal from a GPS satellite; and

calculating a geographic location from the GPS signal.

18. The method of claim 13, wherein determining a site name using the geographic location data includes providing the geographic location data to a mapping application.

19. A video summarization and annotation system comprising:

a processor for extracting a plurality of keyframes from a video document having geographic location data integrated into the video document, and for mapping a site name for each keyframe using the integrated geographic location data;

a data storage system in communication with the processor for storing the extracted keyframes and corresponding site names as a video summary; and

a display device for displaying the video summary.

20. The system of claim 19, further comprising:

a video camera; and

a global positioning system communicating with the video camera and providing geographic location data to the video camera.

21. The system of claim 19, wherein the data storage system includes a DVD disc, a hard disc drive, or other persistent storage device.

22. The system of claim 19, wherein the display device comprises a video monitor.

23. A computer readable medium containing instructions for controlling a computer system to perform a method for annotating a video summarization comprising:

extracting a plurality of keyframes from a video data stream having geographic location data integrated in the video data stream;

mapping a site name for each of the extracted keyframes using the geographic location data; and

annotating the extracted keyframes with the corresponding site name.

24. The method of claim 23, wherein mapping a site name using the geographic location data includes providing the geographic location data to a mapping application.