Integrated data and real-time metadata capture system and method

• US 6,877,134 B1
• Filed: 07/29/1999
• Issued: 04/05/2005
• Est. Priority Date: 08/14/1997
• Status: Expired due to Term

• Current Assignee: Micro Focus LLC (Open Text Corporation)
• Original Assignee: Virage, Inc. (HP Inc.)
• Inventors: Fuller, Charles, Humphrey, Richard D., Gorkani, Mojgan Monika
• Primary Examiner(s): Shah, Sanjiv
• Application Number:
  US09/363,974
• Time in Patent Office: 2,077 Days
• Field of Search: 715/500.1, 715/501.1, 707/104.1, 345/72.3
• US Class Current: 715/202
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

One aspect of the invention is directed to a system and method for a digital capture system, such as a digital encoder, having an embedded real-time content-based analysis function in the capture device to extract metadata from the digital signals. In one embodiment, metadata (descriptive information about the digital content) is formatted and stored separately from the content. In another embodiment, the metadata may be formatted and combined with the digital content in a container format such as MPEG-7, QuickTime, or FlashPix. Digital encoding mechanisms, both pure hardware and hardware/software combinations, convert an analog video signal into a digitally encoded video bitstream. The system extracts metadata in real-time during the encoding process.

Claims

1. An integrated data and real-time metadata capture system, comprising:

a digital capture device producing a digital representation of one or more forms of media content;

a feature extraction engine in direct digital data communication with the digital capture device, the feature extraction engine having a plurality of feature extractors to automatically extract metadata in real-time from the digital content simultaneously with the capture of the content, wherein the plurality of feature extractors extract a plurality of metadata types; and

a storage device capable of storing the media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the media content.

2. The system defined in claim 1, additionally comprising at least one collateral metadata source.

3. The system defined in claim 2, wherein the collateral metadata source includes at least one of the following:

user input, device properties, and external sensors.

4. The system defined in claim 1, additionally comprising an output interface in data communication with the storage device and generating output data, wherein the output interface is capable of preserving a temporal relationship between the metadata and the digital content.

5. The system defined in claim 4, wherein the digital capture device comprises a digital video encoder including an audio capture capability.

6. The system defined in claim 5, wherein an input data stream to the digital video encoder comprises an analog stream.

7. The system defined in claim 6, wherein the analog stream comprises one of the following stream types:

NTSC, PAL, SECAM, S-Video, or component video.

8. The system defined in claim 5, wherein the digital video encoder comprises a hardware encoder.

9. The system defined in claim 8, wherein the hardware encoder is configured for an MPEG format.

10. The system defined in claim 5, wherein the digital video encoder comprises a hardware digitizer and a software encoder.

11. The system defined in claim 5, wherein the feature extraction engine generates a plurality of time-based tracks of metadata that index the audio content and the video content.

12. The system defined in claim 11, wherein the output data comprises an MPEG-7 digital video file containing the plurality of metadata tracks as embedded metadata within an MPEG-7 metadata framework.

13. The system defined in claim 1, wherein the feature extraction engine is integrated with the digital capture device in a common enclosure.

14. The system defined in claim 1, wherein the digital capture device is configured to encode the digital representation of one or more forms of media content.

15. The system defined in claim 1, wherein the digital capture device is configured to add time codes to the digital representation of one or more forms of media content.

16. The system defined in claim 15, wherein selected portions of the metadata are associated with selected portions of the media content via the time codes.

18. The method defined in claim 7, wherein automatically extracting metadata in real-time includes extracting a plurality of feature vectors from the digital media content.

17. An integrated data and real-time metadata capture method, comprising:

receiving analog signals;

converting the analog signals to a digital representation of one or more forms of media content;

encoding the digital media content;

automatically extracting a plurality of metadata types in real-time from the digital media content simultaneously with the encoding of the digital media content, wherein the digital media content is directly communicated for the automatically extracting; and

storing the encoded digital media content and the metadata, wherein selected portions of the metadata are associated with selected portions of the encoded digital media content.

19. The method defined in claim 17, wherein automatically extracting the plurality of metadata types in real-time comprises extracting the plurality of metadata types via a plurality of feature extractors.