Video cataloger system with hyperlinked output

• US 6,567,980 B1
• Filed: 08/14/1998
• Issued: 05/20/2003
• Est. Priority Date: 08/14/1997
• Status: Expired due to Fees

• Current Assignee: Virage, Inc. (HP Inc.)
• Original Assignee: Virage, Inc. (HP Inc.)
• Inventors: Horowitz, Bradley, Jain, Ramesh, Portuesi, Michael J., Gupta, Amarnath, Shu, Chiao-fe, Humphrey, Richard D., Bach, Jeffrey, Hampapur, Arun, Fuller, Charles, Gorkani, Mojgan Monika
• Primary Examiner(s): Faile, Andrew
• Assistant Examiner(s): VU, NGOC K
• Application Number:
  US09/134,499
• Time in Patent Office: 1,740 Days
• Field of Search: 348/10, 709/219, 707/10, 707/103, 707/104, 707/501, 707/501.1, 707/104.1, 725/51, 725/52, 725/61, 345/723
• US Class Current: 725/61
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

One aspect of the invention is directed to a system and method for video cataloging. The video is cataloged according to predefined or user definable metadata. The metadata is used to index and then retrieve encoded video. In another aspect of the invention, video metadata track processors convert metadata tracks of the video information to produce displayable frames containing hyperlinking between displayable data. Another aspect of the invention is directed to a method of browsing stored video information, including displaying hyperlinked frames of metadata track representations, and selecting and displaying links between displayable frames.

Claims

1. A video cataloging output filter, comprising:

a plurality of metadata track processors each generating a distinct type of metadata, wherein each processor converts at least one type of metadata representation of video information into a displayable frame and wherein at least one of the plurality of metadata track processors hyperlinks one type of metadata presented in the displayable frame with another type of metadata displayable in another frame provided by another metadata track processor; and

a main frame processor incorporating the displayable frames of metadata into a displayble page.

2. The filter of claim 1, additionally comprising a session level frame processor converting session level metadata to a displayable frame which is hyperlinked via another frame.

3. The filter of claim 1, wherein the metadata representations include at least one of:

keyframe, close caption and clip.

4. The filter of claim 1, wherein the displayable frame is coded in HTML format.

5. The filter of claim 1, wherein the displayable frames are linked with video information stored in a file system.

6. The filter of claim 1, wherein the displayable frames are linked in with video information communicated in a stream format.

7. The filter of claim 1, additionally comprising a processor capable of converting keyframes to JPEG image files, and wherein one of the metadata track processors converts a keyframe metadata track and links the keyframe metadata track to the JPEG image files.

8. A method of browsing stored video information, comprising:

displaying a page of hyperlinked metadata within frames, each displayable frame being indicative of a distinct type of metadata representation of stored video information;

selecting a link from one type of metadata presented in the displayable frame to another type of metadata displayable in another frame;

selecting for display a portion of the video information based on the metadata in one of the displayable frames;

retrieving video information stored as encoded digital data which corresponds to the selected portion of video information; and

displaying the retrieved video information.

9. The method of claim 8, wherein the encoded digital video data and the displayable frames are stored in a common file system.

10. The method of claim 8, wherein the retrieving of encoded digital video data comprises receiving a video data stream from a video content server.

11. The method of claim 8, wherein the video content server is remotely located and connected via the Internet.

12. A video cataloging output subsystem, comprising:

a plurality of metadata track generators, wherein each generator generates a distinct type of metadata representation of video information;

a plurality of metadata track processors, wherein each metadata track processor converts at least one type of metadata representation of the video information into a displayable frame, and wherein at least one of the plurality of metadata track processors hyperlinks one type of metadata presented in the displayable frame with another type of metadata displayable in another frame provided by another metadata track processor; and

a main frame processor incorporating the displayable frames of metadata into a displayable main fame.

13. The subsystem of claim 12, wherein the metadata is hyperlinked based on time-codes corresponding to the video.

14. The subsystem of claim 12, wherein the displayable main frame is displayed in a browser window.

15. The subsystem of claim 12, wherein the displayable frames are linked with video information stored in a file system.

16. The subsystem of claim 12, wherein the displayable frames are linked with video information communicated in a stream format.

17. The subsystem of claim 12, additionally comprising a video player for playing retrieved video information corresponding to a portion of the video information selected based on data in a metadata track.

18. The subsystem of claim 17, wherein the video information is stored as encoded digital data.

19. A system for browsing stored video information, comprising:

means for displaying a page of hyperlinked metadata within frames, each displayable frame being indicative of a distinct type of metadata representation of stored video information;

means for selecting a link from one type of metadata presented in the displayable frame to another type of metadata displayable in another frame;

means for selecting for display a portion of the video information based on the metadata in one of the displayable frames;

means for retrieving video information stored as encoded digital data which corresponds to the selected portion of video information; and

means for displaying the retrieved video information.

20. The system of claim 19, wherein the encoded digital video data and the displayable frames are stored in a common file system.

21. The system of claim 19, wherein the means for retrieving of encoded digital video data comprises means for receiving a video data stream from a video content server.

22. The system of claim 21, wherein the video content server is remotely located and connected via the Internet.

23. The system of claim 19, wherein the link from one frame to another frame is within the page.