Recording medium with video index information recorded therein video information management method which uses the video index information, recording medium with audio index information recorded therein, audio information management method which uses the audio index information, video retrieval method which uses video index information, audio retrieval method which uses the audio index information and a video retrieval system

• US 7,277,621 B2
• Filed: 01/30/2004
• Issued: 10/02/2007
• Est. Priority Date: 09/03/1998
• Status: Expired due to Fees

• Current Assignee: Information Broadcasting Laboratories Incorporated, Ricoh Company Limited
• Original Assignee: Information Broadcasting Laboratories Incorporated, Ricoh Company Limited
• Inventors: Iwasaki, Masajiro, Kunieda, Takayuki, Wakita, Yuki
• Primary Examiner(s): Chevalier; Robert
• Application Number:
  US10/766,891
• Publication Number:
  US 20040184774A1
• Time in Patent Office: 1,341 Days
• Field of Search: 386/46, 386/52, 386/55, 386/1, 386/4, 386/68, 386/69, 386/75, 386/96, 386/104, 386/39
• US Class Current: 386/281
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/7343 Query language or query format
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

The video index information has a tree structure comprising frame information, sound information, segment information, and package information each as a structure element object. The segment information manages package information for managing a plurality of other segment information as a group, and in the tree structure, the package information is allocated in addition to the frame information and sound information under one segment information, and the video information is managed by using the tree structure of the video index information and structure element objects therein.

Claims

1. A computer-readable recording medium storing a computer program with video index information generated based on video information recorded therein, the video index information having a tree structure, the computer program including instructions configured to cause a computer to execute a method comprising:

managing a predetermined segment of the video information with first segment information;

managing at least a portion of the predetermined segment of the video information with a plurality of second segment information;

managing the first segment information with first package information; and

configured to collectively managing the plurality of second segment information as a group with second package information, wherein

the first segment information further manages the second package information.

2. The computer-readable recording medium of claim 1, wherein one of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of frame and/or audio data.

3. The computer-readable recording medium of claim 1, wherein each of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of frame and/or audio data.

4. A video information management method, comprising:

analyzing a plurality of frames containing video information;

generating, apart from the video information, video index information; and

retrieving video information in accordance with the generated video index information, wherein

the video index information has a tree structure comprising;

first segment information configured to manage a predetermined segment of the video information;

a plurality of second segment information, each configured to manage at least a portion of the predetermined segment of the video information;

first package information configured to manage the first segment information; and

second package information configured to collectively manage the plurality of second segment information as a group, wherein

the first segment information is further configured to manage the second package information.

5. The method of claim 4, wherein one of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

visible and/or audible selection information.

6. The method of claim 4, wherein one of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

frame information having

a node ID corresponding to a location in said tree structure,

a range of successive frames managed according to the frame information, and

a pointer indicating a position in the video information.

7. The method of claim 4, wherein one of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

sound information having

a node ID corresponding to a location in said tree structure,

a range of successive frames managed according to the frame information, and

a pointer indicating a position in the sound information.

8. The method of claim 4, wherein one of the first segment information and the plurality of second segment information comprises:

a node ID in said tree structure,

identifying information for identifying frame-information, sound information and package information to be managed, and

a pointer to upper package information.

9. The method of claim 4, wherein one of the first package information and the second package information comprises:

a node ID in said tree structure,

identifying information for identifying frame-information, sound information and package information to be managed, and

a pointer to upper package information.

10. The method of claim 4, wherein the video index information comprises:

an attribute object (106) allocated in said tree structure, wherein

the first segment information, the plurality of second segment information, the first package information, and the second package information each comprise;

a pointer to the attribute object (106), and

additional information can be added to one of the first segment information, the plurality of second segment information, the first package information, and the second package information using the attribute object (106) and the pointer to the attribute object (106).

11. The method of claim 4, further comprising:

storing the video index information separately from the video information.

12. A video information management method, comprising:

analyzing a plurality of frames containing video information;

generating, apart from the video information, video index information; and

retrieving video information in accordance with the generated video index information, wherein the video index information comprises;

a tree structure including;

first segment information configured to manage a predetermined segment of the video information;

a plurality of second segment information, each configured to manage at least a portion of the predetermined segment of the video information;

first package information configured to manage the first segment information; and

second package information configured to collectively manage the plurality of second segment information as a group, wherein

the first segment information is further configured to manage the second package information, and

the first and plurality of second segment information is configured to manage a range of successive frames;

a first link list configured to indicate an order for the first and plurality of second segment information;

a plurality of second link lists configured to indicate an order of frame and/or audio data; and

a plurality of view information configured to enable retrieval of the frame and/or audio data.

13. The method of claim 12, further comprising:

specifying particular view information from the plurality of view information; and

making a portion of video information corresponding to the particular view visible and/or audible by using a link list corresponding to the particular view information.

14. The method of claim 12, further comprising:

storing the video index information separately from the video information.

15. A computer-readable recording medium storing a computer program with audio index information generated based on audio information recorded therein, the audio index information having a tree structure, the computer program including instructions configured to cause a computer to execute a method comprising:

managing a predetermined segment of the audio information with first segment information;

managing at least a portion of the predetermined segment of the audio information with a plurality of second segment information;

managing the first segment information with first package information; and

collectively managing the plurality of second segment information as a group with second package information, wherein

the first segment information further manages the second package information.

16. The computer-readable recording medium of claim 15, wherein one of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of sound data.

17. The computer-readable recording medium of claim 15, wherein each of the first segment information, the plurality of second segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of sound data.

18. An audio information management method, comprising:

analyzing a plurality of frames containing audio information;

generating, apart from the audio information, audio index information; and

retrieving video information in accordance with the generated audio index information, wherein

the audio index information has a tree structure comprising;

first segment information configured to manage a predetermined segment of the audio information;

a plurality of second segment information, each configured to manage at least a portion of the predetermined segment of the audio information;

first package information configured to manage the first segment information; and

second package information configured to collectively manage the plurality of second segment information as a group, wherein

the first segment information is further configured to manage the second package information.

19. The method of claim 18, further comprising:

storing the audio index information separately from the audio information.

20. A video information retrieval apparatus, comprising:

a video retrieval tool;

a video information library connected to the video retrieval tool; and

a video index information database connected to the video retrieval tool and including a computer-readable recording medium with video index information having a tree structure comprising;

first segment information configured to manage a predetermined segment of the video information;

a plurality of second segment information, each configured to manage at least a portion of the predetermined segment of the video information;

first package information configured to manage the first segment information; and

second package information configured to collectively manage the plurality of second segment information as a group, wherein

the first segment information is further configured to manage the second package information.

21. A computer-readable recording medium storing a computer program with video index information generated based on video information recorded therein, the video index information having a tree structure, the computer program including instructions configured to cause a computer to execute a method comprising:

managing a first segment of the video information with a first segment information;

managing a plurality of second segments generated as a result of dividing the first segment according to a first algorithm with a plurality of second segment information;

managing the plurality of second segment information with a first package information;

managing a plurality of third segments generated as a result of dividing the first segment according to a second algorithm with a plurality of third segment information; and

managing the plurality of third segment information with a second package information, wherein

the first segment information further manages the first and the second package information collectively as a group.

22. The computer-readable recording medium of claim 21, wherein one of the first segment information, the plurality of second segment information, the first package information, the plurality of third segment information, and the second package information comprises:

retrieval information configured to enable retrieval of frame and/or audio data.

23. The computer-readable recording medium of claim 21, wherein each of the first segment information, the plurality of second segment information, the first package information, the plurality of third segment information, and the second package information comprises:

retrieval information configured to enable retrieval of frame and/or audio data.

24. A video information management method, comprising:

analyzing a plurality of frames containing video information;

generating, apart from the video information, video index information; and

retrieving video information in accordance with the generated video index information, wherein

the video index information has a tree structure comprising;

a first segment information configured to manage a first segment of the video information;

a plurality of second segment information configured to manage a plurality of second segments generated as a result of dividing the first segment according to a first algorithm;

a first package information configured to manage the plurality of second segment information;

a plurality of third segment information configured to manage a plurality of third segments generated as a result of dividing the first segment according to a second algorithm; and

a second package information configured to manage the plurality of third segment information, wherein

the first segment information is further configured to manage the first and the second package information collectively as a group.

25. The method of claim 24, wherein one of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information comprises:

visible and/or audible selection information.

26. The method of claim 24, wherein one of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information comprises:

frame information having

a node ID corresponding to a location in said tree structure,

a range of successive frames managed according to the frame information, and

a pointer indicating a position in the video information.

27. The method of claim 24, wherein one of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information comprises:

sound information having

a node ID corresponding to a location in said tree structure,

a range of successive frames managed according to the frame information, and

a pointer indicating a position in the sound information.

28. The method of claim 24, wherein one of the first segment information and the plurality of second segment information comprises:

a node ID in said tree structure,

identifying information for identifying frame-information, sound information and package information to be managed, and

a pointer to upper package information.

29. The method of claim 24, wherein one of the first package information and the second package information comprises:

a node ID in said tree structure,

identifying information for identifying frame-information, sound information and package information to be managed, and

a pointer to upper package information.

30. The method of claim 24, wherein the video index information comprises:

an attribute object (106) allocated in said tree structure, wherein

the first segment information, the plurality of second segment information, the first package information, and the second package information each comprise;

a pointer to the attribute object (106), and

additional information can be added to one of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information using the attribute object (106) and the pointer to the attribute object (106).

31. The method of claim 24, further comprising:

storing the video index information separately from the video information.

32. A computer-readable recording medium storing a computer program with audio index information generated based on audio information recorded therein, the audio index information having a tree structure, the computer program including instructions configured to cause a computer to execute a method comprising:

managing a first segment of the audio information with a first segment information;

managing a plurality of second segments generated as a result of dividing the first segment according to a first algorithm with a plurality of second segment information;

managing the plurality of second segment information with a first package information;

managing a plurality of third segments generated as a result of dividing the first segment according to a second algorithm with a plurality of third segment information; and

managing the plurality of third segment information with a second package information, wherein

the first segment information further manages the first and the second package information collectively as a group.

33. The computer-readable recording medium of claim 32, wherein one of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of sound data.

34. The computer-readable recording medium of claim 32, wherein each of the first segment information, the plurality of second segment information, the plurality of third segment information, the first package information, and the second package information comprises:

retrieval information configured to enable retrieval of sound data.

35. An audio information management method, comprising:

analyzing a plurality of frames containing audio information;

generating, apart from the audio information, audio index information; and

retrieving video information in accordance with the generated audio index information, wherein

the audio index information has a tree structure comprising;

a first segment information configured to manage a first segment of the audio information;

a plurality of second segment information configured to manage a plurality of second segments generated as a result of dividing the first segment according to a first algorithm;

a first package information configured to manage the plurality of second segment information;

a plurality of third segment information configured to manage a plurality of third segments generated as a result of dividing the first segment according to a second algorithm; and

a second package information configured to manage the plurality of third segment information, wherein

the first segment information is further configured to manage the first and the second package information collectively as a group.

36. The method of claim 35, further comprising:

storing the audio index information separately from the audio information.

37. A video information retrieval apparatus, comprising:

a video retrieval tool;

a video information library connected to the video retrieval tool; and

a video index information database connected to the video retrieval tool and including a computer-readable recording medium with video index information having a tree structure comprising;

a first segment information configured to manage a first segment of the video information;

a plurality of second segment information configured to manage a plurality of second segments generated as a result of dividing the first segment according to a first algorithm;

a first package information configured to manage the plurality of second segment information;

a plurality of third segment information configured to manage a plurality of third segments generated as a result of dividing the first segment according to a second algorithm; and

a second package information configured to manage the plurality of third segment information, wherein

the first segment information is further configured to manage the first and the second package information collectively as a group.