Video database indexing and method of presenting video database index to a user

• US 5,485,611 A
• Filed: 12/30/1994
• Issued: 01/16/1996
• Est. Priority Date: 12/30/1994
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Astle, Brian
• Primary Examiner(s): Kulik, Paul V.
• Application Number:
  US08/366,807
• Time in Patent Office: 382 Days
• Field of Search: 395/600, 395/153, 364/514, 360/72.1, 360/72.2, 348/563, 348/564, 382/236, 345/115, 345/119
• US Class Current: 1/1
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/213 Read-only discs
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/41 Flat as opposed to hierarchical combination, e.g. library of tapes or discs, CD changer, or groups of record carriers that together store one title
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/024 on tapes G11B27/028, G11B27/029 take precedence
• CPC Class Codes: G11B 27/032 on tapes G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/326 used signal is a video-frame or a video-field (P.I.P.)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A computer-implemented method for generating a video database index for indexing a video database comprising a plurality of video frames, the video database index comprising a plurality of index frames, wherein each video frame within the video database has a unique location within the video database. According to a preferred embodiment of the invention, the video frames of the video database are transmitted to a processor. A processor generates the index frames of the video database index in accordance with the amount of change occurring in images depicted by the video frames of the video database. Each of the index frames represents a unique video sequence of a plurality of video sequences that constitute the video database. Each video sequence comprises a sequence of video frames of the video database. Also, each video sequence has a unique location within the video database.

Claims

1. A computer-implemented method for generating a video database index for indexing a video database comprising a plurality of video frames, the video database index comprising a plurality of index frames, wherein each video frame within the video database has a unique location within the video database, the method comprising the steps of:

(a) transmitting the video frames of the video database to a processor; and

(b) generating with the processor the index frames of the video database index in accordance with the amount of change occurring in images depicted by the video frames of the video database;

wherein;

each of the index frames represents a unique video sequence of a plurality of video sequences that constitute the video database;

each video sequence comprises a sequence of video frames of the video database; and

each video sequence has a unique location within the video database.

2. The method of claim 1, wherein each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame.

3. The method of claim 1, wherein some video sequences of the plurality of video sequences may comprise a plurality of video subsequences.

4. The method of claim 1, wherein each video sequence of the plurality of video sequences represents a scene, wherein the scene represented by a given video sequence of the sequential plurality of video sequences differs by a predetermined threshold amount from scenes represented by video sequences adjacent to the given video sequence.

5. The method of claim 1, wherein step (b) comprises the steps of:

(1) detecting a scene cut between sequences of video frames of the video database;

(2) selecting a first reference frame of the video database index after a detected scene cut;

(3) determining the difference between subsequent video frames and the first reference frame;

(4) selecting a second reference frame when a predetermined threshold difference is determined between the second reference frame and the first reference frame and defining a defined video sequence comprising the plurality of video frames from the first reference frame to the second reference frame;

(5) generating an index frame representative of the defined video sequence; and

(6) selecting a subsequent first reference frame to generate index frames for subsequent video sequences.

6. The method of claim 5, wherein:

step (b)(1) comprises the step of detecting a second predetermined threshold difference or scene fade between sequences of video frames of the video database; and

step (b)(2) further comprises the step of detecting transition frames and excluding the transition frames from being selected as a first reference frame.

7. The method of claim 6, wherein step (b)(3) comprises the step of determining the motion-compensated difference between subsequent video frames and the first reference frame.

8. The method of claim 6, wherein step (b)(3) comprises the step of determining the difference between subsequent video frames and the first reference frame, wherein motion, panning, and zooms are taken into account.

9. The method of claim 6, wherein the index frame comprises one of the video frames of the video sequence comprising the plurality of video frames from the first reference frame to the second reference frame.

10. The method of claim 9, wherein the index frame comprises a difference-centered video frame of the video sequence comprising the plurality of video frames from the first reference frame to the second reference frame.

11. The method of claim 1, further comprising the step of:

(c) detecting scene cuts between sequences of video frames of the video database; and

(d) defining a video shot as comprising a plurality of sequential video frames between two consecutive scene cuts;

wherein each video sequence of the plurality of video sequences comprises a video shot.

12. The method of claim 11, wherein each index frame of the video database index comprises a difference-centered video frame of a unique video shot of the video database.

13. The method of claim 1, further comprising the step of:

(c) storing each index frame of the video database index in a mass storage device.

14. The method of claim 13, further comprising the step of:

(d) displaying a predetermined number of index frames of the video database index in parallel on a monitor; and

(e) updating at a predetermined frequency the predetermined number of index frames displayed in parallel on the monitor.

15. The method of claim 14, wherein:

the predetermined number and predetermined frequency may be varied by a user; and

each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame; and

further comprising the step of;

(f) displaying the location of a video sequence corresponding to an index frame selected by the user.

16. The method of claim 1, further comprising the step of:

(c) displaying a predetermined number of index frames of the video database index in parallel on a monitor; and

(d) updating at a predetermined frequency the predetermined number of index frames displayed in parallel on the monitor.

17. The method of claim 16, wherein:

the predetermined number and predetermined frequency may be varied by a user; and

each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame; and

further comprising the step of;

(e) displaying the location of a video sequence corresponding to an index frame selected by the user.

18. A method of presenting a video database index to a user, the video database index comprising a plurality of index frames and corresponding to a video database, wherein each index frame of the video database index represents a video sequence of a plurality of video sequences of the video database, the method comprising the steps of:

(a) displaying a predetermined number of index frames of the video database index in parallel on a monitor; and

(b) updating at a predetermined frequency the predetermined number of index frames displayed in parallel on the monitor.

19. The method of claim 18, wherein:

the predetermined number and predetermined frequency may be varied by a user; and

further comprising the step of;

(c) displaying on the monitor the location of a video sequence corresponding to an index frame selected by the user.

20. An apparatus for generating a video database index for indexing a video database comprising a plurality of video frames, the video database index comprising a plurality of index frames, wherein each video frame within the video database has a unique location within the video database, the apparatus comprising:

(a) a processor and means for transmitting the video frames of the video database to the processor; and

(b) means for generating with the processor the index frames of the video database index in accordance with the amount of change occurring in images depicted by the video frames of the video database;

wherein;

each of the index frames represents a unique video sequence of a plurality of video sequences that constitute the video database;

each video sequence comprises a sequence of video frames of the video database; and

each video sequence has a unique location within the video database.

21. The apparatus of claim 20, wherein each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame.

22. The apparatus of claim 20, wherein each video sequence of the plurality of video sequences represents a scene, wherein the scene represented by a given video sequence of the sequential plurality of video sequences differs by a predetermined threshold amount from scenes represented by video sequences adjacent to the given video sequence.

23. The apparatus of claim 20, wherein means (b) comprises:

(1) means for detecting a scene cut between sequences of video frames of the video database;

(2) means for selecting a first reference frame of the video database index after a detected scene cut;

(3) means for determining the difference between subsequent video frames and the first reference frame;

(4) means for selecting a second reference frame when a predetermined threshold difference is determined between the second reference frame and the first reference frame and defining a defined video sequence comprising the plurality of video frames from the first reference frame to the second reference frame;

(5) means for generating an index frame representative of the defined video sequence; and

(6) means for selecting a subsequent first reference frame to generate index frames for subsequent video sequences.

24. The apparatus of claim 23, wherein:

means (b)(1) comprises means for detecting a second predetermined threshold difference or scene fade between sequences of video frames of the video database; and

means (b)(2) further comprises means for detecting transition frames and excluding the transition frames from being selected as a first reference frame.

25. The apparatus of claim 24, wherein means (b)(3) comprises means for determining the motion-compensated difference between subsequent video frames and the first reference frame.

26. The apparatus of claim 24, wherein means (b)(3) comprises means for determining the difference between subsequent video frames and the first reference frame, wherein motion, panning, and zooms are taken into account.

27. The apparatus of claim 24, wherein the index frame comprises one of the video frames of the video sequence comprising the plurality of video frames from the first reference frame to the second reference frame.

28. The apparatus of claim 27, wherein the index frame comprises a difference-centered video frame of the video sequence comprising the plurality of video frames from the first reference frame to the second reference frame.

29. The apparatus of claim 20, further comprising:

(c) means for detecting scene cuts between sequences of video frames of the video database; and

(d) means for defining a video shot as comprising a plurality of sequential video frames between two consecutive scene cuts;

wherein each video sequence of the plurality of video sequences comprises a video shot.

30. The apparatus of claim 29, wherein each index frame of the video database index comprises a difference-centered video frame of a unique video shot of the video database.

31. The apparatus of claim 20, further comprising:

(c) a mass storage device for storing each index frame of the video database index.

32. The apparatus of claim 31, further comprising:

(d) a monitor and means for displaying a predetermined number of index frames of the video database index in parallel on the monitor; and

(e) means for updating at a predetermined frequency the predetermined number of index frames displayed in parallel on the monitor.

33. The apparatus of claim 32, wherein:

the predetermined number and predetermined frequency may be varied by a user; and

each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame; and

further comprising;

(f) means for displaying on the monitor the location of a video sequence corresponding to an index frame selected by the user.

34. The apparatus of claim 20, further comprising:

(c) a monitor and means for displaying a predetermined number of index frames of the video database index in parallel on the monitor; and

(d) means for updating at a predetermined frequency the predetermined number of index frames displayed in parallel on the monitor.

35. The apparatus of claim 34, wherein:

the predetermined number and predetermined frequency may be varied by a user; and

each index frame of the video database index further comprises information corresponding to the location of the respective video sequence represented by each index frame; and

further comprising;

(e) means for displaying on the monitor the location of a video sequence corresponding to an index frame selected by the user.