Apparatus for automatically generating video highlights and method thereof

• US 7,199,841 B2
• Filed: 12/24/2002
• Issued: 04/03/2007
• Est. Priority Date: 12/28/2001
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Suh, Jong Yeul
• Primary Examiner(s): Vo; Tung
• Assistant Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US10/328,990
• Publication Number:
  US 20030126604A1
• Time in Patent Office: 1,561 Days
• Field of Search: 348/387, 348/390, 348/395, 348/397, 348/403, 348/411, 348/700, 382/250, 382/252, 382/248, 382/238, 382/298, 382/245, 382/233, 382/235, 382/232, 382/236, 386/46, 386/83, 725/38
• US Class Current: 348/700
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7864 using domain-transform features, e.g. DCT or wavelet transform coefficients
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

The present invention provides an apparatus and method for automatically generating moving picture highlights for video stored in a digital video recorder that detects scene change of stored video, extracts information amount with respect to the relevant video interval on the basis of the scene change detection information, automatically generates moving picture highlights according to moving picture highlight length information set by a user or default value in the system, on the basis of results of the scene change detection and the interval information amount.

Claims

1. An apparatus for automatically generating video highlights comprising:

a scene change detecting means for detecting a scene change point of a stored digital video;

an interval information amount estimating means for estimating interval information amount for a predetermined interval on the basis of detected scene change points; and

a highlight generating means for generating moving picture highlights according to the estimated interval information amount and predetermined moving picture highlight length information;

wherein the highlight generating means generates more than one primary scene for highlights according to the estimated interval information amount, wherein in case of generating highlights using M primary scenes, the moving picture amount on the basis of each primary scene is a value that the highlight length is divided by M.

2. The apparatus according to claim 1, wherein the scene change detecting means detects whether scene change occurs using I-picture of an input image.

3. The apparatus according to claim 2, wherein the scene change detecting means detects whether scene change occurs by parsing an only DC value of I-picture of an input image.

4. The apparatus according to claim 1, wherein the scene change detecting means derives a histogram error between a current image and a previous image by using a mapping table for each pixel value of histogram bin between I-picture frames.

5. The apparatus according to claim 1, wherein the scene change detecting means determines the scene change by judging a histogram error range of a current image and a previous image between I-picture frames derived from the scene change detecting means.

6. The apparatus according to claim 1, wherein the interval information amount estimating means estimates interval information amount by reflecting average of information amount of a frame belonging to a predetermined interval divided on the basis of a scene change point.

7. The apparatus according to claim 1, wherein the interval information amount estimating means uses information amount of each scene as a criterion for computing importance of each scene.

8. The apparatus according to claim 7, wherein the interval information amount estimating means estimates information amounts for frame and the relevant scene interval by using a value proportional to bit numbers for each frame, not by computing the bit numbers for the frame upon estimation of information amount of each scene.

9. The apparatus according to claim 8, wherein as a criterion for estimating information amount of each scene interval, a vbv_delay coded by 16 bits in picture head of each frame is used.

10. The apparatus according to claim 1, wherein the highlight generating means generates highlights for a scene having high importance estimated by the interval information amount estimating means.

11. The apparatus according to claim 1, wherein the highlight generating means generates moving picture highlights according to a length set by a user or a default value by selecting a predetermined interval including a highlight reference scene set by the estimated interval information amount.

12. A method for automatically generating video highlights comprising:

dividing digital video into intervals of a scene unit by detecting scene change point of stored digital video;

estimating information amount for each divided interval in order to determine importance of a scene;

selecting a reference scene to be included in highlights according to an estimated interval information amount; and

generating moving picture highlights by including video stream of a predetermined interval having a reference scene according to a selected reference scene;

wherein the stop of generating moving picture highlights generates more than one primary scene for highlights according to the estimated information amount, wherein in case of generating highlights using M primary scenes, the moving picture amount on the basis of each primary scene is a value that the highlight length is divided by M.

13. The method according to claim 12, wherein information for the interval of scene unit provided for estimation of the information amount is a frame list constructing each scene.

14. The method according to claim 12, wherein the scene change is detected for only DC image of I-picture.

15. The method according to claim 12, wherein the scene change is determined as one among a gradual scene change, an abrupt scene change (hard cut), or no scene change depending on histogram error amount between adjacent frames.

16. The method according to claim 14, wherein in case that the gradual scene change continues, the first gradual scene change is only considered, and it is regarded that there is no scene change for subsequent gradual scene changes after that.

17. The method according to claim 12, wherein the step of generating moving picture highlights is performed in such a way that a scene of high importance is preferentially included in highlights on the basis of the estimated information amount.

18. The method according to claim 12, wherein the step of generating moving picture highlights is performed in such a way that predetermined number of scenes before and after a scene whose estimated information is largest are used in generating highlights.

19. The method according to claim 17, wherein highlights are generated by using the previous n scenes and subsequent n scenes on the basis of a reference scene S_optimal, wherein n is a maximum value within a range not exceeding a highlight length.