Apparatus for automatically generating video highlights and method thereof

• US 8,310,597 B2
• Filed: 02/21/2007
• Issued: 11/13/2012
• Est. Priority Date: 12/28/2001
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Suh, Jong Yeul
• Primary Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US11/677,569
• Publication Number:
  US 20070139566A1
• Time in Patent Office: 2,092 Days
• Field of Search: 348/387, 348/390, 348/395, 348/397, 348/403, 348/411, 348/700, 382/250, 382/252, 382/248, 382/238, 382/298, 382/245, 382/233, 382/235, 382/232, 382/236, 386/46, 386/83, 725/38
• US Class Current: 348/700
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7864 using domain-transform features, e.g. DCT or wavelet transform coefficients
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

The present invention provides an apparatus and method for automatically generating moving picture highlights for video stored in a digital video recorder that detects scene change of stored video, extracts information amount with respect to the relevant video interval on the basis of the scene change detection information, automatically generates moving picture highlights according to moving picture highlight length information set by a user or default value in the system, on the basis of results of the scene change detection and the interval information amount.

Claims

1. A method for generating a highlight from video data in a video system comprising a scene detecting unit and a highlight generator, the method comprising:

dividing, in the scene detecting unit, at least a first scene and a second scene in the video data, wherein a first image is associated with the first scene and a second image is associated with the second scene and at least the first scene or the second scene comprises a reference image; and

generating the highlight for at least the first scene by selecting a plurality of images from the first scene based on an amount of interval data and a user input,

wherein;

the highlight is a moving picture, comprises the selected plurality of images and is generated based on the reference image determined according to the amount of interval data; and

the reference image is one of the selected plurality of images.

2. The method of claim 1, wherein the highlight is recorded in a storage medium.

3. The method of claim 1, wherein the video data is recorded on a storage medium.

4. The method of claim 1, wherein the video data comprises streaming video.

5. The method of claim 1, wherein the highlight for at least the first scene is generated in response to the user input.

6. The method of claim 5, wherein the highlight for at least the first scene is generated exclusive of a highlight for the second scene.

7. The method of claim 6, wherein the amount of interval data and the user input indicate a preferred length of duration for the highlight.

8. The method of claim 1, wherein the at least first scene and second scene are divided by detecting scene change points in the video data.

9. The method of claim 8, wherein the scene change points are detected based on differences between DC images of I-pictures for the plurality of images.

19. The method of claim 1, further comprising:

estimating the amount of interval data for each of the at least first and second scenes,

wherein the highlight is generated based on the reference image corresponding to the at least first scene or second scene having a larger amount of interval data.

20. The method of claim 1, further comprising:

estimating the amount of interval data for each of the at least first and second scenes,

wherein;

the highlight is generated based on at least one of the at least first and second scenes selected according to a degree of importance, and

the degree of importance is determined using the estimated amount of interval data.

21. The method of claim 1, further comprising determining the amount of interval data according to an average value of amounts of information of all images in an interval of the at least first scene or second scene.

24. The method of claim 1, further comprising positioning the reference image at a center of the highlight.

25. The method of claim 1, wherein the reference image has a largest amount of information among the plurality of images of the highlight.

10. A system for generating a highlight from video data, the system comprising:

a scene detector for dividing at least a first scene and a second scene in the video data, wherein a first image is associated with the first scene and a second image is associated with the second scene and at least the first scene or the second scene comprises a reference image; and

a highlight generator for generating the highlight for at least the first scene by selecting a plurality of images from the first scene based on an amount of interval data and a user input,

wherein;

the highlight is a moving picture, comprises the selected plurality of images and is generated based on the reference image determined according to the amount of interval data; and

the reference image is one of the selected plurality of images.

11. The system of claim 10, wherein the highlight is recorded in a storage medium.

12. The system of claim 10, wherein the video data is recorded on a storage medium.

13. The system of claim 10, wherein the video data comprises streaming video.

14. The system of claim 10, wherein the highlight for at least the first scene is generated in response to the user input.

15. The system of claim 14, wherein the highlight for at least the first scene is generated exclusive of a highlight for the second scene.

16. The system of claim 15, wherein the amount of interval data and the user input indicate a preferred length of duration for the highlight.

17. The system of claim 10, wherein the at least first scene and second scene are divided by detecting scene change points in the video data.

18. The system of claim 17, wherein the scene change points are detected based on differences between DC images of I-pictures for the plurality of images.

22. The system of claim 10, wherein the amount of interval data is determined by an average value of amounts of information of all images in an interval of the at least first scene or second scene.

23. The system of claim 10, wherein the highlight is generated using ‘

n’

previous images and ‘

n’

subsequent images of the plurality of images with respect to the reference image.