Apparatus for automatically generating video highlights and method thereof

• US 8,243,203 B2
• Filed: 02/21/2007
• Issued: 08/14/2012
• Est. Priority Date: 12/28/2001
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Suh, Jong Yeul
• Primary Examiner(s): SENFI, BEHROOZ M
• Application Number:
  US11/677,570
• Publication Number:
  US 20070146549A1
• Time in Patent Office: 2,001 Days
• Field of Search: 348/387, 348/390, 348/395, 348/397, 348/403, 348/411, 348/700, 348/669, 382/250, 382/252, 382/248, 382/238, 382/298, 382/245, 382/233, 382/235, 382/232, 382/236, 386/46, 386/83, 725/38
• US Class Current: 348/700
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7864 using domain-transform features, e.g. DCT or wavelet transform coefficients
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/147 Scene change detection
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

The present invention provides an apparatus and method for automatically generating moving picture highlights for video stored in a digital video recorder that detects scene change of stored video, extracts information amount with respect to the relevant video interval on the basis of the scene change detection information, automatically generates moving picture highlights according to moving picture highlight length information set by a user or default value in the system, on the basis of results of the scene change detection and the interval information amount.

Claims

1. A method for generating a video highlight from video data in a video system comprising a video segment detecting unit and a highlight generator, the method comprising:

dividing in the video segment detecting unit the video data into at least a first video segment and a second video segment, wherein a first image is associated with the first video segment and a second image is associated with the second video segment; and

generating the video highlight by selecting a plurality of images from at least one of the first video segment and the second video segment based on an amount of interval data, wherein the video highlight comprises the plurality of images and is generated based on a reference image determined according to the amount of interval data.

2. The method of claim 1, wherein the video data comprises video data recorded on a storage medium.

3. The method of claim 1, wherein the video data comprises streaming video.

4. The method of claim 1, wherein the video highlight is stored in a storage medium.

5. The method of claim 1, further comprising generating the second image in the second video segment after the first image in the first video segment.

6. The method of claim 1, wherein the video highlight is further generated from images in at least one of the first video segment and the second video segment selected based on importance.

7. The method of claim 1, wherein the video highlight is further generated from images in at least one of the first video segment and the second video segment that have a first level of importance.

8. The method of claim 1, wherein the video highlight excludes images in at least one of the first video segment and the second video segment that are not associated with a first level of importance.

9. The method of claim 1, wherein the at least the first video segment and the second video segment are divided based on scene change points in the video data.

10. The method of claim 1, wherein the plurality of images are selected based on a user input providing a preferred length for a duration of the video highlight comprising the plurality of images and the amount of interval data.

21. The method of claim 1, further comprising estimating the amount of interval data for each of the at least first and second video segments, wherein the reference image is determined according to the first or second video segment having a greater amount of interval data.

22. The method of claim 1, further comprising estimating the amount of interval data for each of the at least first and second video segments,

wherein the video highlight is further generated based on at least the first or second video segments selected according to a degree of importance determined using the estimated amount of interval data.

23. The method of claim 1, wherein the amount of interval data is determined by an average value of amounts of information of all images in an interval of the at least first or second video segment.

26. The method of claim 1, wherein the reference image is positioned at a center of the video highlight.

27. The method of claim 1, wherein the reference image comprises a largest amount of information among the plurality of images.

11. A system for generating a video highlight from video data, the system comprising:

a segment detector for dividing the video data into at least a first video segment and a second video segment prior to generating the video highlight, wherein a first image is associated with the first video segment and a second image is associated with the second video segment; and

a highlight generator for generating the video highlight by selecting a plurality of images from at least one of the first video segment and the second video segment based on an amount of interval data, wherein the video highlight comprises the plurality of images and is generated based on a reference image determined according to the amount of interval data.

12. The system of claim 11, wherein the video data comprises video data recorded on a storage medium.

13. The system of claim 11, wherein the video data comprises streaming video.

14. The system of claim 11, wherein the video highlight is stored in a storage medium.

15. The system of claim 11, further comprising generating the second image in the second video segment after the first image in the first video segment.

16. The system of claim 11, wherein the video highlight is further generated from images in at least one of the first video segment and the second video segment selected based on importance.

17. The system of claim 11, wherein the video highlight is further generated from images in at least one of the first video segment and the second video segment that have a first level of importance.

18. The system of claim 11, wherein the video highlight excludes images in at least one of the first video segment and the second video segment that are not associated with a first level of importance.

19. The system of claim 11, wherein the at least the first video segment and the second video segment are divided based on scene change points in the video data.

20. The system of claim 11, wherein the plurality of images are selected based on a user input providing a preferred length for a duration of the video highlight.

24. The system of claim 11, wherein the amount of interval data is determined by an average value of amounts of information of all images in an interval of the at least first or second video segment.

25. The system of claim 11, wherein the video highlight is generated using ‘

n’

previous images and ‘

n’

subsequent images of the plurality of images with respect to the reference image.

28. The system of claim 11, wherein the reference image is one of the plurality of images.