Video summary service apparatus and method of operating the apparatus

• US 20070124679A1
• Filed: 07/11/2006
• Published: 05/31/2007
• Est. Priority Date: 11/28/2005
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Sang, Jeong, Jin, Kim, Hyoung, Hwang, Doo, Moon, Young, Eom, Ki, Kim, Ji, Jung, Cheol
• Application Number:
  US11/483,847
• Publication Number:
  US 20070124679A1
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/44029 for generating different versions
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

The invention provides a video summary service providing apparatus and method, and more particularly, provides a video summary service providing apparatus and method in which a summary image of a video is generated by considering a resources state of a device for summarizing the video and an expected replay time used in summarizing desired by the user, and the generated summary image, prepared to be suitable for a replay time desired by the user, is provided to the user.

Claims

1. A video summary service providing method of preparing a summary video of a video, the method comprising:

dividing the video into at least one individual image by detecting a shot change of the video;

computing a detection time used in detecting the at least one individual image in which an event occurs, from the at least one individual image, for each event using at least a video summary algorithm;

computing an event significance of each of the at least one event according to the detection time;

selecting a K number of the events from the at least one event according to the event significance, the detection time, and/or the expected replay time;

computing an individual image significance for each of the at least one individual image by using the selected K number of the events, wherein K is a positive integer and;

generating a summary image the individual images according to the computed individual image significance.

2. The method of claim 1, wherein at least the one video summary algorithm is stored in a memory.

3. The method of claim 1, further comprises

inputting an expected replay time used in generating the summary video from a user.

4. The method of claim 1, wherein:

the at least one individual image includes a key frame; and

in the computing a detection time used in detecting the individual image in which an event occurs from the at least one individual image, the detection time is computed by computing a time used in detecting whether the each event occurs in each of the key frame.

5. The method of claim 4, wherein the computing a detection time used in detecting the individual image in which an event occurs from the at least one individual image comprises:

detecting resources of a summary video generation apparatus replaying the video;

detecting the time used in detecting whether one event occurs in one frame by the summary video generation apparatus according to the resource; and

computing the detection time by multiplying a total number of the key frames by the computed time used in detecting whether the each event occurs in each of the key frame.

6. The method of claim 1, wherein:

the at least one video summary algorithm includes an event confidence level and an event importance level with respect to each of the at least one event; and

in the computing an event significance according to the detection time, with respect to the each event;

a first value is computed by dividing a value, computed by subtracting the detection time from the expected replay time, by the expected replay time; and

the event significance is computed by multiplying the first value by the event confidence level and the event importance level.

7. The method of claim 6, wherein, when the expected replay time is not more than the detection time, the first value is set to 0.

8. The method of claim 1, wherein the selecting aK number of the at least one event according to the event significance, the detection time, and the expected replay time comprises:

sequentially sorting the at least one event according to an order of high event significance;

adding the detection time of the each event according to the sorted order to be compared with the expected replay time; and

as a result of the comparing, when the detection times computed by adding to a K+1th event is more than the expected replay time, selecting the events up through a Kth event.

9. The method of claim 1, further comprising:

maintaining a memory in which an event return value table including an event return value corresponding to the each event included in the each video summary algorithm is stored;

computing a relative value for each of the selected K number of events;

receiving preference event information with respect to the video from the user; and

computing a weight of the each event by using one of the relative value of the event and the preference event information, and

in the computing an individual image significance for each of the at least one individual image by using the selected K number of the events, with respect to one individual image,

a second value corresponding to the each event is computed by multiplying the event return value corresponding to the each event by an event weight from the K number of the events; and

the individual image significance with respect to the individual image is computed by adding up the second value corresponding to the each of the K number of the events.

10. The method of claim 1, wherein the generating a summary image by sequentially sorting the individual images according to the computed individual image significance comprises:

receiving an expected replay time with respect to the summary image from the user;

extracting the summary image corresponding to the expected replay time from the sorted individual images; and

replaying the extracted summary image via a predetermined display.

11. The method of claim 1, wherein:

the video and the summary image are replayed or recorded via a predetermined video summary service apparatus; and

the video summary service apparatus is one of personal video recorder, a home server, a smart mobile server, a DVD player/recorder, a PC, a notebook PC, a PDA, and a mobile communication terminal.

12. A computer-readable recording medium encoded with processing instructions for causing a processor to execute a video summary service providing method of preparing a summary video of a predetermined video, the method comprising:

maintaining a memory in which at least one video summary algorithm is stored, each of the at least one video summary algorithm including at least one event;

receiving a request for generating the summary video of the predetermined video from a user and receiving an expected replay time used in generating the summary video from the user;

dividing the predetermined video into at least one individual image by detecting a shot change of the video;

extracting the video summary algorithm corresponding to the video from the memory;

with respect to each of the at least one event included in the extracted video summary algorithm, computing a detection time used in detecting the at least one individual image in which an event occurs from the at least one individual image, for each event;

computing an event significance of each of the at least one event according to the detection time;

selecting a K number of the events from the at least one event according to the event significance, the detection time, and the expected replay time, wherein K is a positive integer;

computing an individual image significance for each of the at least one individual image by using the selected K number of the events; and

generating a summary image by sequentially sorting the individual images according to the computed individual image significance.

13. A video summary service apparatus for preparing a summary video of a video, comprising:

a shot change detection unit dividing the video into at least one individual image by detecting a shot change of the video;

a detection time computation unit computing a detection time used in detecting the at least one individual image in which an event occurs, from the at least one individual image, for each event by using a video summary algorithm which includes at least one event;

an event significance computation unit computing event significance of each of the at least one event according to the detection time and selecting a K number of the events from the at least one event according to the event significance, the detection time, and/or the expected replay time wherein K is positive integer;

an individual image significance computation unit computing an individual image significance of each of the at least one individual image by using the selected K number of the events; and

a summary image control unit generating a summary image.

14. The video summary service of claim 13, wherein the video summary algorithm is stored in a memory.

15. The video summary service of claim 13, the summary image is sequentially generated by individual image significance.

16. The video summary service of claim 14, wherein the memory is one of an Universal Serial Bus (USB) memory, a CompactFlash (CF) memory, a Secure Digital (SD) memory, a mini SD (miniSD) memory, an extreme digital (XD) memory, a Memory Stick, a Memory Stick Duo, a SmartMedia Card (SMC) memory, a Multi Media Card (MMC) memory, and/or a Reduced Size MMC (RS-MMC) memory

17. The video summary service of claim 14, the expected replay time is input by a user.