DIGEST PLAYBACK APPARATUS AND METHOD

• US 20080292279A1
• Filed: 02/15/2008
• Published: 11/27/2008
• Est. Priority Date: 05/22/2007
• Status: Abandoned Application

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: EJIMA, Naoki, KAMADA, Takashi
• Application Number:
  US12/032,504
• Publication Number:
  US 20080292279A1
• Time in Patent Office: Days
• US Class Current: 386/244
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

A character identification section identifies characters to specify one or more characters in each of scenes in video content according to video data in the video content, and generates images of the identified characters. A speaker identification section identifies speakers to specify one or more speakers in each of the scenes in the video content according to subtitle data in the video content. A correspondence determination section determines, based on results of the specification of the characters and the specification of the speakers in the scenes in the video content, a correspondence between each of the characters and each of the speakers. A display control section controls display of the images of the characters to receive selection of a character desired by a user, and plays back one or more of the scenes in the video content in which the speaker speaks, who is determined to correspond to the selected character.

Claims

1. An apparatus for playing back a digest of recorded video content, comprising:

a character identification section for identifying characters to specify one or more characters in each of scenes in the video content according to video data in the video content, and generating images of the identified characters;

a speaker identification section for identifying speakers to specify one or more speakers in each of the scenes in the video content according to subtitle data in the video content;

a correspondence determination section for determining, based on results of the character identification section'"'"'s specification of the characters and the speaker identification section'"'"'s specification of the speakers in the scenes in the video content, a correspondence between each of the characters identified by the character identification section and each of the speakers identified by the speaker identification section; and

a display control section for controlling display of the images of the characters generated by the character identification section to receive selection of a character desired by a user, and playing back one or more of the scenes in the video content in which a speaker speaks, who is determined to correspond to the selected character by the correspondence determination section.

2. The apparatus of claim 1, wherein when switching occurs between speakers identified by the speaker identification section, the character identification section identifies a character by referring to a still image contained in the video data at the time of the occurrence of the switching.

3. The apparatus of claim 1, wherein the character identification section performs a discrete cosine transform on part of a still image contained in the video data which shows a face of a human, and identifies a character by a code obtained by the transform.

4. The apparatus of claim 1, wherein the speaker identification section obtains information on colors of letters of subtitles or textual information added to the subtitles from the subtitle data, and identifies the speakers according to the letter color information or the textual information.

5. The apparatus of claim 1, wherein if there is a scene which has been determined to have one character by the character identification section and determined to have one speaker by the speaker identification section, the correspondence determination section determines that the character and the speaker correspond to each other.

6. The apparatus of claim 5, wherein if there is a scene which has been determined to have n characters by the character identification section and determined to have n speakers by the speaker identification section, and in which correspondences between n−

1 characters of the n characters and n−

1 speakers of the n speakers have already been determined, the correspondence determination section determines that the remaining one character and the remaining one speaker correspond to each other.

7. The apparatus of claim 5, wherein the speaker identification section calculates, for each of the scenes in the video content, a ratio of a subtitle display time for each speaker in that scene to the duration of that scene;

and

when there are a plurality of scenes that satisfy said conditions, the correspondence determination section determines, based on results of the character identification section'"'"'s specification of the characters and the speaker identification section'"'"'s specification of the speakers for one of the scenes in which the ratio calculated by the speaker identification section is larger than the ratios in others of the scenes, a correspondence between each of the characters identified by the character identification section and each of the speakers identified by the speaker identification section.

8. The apparatus of claim 1, wherein the speaker identification section calculates, for each of the scenes in the video content, a ratio of a subtitle display time for each speaker in that scene to the duration of that scene;

and

the display control section preferentially plays back a scene, in which the ratio calculated by the speaker identification section for the speaker who has been determined to correspond to the selected character by the correspondence determination section is larger than the ratios in others of the scenes.

9. The apparatus of claim 1, wherein the display control section preferentially plays back a scene close to an end of the video content.

10. The apparatus of claim 1, wherein the display control section equally plays back scenes at a beginning, in a middle and at an end of the video content.

11. The apparatus of claim 1, comprising a storage section for storing the images of the characters generated by the character identification section and results of the determination made by the correspondence determination section, while associating the images and the determination results with a series of programs in the video content, wherein when the display control section plays back a video content which is an episode of a series, the display control section controls display of the images of the characters in the series, which are stored in the storage section, to receive selection of a character desired by a user, and plays back one or more of the scenes in the video content, in which a speaker speaks, who is determined to correspond to the selected character according to the results of the determination made for the series by the correspondence determination section and stored in the storage section.

12. A method for playing back a digest of recorded video content, comprising the steps of:

(a) identifying characters to specify one or more characters in each of scenes in the video content according to video data in the video content, and generating images of the identified characters;

(b) identifying speakers to specify one or more speakers in each of the scenes in the video content according to subtitle data in the video content;

(c) determining, based on results of the specification of the characters and the specification of the speakers in the scenes in the video content performed in the steps (a) and (b), a correspondence between each of the characters identified in the step (a) and each of the speakers identified in the step (b); and

(d) displaying the images of the characters generated in the step (a) to receive selection of a character desired by a user, and playing back one or more of the scenes in the video content in which a speaker speaks, who is determined to correspond to the selected character in the step (c).

13. The method of claim 12, wherein in the step (a), when switching occurs between speakers identified in the step (b), a character is identified by referring to a still image contained in the video data at the time of the occurrence of the switching.

14. The method of claim 12, wherein in the step (a), a discrete cosine transform is performed on part of a still image contained in the video data which shows a face of a human, and a character is identified by a code obtained by the transform.

15. The method of claim 12, wherein in the step (b), information on colors of letters of subtitles or textual information added to the subtitles is obtained from the subtitle data, and the speakers are identified according to the letter color information or the textual information.

16. The method of claim 12, wherein in the step (c), if there is a scene which has been determined to have one character in the step (a) and determined to have one speaker in the step (b), the character and the speaker are determined to correspond to each other.

17. The method of claim 16, wherein in the step (c), if there is a scene which has been determined to have n characters in the step (a) and determined to have n speakers in the step (b), and in which correspondences between n−

1 characters of the n characters and n−

1 speakers of the n speakers have already been determined, the remaining one character and the remaining one speaker are determined to correspond to each other.

18. The method of claim 16, wherein in the step (b), for each of the scenes in the video content, a ratio of a subtitle display time for each speaker in that scene to the duration of that scene is calculated;

and

in the step (d), when there are a plurality of scenes that satisfy said conditions, a correspondence between each of the characters identified in the step (a) and each of the speakers identified in the step (b) is determined based on results of the specification of the characters and the specification of the speakers performed in the steps (a) and (b) for one of the scenes in which the ratio calculated in the step (b) is larger than the ratios in others of the scenes.

19. The method of claim 12, wherein in the step (b), for each of the scenes in the video content, a ratio of a subtitle display time for each speaker in that scene to the duration of that scene is calculated;

and

in the step (d), a scene, in which the ratio calculated in the step (b) for the speaker who has been determined to correspond to the selected character in the step (c) is larger than the ratios in others of the scenes, is played back preferentially.

20. The method of claim 12, wherein in the step (d), a scene close to an end of the video content is played back preferentially.

21. The method of claim 12, wherein in the step (d), scenes at a beginning, in a middle and at an end of the video content are equally played back.

22. The method of claim 12, comprising the steps of:

(e) storing the images of the characters generated in the step (a) and results of the determination made in the step (c), while associating the images and the determination results with a series of programs in the video content; and

(f) when a video content which is an episode of a series is played back, displaying the images of the characters in the series, which are stored in the step (e) to receive selection of a character desired by a user, and playing back one or more of the scenes in the video content, in which a speaker speaks, who is determined to correspond to the selected character according to the results of the determination made for the series in the step (c) and stored in the step (e).