DEVICE, METHOD, AND COMPUTER-READABLE RECORDING MEDIUM FOR NOTIFYING CONTENT SCENE APPEARANCE

• US 20090248637A1
• Filed: 09/22/2008
• Published: 10/01/2009
• Est. Priority Date: 03/27/2008
• Status: Active Grant

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Kawamura, Takahiro, Yamasaki, Tomohiro
• Granted Patent: US 8,214,368 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/8405 represented by keywords
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

An extracting unit extracts keywords from metadata extracted from played scenes. An attaching unit attaches a semantic class to the keywords. A semantic class determining unit determines whether the semantic class is a should-be-played class. When there is a keyword with the should-be-played class attached, an acquiring unit acquires at least one keyword without having the should-be-played class as a should-be-observed keyword. When the metadata includes the should-be-observed keyword and a keyword to which a should-be-stopped class is attached, an appearance determining unit determines that a scene including the should-be-observed keyword appears in contents.

Claims

1. A device for notifying a scene, comprising:

a playing unit that plays contents including plural scenes that can be played in time sequence;

a metadata extracting unit that extracts metadata that is text information on the scenes from played scenes;

a keyword extracting unit that extracts keywords from the metadata;

an attaching unit that attaches a semantic class indicating a semantic attribute of a keyword to each of the keywords;

a semantic class determining unit that determines whether the semantic class attached to the keyword is a should-be-played class indicating that playback is performed after a scene from which the keyword is extracted;

an acquiring unit that, when there is a keyword to which the semantic class determining unit determines that the should-be-played class is attached, acquires at least one keyword that is not provided with the should-be-played class as a should-be-observed keyword from among the keywords to which the semantic classes are attached;

an appearance determining unit that, when the metadata extracted from a scene that is played after a scene from which the should-be-observed keyword is extracted includes the should-be-observed keyword and a keyword to which a should-be-stopped class that is a semantic class indicating that playback is completed is attached, determines that a scene including the should-be-observed keyword appears in contents that are being played; and

a notifying unit that, when the scene including the should-be-observed keyword appears, makes a notification that the scene including the should-be-observed keyword appears.

2. The device according to claim 1, wherein

when there is a keyword to which the semantic class determining unit determines that the should-be-played class is attached, the acquiring unit acquires the semantic class of at least one keyword to which the semantic class is attached but the should-be-played class is not attached, as a should-be-observed class that is a semantic class to be observed,

when the metadata extracted from the scene that is played after the scene from which the should-be-observed keyword is extracted includes a keyword to which the should-be-observed class is attached and a keyword to which the should-be-stopped class is attached, the appearance determining unit determines that a scene that includes a keyword of a semantic attribute indicated by the should-be-observed class appears in the contents that are being played, and

when it is determined that the scene that includes the keyword of the semantic attribute indicated by the should-be-observed class appears, the notifying unit makes the notification that the scene that includes the keyword of the semantic attribute indicated by the should-be-observed class appears.

3. The device according to claim 1, further comprising a dictionary storage unit that stores therein dictionary information of keywords and semantic classes associated with one another, wherein

the keyword extracting unit extracts a keyword that matches a keyword in the dictionary information stored in the dictionary storage unit from the metadata, and

the attaching unit attaches a semantic class corresponding to the keyword of the dictionary information that matches each of extracted keywords to each of the extracted keywords.

4. The device according to claim 3, wherein

the dictionary information further includes certainty factors of the semantic classes associated with the keywords and the semantic classes, and

the attaching unit attaches a semantic class having a maximum certainty factor among the semantic classes associated with the keywords of the dictionary information that match the extracted keywords to each of the extracted keywords.

5. The device according to claim 1, further comprising a dictionary storage unit that stores therein dictionary information of conditions that keywords satisfy and semantic classes associated with one another, wherein

the keyword extracting unit extracts a keyword that satisfies a condition in the dictionary information stored in the dictionary storage unit from the metadata, and

the attaching unit attaches a semantic class associated with the condition satisfied by an extracted keyword to the extracted keyword.

6. The device according to claim 5, wherein

the dictionary information further includes certainty factors of the semantic classes, and

the attaching unit attaches a semantic class having a maximum certainty factor from among the semantic classes corresponding to a condition that the extracted keyword satisfies to the extracted keyword.

7. The device according to claim 1, wherein

the keyword extracting unit extracts keywords that appear in the metadata in a predetermined format, and

the attaching unit attaches a semantic class predetermined in correspondence with the predetermined format to each of the keywords.

8. The device according to claim 1, further comprising:

a displaying unit that displays acquired should-be-observed keywords; and

a receiving unit that receives designations of the acquired should-be-observed keywords, wherein

when the metadata that is extracted from a scene played after the scene from which the should-be-observed keywords are extracted includes a should-be-observed keyword for which the designation is received and the keyword to which the should-be-stopped class is attached, the appearance determining unit determines that the scene including the should-be-observed keyword appears in the contents that are being played.

9. The device according to claim 1, wherein

the playing unit plays the contents including the scene to which the metadata is attached, and

the metadata extracting unit extracts the metadata attached to the scene from the scene.

10. The device according to claim 1, wherein

the playing unit plays video contents that includes the scenes, which are image information, and

the metadata extracting unit extracts text information obtained as a result of recognizing the image information as the metadata.

11. The device according to claim 1, wherein

the playing unit plays video contents including the scenes, which are image information, and audio information that corresponds to the image information, and

the metadata extracting unit recognizes the audio information and extracts text information obtained as a result of recognition as the metadata.

12. The device according to claim 1, wherein

the playing unit plays audio contents including the scenes, which are audio information, and

the metadata extracting unit extracts text information obtained as a result of recognition of the audio information, as the metadata.

13. A method of notifying a scene, comprising:

playing contents including plural scenes that can be played in time sequence;

extracting metadata that is text information on the scenes from played scenes;

extracting keywords from the metadata;

attaching a semantic class indicating a semantic attribute of a keyword to each of the keywords;

determining whether the semantic class attached to the keyword is a should-be-played class indicating that playback is performed after a scene from which the keyword is extracted;

acquiring, when there is a keyword to which the semantic class determining unit determines that the should-be-played class is attached, at least one keyword that is not provided with the should-be-played class as a should-be-observed keyword from among the keywords to which the semantic classes are attached;

determining, when the metadata extracted from a scene that is played after a scene from which the should-be-observed keyword is extracted includes the should-be-observed keyword and a keyword to which a should-be-stopped class that is a semantic class indicating that playback is completed is attached, that a scene including the should-be-observed keyword appears in contents that are being played; and

notifying, when the scene including the should-be-observed keyword appears, that the scene including the should-be-observed keyword appears.

14. A computer-readable recording medium that stores therein a computer program for notifying a scene, the computer program causing a computer to execute:

playing contents including plural scenes that can be played in time sequence;

extracting metadata that is text information on the scenes from played scenes;

extracting keywords from the metadata;

attaching a semantic class indicating a semantic attribute of a keyword to each of the keywords;

determining whether the semantic class attached to the keyword is a should-be-played class indicating that playback is performed after a scene from which the keyword is extracted;

acquiring, when there is a keyword to which the semantic class determining unit determines that the should-be-played class is attached, at least one keyword that is not provided with the should-be-played class as a should-be-observed keyword from among the keywords to which the semantic classes are attached;

determining, when the metadata extracted from a scene that is played after a scene from which the should-be-observed keyword is extracted includes the should-be-observed keyword and a keyword to which a should-be-stopped class that is a semantic class indicating that playback is completed is attached, that a scene including the should-be-observed keyword appears in contents that are being played; and

notifying, when the scene including the should-be-observed keyword appears, that the scene including the should-be-observed keyword appears.