Method and system for providing additional information on broadcasting content

• US 9,301,006 B2
• Filed: 07/10/2012
• Issued: 03/29/2016
• Est. Priority Date: 07/25/2011
• Status: Active Grant

• Current Assignee: Iplateiakorea Co., Ltd.
• Original Assignee: Iplateiakorea Co., Ltd.
• Inventors: Cho, Young Bong, Kim, Do Hyung
• Primary Examiner(s): HANCE, ROBERT J
• Application Number:
  US14/129,968
• Publication Number:
  US 20140130087A1
• Time in Patent Office: 1,358 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/218 Source of audio or video content , e.g. local disk arrays details of retrieval in video databases G06F16/739
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/2542 for selling goods, e.g. TV shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6187 involving transmission via a telephone network, e.g. POTS
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

The present invention relates to a method and a system for providing additional information on broadcast content, and particularly, to a method and a system for providing additional information corresponding to broadcast content displayed on a television to a separate viewer'"'"'s terminal. The method for providing additional information on the broadcast content is performed by a voice feature extraction server and comprises the steps of: extracting audio feature data of the broadcast content to store voice feature information previously grouped in preset units in a provided storage space; and detecting voice feature information corresponding to the voice feature data received from the viewer'"'"'s terminal among the stored one or more pieces of voice feature information and transmitting the detected feature information to the viewer'"'"'s terminal, wherein the viewer'"'"'s terminal extracts the voice feature data from an input audio signal according to a preset method and transmits the extracted voice feature data to the voice feature extraction server, a temporal position corresponding to the voice feature data is determined from the received voice feature information, and the additional information is displayed at the temporal position.

Claims

1. A method performed by a viewer terminal for providing additional information on broadcast content to a viewer, the method comprising:

extracting n-th voice feature data (where n is a natural number) from an audio signal that is inputted through the viewer terminal in a predetermined method to transmit it to a voice feature extraction server that is connected through a data network;

receiving, from the voice feature extraction server, n-th voice feature information corresponding to the n-th voice feature data from among voice feature information in which audio feature data of the broadcast content is grouped in a predetermined unit;

determining an n-th temporal location relevant to the n-th voice feature data from the received n-th voice feature information that corresponds to the n-th voice feature data;

displaying the additional information related to the n-th temporal location where n is a natural number;

when a predetermined event occurs, extracting (n+1)-th voice feature data;

detecting (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from among one or more pieces of pre-stored voice feature information;

determining the n-th temporal location related to the (n+1)-th voice feature data from the (n+1)-th voice feature information;

displaying the additional information related to the (n+1)-th temporal location;

when the voice feature information corresponding to the (n+1)-th voice feature data is not detected from among one or more pieces of pre-stored voice feature information, transmitting the (n+1)-th voice feature data to the voice feature extraction server; and

receiving the (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from the voice feature extraction server.

2. The method of claim 1, wherein said displaying the additional information comprises:

transmitting a request for the additional information in which information about the n-th temporal location is included to the voice feature extraction server;

receiving the additional information related to the n-th temporal location from the voice feature extraction server as a response to the request for the additional information; and

displaying the additional information related to the n-th temporal location.

3. The method of claim 1, further comprising:

receiving the additional information relevant to the n-th voice feature information from the voice feature extraction server.

4. The method of claim 1, wherein said extracting (n+1)-th voice feature data comprises:

extracting the (n+1)-th voice feature data when a predetermined time period has lapsed.

5. A non-transitory computer-readable storage medium including a computer executable program stored therein, wherein the program, when executed by a processor, causes the processor to perform the method for providing additional information on broadcast content disclosed in claim 1.

6. A viewer terminal configured to:

extract n-th voice feature data (where n is a natural number) in a predetermined method from an audio signal that is inputted to transmit it to a voice feature extraction server that is connected through a data network;

receive, from the voice feature extraction server, n-th voice feature information corresponding to the n-th voice feature data from among voice feature information in which audio feature data of the broadcast content which is received by the voice feature extraction server is grouped in a predetermined unit; and

determine an n-th temporal location related to the n-th voice feature data from the received n-th voice feature information that corresponds to the n-th voice feature data,

wherein the viewer terminal comprises a display unit configured to display additional information relevant to the n-th temporal location,

wherein the viewer terminal is configured to;

when a predetermined event occurs, extract (n+1)-th voice feature data;

detect (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from among one or more pieces of pre-stored voice feature information; and

determine the n-th temporal location related to the (n+1)-th voice feature data from the (n+1)-th voice feature information,

wherein the display unit is configured to display the additional information related to the (n+1)-th temporal location, and

wherein the viewer terminal is configured to;

when the voice feature information corresponding to the (n+1)-th voice feature data is not detected from among one or more pieces of pre-stored voice feature information, transmit the (n+1)-th voice feature data to the voice feature extraction server; and

receive the (n+1)-th voice feature information that corresponds to the (n+1)-th voice feature data from the voice feature extraction server.

7. The viewer terminal of claim 6, wherein the viewer terminal controller is configured to:

before said displaying the additional information relevant to the n-th temporal location by the display unit, transmit a request for the additional information in which information about the n-th temporal location is included to the voice feature extraction server; and

receive the additional information related to the n-th temporal location from the voice feature extraction server as a response to the request for the additional information.

8. The viewer terminal of claim 6, wherein the viewer terminal is configured to receive the additional information relevant to the n-th voice feature information from the voice feature extraction server.

9. The viewer terminal of claim 6, wherein the viewer terminal is configured to extract the (n+1)-th voice feature data when a predetermined time period has lapsed.