METHOD AND SYSTEM FOR PROVIDING ADDITIONAL INFORMATION ON BROADCASTING CONTENT

• US 20140130087A1
• Filed: 07/10/2012
• Published: 05/08/2014
• Est. Priority Date: 07/25/2011
• Status: Active Grant

• Current Assignee: Iplateiakorea Co., Ltd.
• Original Assignee: Iplateiakorea Co., Ltd.
• Inventors: Kim, Do Hyung, Cho, Young Bong
• Granted Patent: US 9,301,006 B2
• Time in Patent Office: Days
• US Class Current: 725/34
• CPC Class Codes: H04N 21/218 Source of audio or video content , e.g. local disk arrays details of retrieval in video databases G06F16/739
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/2542 for selling goods, e.g. TV shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6187 involving transmission via a telephone network, e.g. POTS
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

The present invention relates to a method and a system for providing additional information on broadcast content, and particularly, to a method and a system for providing additional information corresponding to broadcast content displayed on a television to a separate viewer'"'"'s terminal. The method for providing additional information on the broadcast content is performed by a voice feature extraction server and comprises the steps of: extracting audio feature data of the broadcast content to store voice feature information previously grouped in preset units in a provided storage space; and detecting voice feature information corresponding to the voice feature data received from the viewer'"'"'s terminal among the stored one or more pieces of voice feature information and transmitting the detected feature information to the viewer'"'"'s terminal, wherein the viewer'"'"'s terminal extracts the voice feature data from an input audio signal according to a preset method and transmits the extracted voice feature data to the voice feature extraction server, a temporal position corresponding to the voice feature data is determined from the received voice feature information, and the additional information is displayed at the temporal position.

Claims

1. A method performed by a voice feature extraction server for providing additional information on broadcast content to a viewer terminal connected through a data communication network, the method comprising:

extracting audio feature data from the broadcast content and grouping it in a predetermined unit to store as voice feature information in a reserved storage space;

receiving voice feature data from the viewer terminal that is extracted by the viewer terminal in accordance with a predetermined method, based on an audio signal inputted through the viewer terminal;

detecting voice feature information corresponding to the voice feature data received from the viewer terminal from among the stored one or more pieces of voice feature information and transmitting the detected feature information to the viewer terminal.

2. The method of claim 1, further comprising:

transmitting the additional information corresponding to the voice feature information to the viewer terminal.

3. The method of claim 1, further comprising:

upon a receipt of a request for the additional information related to a temporal position related to the voice feature data from the viewer terminal,

transmitting the additional information related to the temporal location.

4. The method of claim 1, wherein said extracting audio feature data from the broadcast content and grouping it in a predetermined unit comprising:

grouping the audio feature data in a predetermined unit of time or in a predetermined unit of volume.

11. A computer-readable storage medium including a computer executable program stored therein, wherein the program, when executed by a processor, causes the processor to perform the method for providing additional information on broadcast content disclosed in any one of claim 1 to claim 10.

5. A method performed by a viewer terminal for providing additional information on broadcast content to a viewer, the method comprising:

extracting n-th voice feature data (where n is a natural number) from an audio signal that is inputted through the viewer terminal in a predetermined method to transmit it to a voice feature extraction server that is connected through a data network;

receiving, from the voice feature extraction server, n-th voice feature information corresponding to the n-th voice feature data from among voice feature information in which audio feature data of the broadcast content is grouped in a predetermined unit;

determining an n-th temporal location relevant to the n-th voice feature data from the received n-th voice feature information that corresponds to the n-th voice feature data; and

displaying the additional information related to the n-th temporal location where n is a natural number.

6. The method of claim 5, wherein said displaying the additional information comprises:

transmitting a request for the additional information in which information about the n-th temporal location is included to the voice feature extraction server;

receiving the additional information related to the n-th temporal location from the voice feature extraction server as a response to the request for the additional information; and

displaying the additional information related to the n-th temporal location;

7. The method of claim 5, further comprising:

receiving the additional information relevant to to the n-th voice feature information from the voice feature extraction server.

8. The method of claim 5, further comprising:

when a predetermined event occurs, extracting (n+1)-th voice feature data;

detecting (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from among one or more pieces of pre-stored voice feature information;

determining the n-th temporal location related to the (n+1)-th voice feature data from the (n+1)-th voice feature information; and

displaying the additional information related to the (n+1)-th temporal location.

9. The method of claim 8, further comprising:

when the voice feature information corresponding to the (n+1)-th voice feature data is not detected from among one or more pieces of pre-stored voice feature information, transmitting the (n+1)-th voice feature data to the voice feature extraction server; and

receiving the (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from the voice feature extraction server.

10. The method of claim 8, wherein said extracting (n+1)-th voice feature data comprises:

extracting the (n+1)-th voice feature data when a predetermined time period has lapsed.

12. A voice feature extraction server comprising:

a broadcast content receiving unit configured to receive broadcast content;

a voice feature information extraction unit configured to extract audio feature data of the broadcast content and produce voice feature information in which the audio feature data is grouped in a predetermined unit;

a database that stores the voice feature information; and

a server communication unit configured to receive the voice feature data from the viewer terminal that is extracted by the viewer terminal in accordance with a predetermined method, based on an audio signal inputted through the viewer terminal, and transmit voice feature information corresponding to the voice feature data received from the viewer terminal from among the stored one or more pieces of voice feature information to the viewer terminal.

13. The voice feature extraction server of claim 12, wherein the server communication unit is configured to:

transmit the additional information corresponding to the voice feature information to the viewer terminal.

14. A viewer terminal comprising:

a transmitting unit configured to;

extract n-th voice feature data (where n is a natural number) in a predetermined method from an audio signal that is inputted to transmit it to a voice feature extraction server that is connected through a data network;

and receive, from the voice feature extraction server, n-th voice feature information corresponding to the n-th voice feature data from among voice feature information in which audio feature data of the broadcast content which is received by the voice feature extraction server is grouped in a predetermined unit;

a control unit configured to determine an n-th temporal location related to the n-th voice feature data from the received n-th voice feature information that corresponds to the n-th voice feature data; and

a display unit configured to display additional information relevant to the n-th temporal location.

15. The viewer terminal of claim 14, wherein the control unit is configured to:

before said displaying the additional information relevant to the n-th temporal location by the display unit,

control the transmitting unit to transmit a request for the additional information in which information about the n-th temporal location is included to the voice feature extraction server; and

control the transmission unit to receive the additional information related to the n-th temporal location from the voice feature extraction server as a response to the request for the additional information.

16. The viewer terminal of claim 14, wherein the transmitting unit is configured to receive the additional information relevant to the n-th voice feature information from the voice feature extraction server.

17. The viewer terminal of claim 14, wherein the control unit is configured to:

when a predetermined event occurs, extract (n+1)-th voice feature data;

detect (n+1)-th voice feature information corresponding to the (n+1)-th voice feature data from among one or more pieces of pre-stored voice feature information; and

determine the n-th temporal location related to the (n+1)-th voice feature data from the (n+1)-th voice feature information; and

wherein the display unit is configured to display the additional information related to the (n+1)-th temporal location.

18. The viewer terminal of claim 17, wherein the transmitting unit is configured to:

when the voice feature information corresponding to the (n+1)-th voice feature data is not detected from among one or more pieces of pre-stored voice feature information, transmit the (n+1)-th voice feature data to the voice feature extraction server; and

receive the (n+1)-th voice feature information that corresponds to the (n+1)-th voice feature data from the voice feature extraction server.

19. The viewer terminal of claim 17, wherein the control unit is configured to extract the (n+1)-th voice feature data when a predetermined time period has lapsed.