Contextual information between television and user device

• US 8,966,525 B2
• Filed: 11/08/2011
• Issued: 02/24/2015
• Est. Priority Date: 11/08/2011
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Inventors: Mehta, Gaurav D., Hao, Jack Jianxiu
• Primary Examiner(s): Goodarzi, Nasser
• Assistant Examiner(s): Pierorazio, Michael B
• Application Number:
  US13/291,571
• Publication Number:
  US 20130117782A1
• Time in Patent Office: 1,204 Days
• Field of Search: 725 32- 36
• US Class Current: 725/34
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: H04H 2201/37 via a different channel
• CPC Class Codes: H04H 60/00 Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
• CPC Class Codes: H04H 60/372 Programme
• CPC Class Codes: H04H 60/375 Commercial
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04H 60/63 for services of sales data processing systems or methods specially adapted for electronic commerce G06Q30/00
• CPC Class Codes: H04H 60/82 the transmission system being the Internet
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/6181 involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Abstract

A device receives, from a user device, recorded audio and input information associated with content viewed by a user of the user device, and converts the recorded audio into textual information. The device determines whether the content is an advertisement or television content based on the textual information and the input information, and provides, to the user device, promotional content related to the advertisement when the content is determined to be the advertisement. The device provides, to the user device, promotional content related to the television content when the content is determined to be the television content.

Claims

1. A method comprising:

receiving, by a device and from a user device, recorded audio content associated with content provided by the user device,

the recorded audio content being based on audio content received by the user device from a television,

the television receiving the audio content from a set-top box,

the user device being different than the television and being different than the set-top box;

converting, by the device, the recorded audio content into textual information;

comparing, by the device, the textual information to reference information,

the reference information including television content identifiers and advertisement identifiers;

determining, by the device and based on the comparing, whether the content is an advertisement or television content; and

selectively providing, by the device and to the user device, promotional content,

selectively providing the promotional content including;

providing, by the device and based on determining that the content is the advertisement first promotional content related to the advertisement;

or

providing, by the device and based on determining that the content is the television content, second promotional content related to the television content when the content.

2. The method of claim 1, further comprising:

receiving input information associated with the content provided by the user device,

where, when determining whether the content is the advertisement or the television content, the method includes;

determining whether the content is the advertisement or the television content based on the input information.

3. The method of claim 2, where, when determining whether the content is the advertisement or the television content, the method includes:

determining that the content is the advertisement when at least one of the textual information or the input information matches at least one of the advertisement identifiers;

or

determining that the content is the television content when at least one of the textual information or the input information matches at least one of the television content identifiers.

4. The method of claim 1, where, when determining whether the content is the advertisement or the television content, the method includes:

determining that the content is the advertisement when the textual information matches at least one of the advertisement identifiers; and

determining that the content is the television content when the textual information matches at least one of the television content identifiers.

5. The method of claim 1, where the first promotional content comprises one or more of:

video associated with the advertisement,

images associated with the advertisement,

social media associated with the advertisement,

web information associated with the advertisement,

promotions associated with the advertisement, or

coupons associated with the advertisement.

6. The method of claim 1, where the second promotional content comprises one or more of:

video associated with the television content,

images associated with the television content,

social media associated with the television content,

web information associated with the television content,

advertisements associated with the television content, or

merchandise associated with the television content.

7. The method of claim 1, where

the first promotional content comprises a plurality of different types of content,

the second promotional content comprises a plurality of different types of content, and

at least one of the first promotional content or the second promotional content is provided, for presentation, by the user device in a single screenshot.

8. A device comprising:

a memory to store instructions; and

a processor to execute the instructions to;

receive, from a user device, audio content associated with content provided by the user device,

the audio content being based on audio content received by the user device from a television,

the television receiving the audio content from a set-top box,

 

the user device being different than the television and being different than the set-top box;

convert the audio content into textual information;

compare the textual information to reference information,

the reference information including television content identifiers and advertisement identifiers;

determine, based on the comparing, whether the content is an advertisement or television content; and

selectively provide, to the user device, promotional content

the processor, when selectively providing the promotional content, being to;

provide, to the user device and based on determining that the content is the advertisement, first promotional content related to the advertisement;

or

provide, to the user device and based on determining that the content is the television content, second promotional content related to the television content.

9. The device of claim 8, where, when determining whether the content is the advertisement or the television content, the processor is further to:

determine that the content is the advertisement when at least one of the textual information or input information matches at least one of the advertisement identifiers;

or

determine that the content is the television content when at least one of the textual information or the input information matches at least one of the television content identifiers.

10. The device of claim 8, where the first promotional content comprises one or more of:

video associated with the advertisement,

images associated with the advertisement,

social media associated with the advertisement,

web information associated with the advertisement,

promotions associated with the advertisement, or

coupons associated with the advertisement.

11. The device of claim 8, where the second promotional content comprises one or more of:

video associated with the television content,

images associated with the television content,

social media associated with the television content,

web information associated with the television content,

advertisements associated with the television content, or

merchandise associated with the television content.

12. The device of claim 8, where

the first promotional content comprises a plurality of different types of content,

the second promotional content comprises a plurality of different types of content, and

at least one of the first promotional content or the second promotional content is provided, for presentation, by the user device in a single screenshot.

13. A method comprising:

receiving, by a user device, audio content associated with content, received from a television, and input information associated with the content,

the television receiving the audio content from a set-top box,

the user device being different than the television and being different than the set-top box;

recording, by the user device, the audio content;

providing, by the user device and to another device, the recorded audio content and the input information,

the recorded audio content being converted, by the other device, to textual information;

selectively receiving, by the user device and from the other device, promotional content

selectively receiving the promotional content including;

receiving first promotional content related to an advertisement based on the other device determining, based on comparing the textual information and the input information to reference information, that the textual information and the input information are related to the advertisement,

the reference information including television content identifiers and advertisement identifiers;

or

receiving second promotional content related to television content based on the other device determining, based on comparing the textual information and the input information to the reference information, that the textual information and the input information are related to the television content; and

providing, by the user device, the first promotional content or the second promotional content.

14. The method of claim 13, where the first promotional content comprises one or more of:

video associated with the advertisement,

images associated with the advertisement,

social media associated with the advertisement,

web information associated with the advertisement,

promotions associated with the advertisement, or

coupons associated with the advertisement.

15. The method of claim 13, where the second promotional content comprises one or more of:

video associated with the television content,

images associated with the television content,

social media associated with the television content,

web information associated with the television content,

advertisements associated with the television content, or

merchandise associated with the television content.

16. The method of claim 13, where the user device comprises:

a cellular telephone,

a personal digital assistant (PDA),

a smart phone,

a laptop computer, or

a tablet computer.

17. The method of claim 13, where

the first promotional content comprises a plurality of different types of content,

the second promotional content comprises a plurality of different types of content, and

when providing the first promotional content or the second promotional content, the method includes:

providing, for presentation, the first promotional content or the second promotional content in a single screenshot.

18. A user device comprising:

a memory to store instructions; and

a processor to execute the instructions to;

receive audio content associated with content, received from a television, and

input information associated with the content,

the television receiving the audio content from a set-top box,

 

the user device being different than the television and being different than the set-top box;

record the audio content

provide, to another device, the recorded audio content and the input information,

the recorded audio content being converted, by the other device, to textual information;

selectively receive, from the other device, promotional content,

the processor, when selectively receiving the promotional content, being to;

receive first promotional content related to an advertisement based on the other device determining, based on comparing the textual information and the input information to reference information, that the textual information and the input information are related to the advertisement,

 

the reference information including television content identifiers and advertisement identifiers;

or

receive second promotional content related to television content based on the other device determining, based on comparing the textual information and the input information to the reference information, that the textual information and the input information are related to the television content; and

provide the first promotional content or the second promotional content.

19. The user device of claim 18, where the second promotional content comprises one or more of:

video associated with the television content,

images associated with the television content,

social media associated with the television content,

web information associated with the television content,

advertisements associated with the television content, or

merchandise associated with the television content.

20. The user device of claim 18, where the first promotional content comprises one or more of:

video associated with the advertisement,

images associated with the advertisement,

social media associated with the advertisement,

web information associated with the advertisement,

promotions associated with the advertisement, or

coupons associated with the advertisement.

21. The user device of claim 18, where the user device comprises:

a cellular telephone,

a personal digital assistant (PDA),

a smart phone, a laptop computer, or

a tablet computer.

22. The user device of claim 18, where

the first promotional content comprises a plurality of different types of content,

the second promotional content comprises a plurality of different types of content, and

the processor, when providing the first promotional content or the second promotional content, is further to:

provide, for presentation, the first promotional content or the second promotional content in a single screenshot.