Context Aware Geo-Targeted Advertisement in a Communication Session

• US 20150163561A1
• Filed: 12/11/2013
• Published: 06/11/2015
• Est. Priority Date: 12/11/2013
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Grevers, Theodore Robert Jr.
• Granted Patent: US 9,800,950 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Techniques are provided for capturing audio containing speech at an endpoint device, converting the audio into corresponding text, identifying one or more keywords from the corresponding text and determining geolocation information associated with the endpoint device. Both the one or more keywords and the geolocation information are supplied as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords. The geo-targeting advertisement service provides one or more advertisements to an endpoint device for display, wherein the advertisements are based on the one or more keywords and the geolocation information.

Claims

1. A method comprising:

capturing audio containing speech at a device;

converting the audio into corresponding text;

identifying one or more keywords from the corresponding text;

determining geolocation information associated with the device;

supplying both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords; and

receiving at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information.

2. The method of claim 1, wherein supplying further comprises sending the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

3. The method of claim 1, wherein determining the geolocation information comprises determining a location of the device.

4. The method of claim 1, further comprising fetching from an external source for an advertisement, corresponding image data for use in displaying an image on a display screen of the device.

5. The method of claim 1, wherein capturing comprises repeatedly capturing audio at the device, converting comprises repeatedly converting speech contained in the audio into corresponding text, identifying comprises repeatedly identifying one or more keywords from the corresponding text, and wherein supplying comprises repeatedly supplying one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

6. The method of claim 5, further comprising displaying on a display screen of the device a plurality of advertisements in an order corresponding to an order in which audio input is converted into corresponding text.

7. The method of claim 1, further comprising displaying a thumbnail image corresponding to each received advertisement on a display screen while audio is being captured at the device.

8. The method of claim 7, further comprising receiving a user input to select a particular thumbnail image that results in a complete display of the corresponding advertisement on the display screen of the device.

9. The method of claim 7, further comprising displaying, as audio is being captured at the device, a plurality of thumbnail images, each thumbnail image corresponding to a received advertisement, wherein the plurality of thumbnail images scroll across the display screen of the device.

10. The method of claim 9, further comprising receiving an input from a user that causes previously displayed thumbnail images that have scrolled off the display screen to reappear on the display screen.

11. An apparatus comprising:

a microphone configured to capture audio containing speech at a device;

a network interface unit configured to receive communications over a network;

a display screen configured to display information associated with one or more advertisements; and

a processor coupled to the network interface unit, and configured to;

convert the audio received from the microphone into corresponding text;

identify one or more keywords from the corresponding text;

determine geolocation information associated with the device;

supply both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords; and

receive at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information.

12. The apparatus of claim 11, wherein the processor is further configured to send the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

13. The apparatus of claim 11, wherein the processor is further configured to determine the geolocation information by determining a location of the device.

14. The apparatus of claim 11, wherein the processor is further configured to fetch from an external source for an advertisement, corresponding image data for use in displaying an image on the display screen of the device.

15. The apparatus of claim 11, wherein the processor is configured to:

repeatedly convert speech contained in the audio into corresponding text;

repeatedly identify one or more keywords from the corresponding text; and

repeatedly supply one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

16. The apparatus of claim 15, wherein the processor is further configured to display on the display screen of the device a plurality of advertisements in an order corresponding to an order of conversion of the audio input into corresponding text.

17. The apparatus of claim 11, wherein the processor is further configured to display a thumbnail image corresponding to each received advertisement on the display screen while audio is being captured at the device.

18. The apparatus of claim 17, wherein the processor is further configured to receive a user input to select a particular thumbnail image that results in a complete display of the corresponding advertisement on the display screen.

19. The apparatus of claim 17, wherein the processor is further configured to display, as audio is being captured at the device, a plurality of thumbnail images, each thumbnail image corresponding to a received advertisement, wherein the plurality of thumbnail images scroll across the display screen.

20. The apparatus of claim 19, wherein the processor is further configured to receive an input from a user that causes previously displayed thumbnail images that have scrolled off the display screen to reappear on the display screen.

21. One or more computer readable storage media encoded with software comprising computer executable instructions and when the software is executed operable to:

capture audio containing speech at a device;

convert the audio into corresponding text;

identify one or more keywords from the corresponding text;

determine geolocation information associated with the device;

supply both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords; and

receive at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information.

22. The computer readable storage media of claim 21, further comprising computer executable instructions operable to send the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

23. The computer readable storage media of claim 21 further comprising computer executable instructions operable to determine the geolocation information by determining a location of the device.

24. The computer readable storage media of claim 21, further comprising computer executable instructions operable to fetch from an external source for an advertisement, corresponding image data for use in displaying an image on a display screen of the device.

25. The computer readable storage media of claim 21, further comprising computer executable instructions operable to:

repeatedly capture audio at the device;

repeatedly convert speech contained in the audio into corresponding text;

repeatedly identify one or more keywords from the corresponding text; and

repeatedly supply one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

26. The computer readable storage media of claim 25, further comprising computer executable instructions operable to display on a display screen of the device a plurality of advertisements in an order corresponding to an order of conversion of the audio input into corresponding text.

27. The computer readable storage media of claim 21, further comprising computer executable instructions operable to display a thumbnail image corresponding to each received advertisement on a display screen of the device while audio is being captured at the device.

28. The computer readable storage media of claim 27, further comprising computer executable instructions operable to receive a user input to select a particular thumbnail image that results in a complete display of the corresponding advertisement on the display screen of the device.

29. The computer readable storage media of claim 27, further comprising computer executable instructions operable to display, as audio is being captured at the device, a plurality of thumbnail images, each thumbnail image corresponding to a received advertisement, wherein the plurality of thumbnail images scroll across the display screen of the device.

30. The computer readable storage media of claim 29, further comprising computer executable instructions operable to receive an input from a user that causes previously displayed thumbnail images that have scrolled off the display screen to reappear on the display screen.