Context aware geo-targeted advertisement in a communication session

• US 9,800,950 B2
• Filed: 12/11/2013
• Issued: 10/24/2017
• Est. Priority Date: 12/11/2013
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Grevers, Jr., Theodore Robert
• Primary Examiner(s): Ortiz Sanchez, Michael
• Application Number:
  US14/103,154
• Publication Number:
  US 20150163561A1
• Time in Patent Office: 1,413 Days
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Techniques are provided for capturing audio containing speech at an endpoint device, converting the audio into corresponding text, identifying one or more keywords from the corresponding text and determining geolocation information associated with the endpoint device. Both the one or more keywords and the geolocation information are supplied as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords. The geo-targeting advertisement service provides one or more advertisements to an endpoint device for display, wherein the advertisements are based on the one or more keywords and the geolocation information.

Claims

1. A method comprising:

capturing audio containing speech during a video conference session at a device participating in the video conference session;

converting the audio into corresponding text;

identifying one or more keywords from the corresponding text;

determining geolocation information associated with the device;

supplying both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords;

receiving at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information; and

displaying, on a display screen of the device as the one or more keywords are identified during the video conference session, a plurality of thumbnail images, wherein each of the thumbnail images corresponds to an advertisement from the one or more advertisements received at the device and the plurality of thumbnail images are displayed in a sequence that tracks an order in which the one or more keywords are identified, with more recent thumbnail images of the plurality of thumbnail images continuously displacing less recent thumbnail images from prominent display positions on the display screen.

2. The method of claim 1, wherein supplying further comprises sending the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

3. The method of claim 1, wherein determining the geolocation information comprises determining a location of the device.

4. The method of claim 1, further comprising fetching from one or more external sources associated with the one or more advertisements, corresponding image data for use in displaying the plurality of thumbnail images on the display screen of the device.

5. The method of claim 1, wherein capturing comprises repeatedly capturing audio at the device, converting comprises repeatedly converting speech contained in the audio into corresponding text, identifying comprises repeatedly identifying one or more keywords from the corresponding text, and wherein supplying comprises repeatedly supplying one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

6. The method of claim 1, further comprising:

upon receiving a user selection of a particular thumbnail image from the plurality of thumbnail images, completely displaying a corresponding advertisement on the display screen of the device together with additional content related to the corresponding advertisement.

7. The method of claim 1, wherein the plurality of thumbnail images scroll across the display screen of the device.

8. The method of claim 7, further comprising receiving an input from a user that causes previously displayed images that have scrolled off the display screen to reappear on the display screen.

9. An apparatus comprising:

a microphone configured to capture audio containing speech during a video conference session at a device participating in the video conference session;

a network interface unit configured to receive communications over a network;

a display screen configured to display information associated with one or more advertisements; and

a processor coupled to the network interface unit, and configured to;

convert the audio received from the microphone into corresponding text;

identify one or more keywords from the corresponding text;

determine geolocation information associated with the device;

supply both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords;

receive at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information; and

display, on the display screen of the device as the one or more keywords are identified during the video conference session, a plurality of thumbnail images, wherein each of the thumbnail images corresponds to an advertisement from the one or more advertisements received at the device and the plurality of thumbnail images are displayed in a sequence that tracks an order in which the one or more keywords are identified, with more recent thumbnail images of the plurality of thumbnail images continuously displacing less recent thumbnail images from prominent display positions on the display screen.

10. The apparatus of claim 9, wherein the processor is further configured to send the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

11. The apparatus of claim 9, wherein the processor is further configured to determine the geolocation information by determining a location of the device.

12. The apparatus of claim 9, wherein the processor is further configured to fetch from one or more external sources associated with the one or more advertisements, corresponding image data for use in displaying the plurality of thumbnail images on the display screen of the device.

13. The apparatus of claim 9, wherein the processor is configured to:

repeatedly convert speech contained in the audio into corresponding text;

repeatedly identify one or more keywords from the corresponding text; and

repeatedly supply one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

14. The apparatus of claim 9, wherein the processor is further configured to:

upon receiving a user selection of a particular thumbnail image from the plurality of thumbnail images, completely display a corresponding advertisement on the display screen together with additional content related to the corresponding advertisement.

15. The apparatus of claim 9, wherein the plurality of thumbnail images scroll across the display screen.

16. The apparatus of claim 15, wherein the processor is further configured to receive an input from a user that causes previously displayed images that have scrolled off the display screen to reappear on the display screen.

17. One or more non-transitory computer readable storage media encoded with software comprising computer executable instructions and when the software is executed operable to:

capture audio containing speech during a video conference session at a device participating in the video conference session;

convert the audio into corresponding text;

identify one or more keywords from the corresponding text;

determine geolocation information associated with the device;

supply both the one or more keywords and the geolocation information as input to a geo-targeting advertisement service so as to cause the geo-targeting advertisement service to identify relevant content based on both the geolocation information and the one or more keywords;

receive at the device from the geo-targeting advertisement service one or more advertisements obtained by the geo-targeting advertisement service based on the one or more keywords and the geolocation information; and

display, on a display screen of the device as the one or more keywords are identified during the video conference session, a plurality of thumbnail images, wherein each of the thumbnail images corresponds to an advertisement from the one or more advertisements received at the device and the plurality of thumbnail images are displayed in a sequence that tracks an order in which the one or more keywords are identified, with more recent thumbnail images of the plurality of thumbnail images continuously displacing less recent thumbnail images from prominent display positions on the display screen.

18. The non-transitory computer readable storage media of claim 17, further comprising computer executable instructions operable to send the one or more keywords and the geolocation information in a markup language format contained within a message to the geo-targeting advertisement service.

19. The non-transitory computer readable storage media of claim 17 further comprising computer executable instructions operable to determine the geolocation information by determining a location of the device.

20. The non-transitory computer readable storage media of claim 17, further comprising computer executable instructions operable to fetch from one or more external sources associated with the one or more advertisements, corresponding image data for use in displaying the plurality of thumbnail images on the display screen of the device.

21. The non-transitory computer readable storage media of claim 17, further comprising computer executable instructions operable to:

repeatedly capture audio at the device;

repeatedly convert speech contained in the audio into corresponding text;

repeatedly identify one or more keywords from the corresponding text; and

repeatedly supply one or more keywords and associated geolocation information to the geo-targeting advertisement service as audio is captured at the device.

22. The non-transitory computer readable storage media of claim 17, further comprising computer executable instructions operable to:

upon receiving a user selection of a particular thumbnail image from the plurality of thumbnail images, completely display a corresponding advertisement on the display screen of the device together with additional content related to the corresponding advertisement.

23. The non-transitory computer readable storage media of claim 17, wherein the plurality of thumbnail images scroll across the display screen of the device.

24. The non-transitory computer readable storage media of claim 23, further comprising computer executable instructions operable to receive an input from a user that causes previously displayed images that have scrolled off the display screen to reappear on the display screen.