Promotional content targeting based on recognized audio

• US 10,832,287 B2
• Filed: 09/18/2018
• Issued: 11/10/2020
• Est. Priority Date: 05/10/2011
• Status: Active Grant

• Current Assignee: Soundhound AI IP LLC
• Original Assignee: SoundHound Incorporated
• Inventors: Master, Aaron, Mohajer, Keyvan
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US16/134,890
• Publication Number:
  US 20190019220A1
• Time in Patent Office: 784 Days
• Field of Search: 84615, 84653
• CPC Class Codes: G06F 16/60 of audio data
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0275 Auctions
• CPC Class Codes: G06Q 30/0277 Online advertisement

Abstract

An audio recognition system provides for delivery of promotional content to its user. A user interface device, locally or with the assistance of a network-connected server, performs recognition of audio in response to queries. Recognition can be through a method such as processing features extracted from the audio. Audio can comprise recorded music, singing or humming, instrumental music, vocal music, spoken voice, or other recognizable types of audio. Campaign managers provide promotional content for delivery in response to audio recognized in queries.

Claims

1. An audio recognition device enabled to deliver promotional content, the audio recognition device comprising:

a user interface output device enabled to provide information and corresponding related promotional content to a user;

a network interface subsystem for providing the information to a server and obtaining the corresponding related promotional content;

a module for retrieving the information from a local storage device in response to audio queries from the user requesting the information; and

a local recognition module that recognizes the audio queries received from the user.

2. The audio recognition device of claim 1, wherein at least one of the audio queries is vocal music.

3. The audio recognition device of claim 1, wherein at least one of the audio queries is spoken voice.

4. The audio recognition device of claim 1, wherein the local recognition module performs recognition by processing features extracted from the audio queries.

5. The audio recognition device of claim 1, wherein the user interface output device is a display subsystem.

6. The audio recognition device of claim 1, wherein the user interface output device is an audio output device and the corresponding related promotional content comprises audio messages.

7. The audio recognition device of claim 1, wherein the information comprises a name of a song.

8. A method for computer-assisted processing of audio queries, the method comprising:

receiving an audio query and a request for information about the audio query from a user;

recognizing the audio query;

determining a category of the recognized audio query;

searching a database corresponding to the category to obtain information responsive to the recognized audio query;

selecting a promotional item corresponding to the category; and

providing the obtained information and promotional item to the user.

9. The method of claim 8, wherein:

the method is performed by a server;

the audio query is received through a network; and

the obtained information and promotional item are sent to the user through a network.

10. The method of claim 8, wherein:

the method is performed by a user device;

the audio query is received through a microphone; and

the obtained information and promotional item are displayed on a visual display.

11. The method of claim 8, wherein:

the method is performed by a user device;

the audio query is received through a microphone; and

the obtained information and promotional item are provided to the user through an audio output device.

12. The method of claim 8, wherein the audio query is vocal music.

13. The method of claim 8, wherein the audio query is spoken voice.

14. The method of claim 8, wherein the recognizing of the audio query is performed by processing features extracted from the audio query.

15. The method of claim 8, wherein the information comprises a name of a song.

16. A method of managing promotional campaigns, the method comprising:

receiving, from a campaign manager, a reference to a category for recognized audio;

receiving, from the campaign manager, promotional content;

receiving, from the campaign manager, a bid to deliver the promotional content in response to an audio query that matches the category for recognized audio; and

storing, on a campaign configuration server, a link between the category and the promotional content.

17. The method of claim 16, wherein the category for recognized audio is a genre of vocal music.

18. The method of claim 16, wherein the category for recognized audio is a name of a song.

19. The method of claim 16, wherein the category for recognized audio is a topic spoken by voice.