Gamifying voice search experience for children

• US 10,346,129 B1
• Filed: 06/08/2016
• Issued: 07/09/2019
• Est. Priority Date: 06/08/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Jaini, Shiva, Haile, Satoe, Schurman, Aaron
• Primary Examiner(s): Ng, Amy
• Assistant Examiner(s): Kim, Nicole E
• Application Number:
  US15/176,654
• Time in Patent Office: 1,126 Days
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Implementations disclose gamifying voice search experience. A method includes receiving, by a user device, a user request to perform a search associated with an audio input and upon determining that the audio input for the search has not been provided during a first predefined time interval, displaying on a graphical user interface (GUI) of the user device, one or more GUI elements representing one or more audio prompts pertaining to the search. In response to an activation of one of the GUI elements within a second predefined time interval, an audio prompt corresponding to the activated GUI element is played. The method further includes receiving an audio response to the audio prompt, the audio response indicating a query for the search, and presenting, on the user device, a search result for the indicated query, the search result including one or more media items.

Claims

1. A method comprising:

receiving, by a processing device, a request to initiate a search associated with an audio input;

determining that the audio input associated with the search is absent during a first predefined time interval;

providing for display a plurality of graphical user interface elements that represent a plurality of audio prompts pertaining to the search;

in response to determining that there is no user selection of the graphical user interface elements during a second predefined time interval, activating one of the graphical user interface elements based on a ranking of the plurality of audio prompts;

playing an audio prompt of the activated graphical user interface element, wherein the audio prompt comprises a question and is played prior to receiving audio input associated with the search;

receiving, by the processing device, the audio input in response to the audio prompt, the audio input providing data for the search; and

providing for presentation, by the processing device, a search result for the search, wherein the search result comprises one or more media items.

2. The method of claim 1 further comprising:

in response to the activation, displaying a visual prompt corresponding to the activated graphical user interface element, in addition to the playing of the audio prompt.

3. The method of claim 1 wherein the plurality of audio prompts are based on an age of a user.

4. The method of claim 1 wherein the plurality of audio prompts are based on a location of a user device.

5. The method of claim 1 wherein the plurality of audio prompts are based on a search history of a user.

6. The method of claim 1 wherein the plurality of audio prompts are based on a calendar time of the search.

7. The method of claim 1 wherein the graphical user interface elements comprise a second graphical user interface element that is activated when a user selects the second graphical user interface element.

8. The method of claim 1, wherein the activated graphical user interface element is automatically activated in response to detecting an absence of user input during the second predefined time interval.

9. The method of claim 1 further comprising:

after playing the audio prompt, allowing the user to provide the audio input within a third time interval without any manual interaction with a graphical user interface.

10. The method of claim 1 further comprising determining one or more audio prompts that are specific to a user, wherein determining the one or more audio prompts comprises:

receiving an age of the user; and

determining the one or more audio prompts based on the age.

11. The method of claim 1 further comprising determining one or more audio prompts that are specific to a user, wherein determining the one or more audio prompts comprises:

determining at least one of;

a location of a device of the user, a search history of the user, or a calendar time of the search; and

determining the one or more audio prompts based on the location, the search history, or the calendar time of the search.

12. The method of claim 1 wherein each media item of the one or more media items has a rating that indicates appropriateness of a respective media item for children.

13. A system comprising:

a memory; and

a processing device coupled to the memory, wherein the processing device is to;

receive a request to initiate a search associated with an audio input;

determine that the audio input associated with the search is absent during a first predefined time interval;

provide for display a plurality of graphical user interface elements that represent a plurality of audio prompts pertaining to the search;

responsive to determining that there is no user selection of the graphical user interface elements during a second predefined time interval, activate one of the graphical user interface elements based on a ranking of the plurality of audio prompts;

playing an audio prompt of the activated graphical user interface element, wherein the audio prompt comprises a question and is played prior to receiving audio input associate with the search;

receiving the audio input in response to the audio prompt, the audio input providing data for the search; and

providing for presentation a search result for the search, wherein the search result comprises one or more media items.

14. The system of claim 13, wherein the plurality of audio prompts are based on an age of a user of a user device comprising the processing device.

15. The system of claim 13, wherein the plurality of audio prompts are based on a location of a user device.

16. The system of claim 13, wherein the plurality of audio prompts are based on a search history of a user.

17. The system of claim 13, wherein the plurality of audio prompts are based on a calendar time of the search.

18. The system of claim 13, wherein the graphical user interface elements comprise a second graphical user interface element that is activated when a user clicks on the second graphical user interface element.

19. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to:

receive a request to initiate a search associated with an audio input;

determine that the audio input associated with the search is absent during a first predefined time interval;

providing for display a plurality of graphical user interface elements that represent a plurality of audio prompts pertaining to the search;

in response to determining that there is no user selection of the graphical user interface elements during a second predefined time interval, activating one of the graphical user interface elements based on a ranking of the plurality of audio prompts;

playing an audio prompt of the activated graphical user interface element, wherein the audio prompt comprises a question and is played prior to receiving audio input associated with the search;

receiving the audio input in response to the audio prompt, the audio input providing data for the search; and

providing for presentation, on the user device, a search result for the search, wherein the search result comprises one or more media items.

20. The non-transitory machine-readable storage medium of claim 19, further comprising:

in response to the activation, displaying a visual prompt corresponding to the activated graphical user interface element, in addition to the playing of the audio prompt.

21. The non-transitory machine-readable storage medium of claim 19, further comprising:

activating the graphical user interface element responsive to detecting an absence of user input during the second predefined time interval.

22. The non-transitory machine-readable storage medium of claim 19, further comprising:

after playing the audio prompt, receiving the audio input within a third time interval without any manual interaction with a graphical user interface.

23. The non-transitory machine-readable storage medium of claim 19, wherein each media item of the one or more media items is associated with a rating that indicates appropriateness for children.