Systems and methods for adjusting volume in audio devices

• US 10,679,623 B2
• Filed: 06/27/2018
• Issued: 06/09/2020
• Est. Priority Date: 05/10/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Mixter, Kenneth, Shah, Raunaq
• Primary Examiner(s): Roberts, Shaun
• Application Number:
  US16/020,971
• Publication Number:
  US 20180308324A1
• Time in Patent Office: 713 Days
• Field of Search: 704275
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04N 21/20 Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/40 Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
• CPC Class Codes: H04N 21/4104 Peripherals receiving signals from specially adapted client devices
• CPC Class Codes: H04N 21/4112 having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4751 for defining user accounts, e.g. accounts for children

Abstract

The disclosed embodiments include methods, devices, and storage mediums for adjusting the output volume of audio content. In one aspect, a method performed at an audio device includes: (1) identifying a remote location for audio content; (2) streaming the audio content from the remote location; (3) producing an audible output from the audio content at a first volume level; and (4) while producing the audible output: (a) receiving an indication that a user is about to submit verbal input to the electronic device; (b) in response to the indication, adjusting the audible output from the first volume level to a second volume level, less than the first volume level; (c) receiving the verbal input from the user; and (d) after receiving the verbal input, adjusting the audible output from the second volume level to the first volume level.

Claims

1. A method performed at an electronic device having a first device type and comprising a speaker, one or more processors, and memory storing one or more programs for execution by the one or more processors, the method comprising:

downloading a voice assistant library configured to execute across a plurality of different electronic device types, including the first device type, wherein the voice-assistant library includes a plurality of voice processing modules, each of the voice processing modules providing one or more voice processing operations that are accessible to application programs executing or executable on the different electronic device types;

configuring the voice assistant library to execute on the electronic device;

after the configuring, identifying a remote location for audio content;

streaming the audio content from the remote location;

producing, via the speaker, an audible output from the audio content at a first volume level; and

while producing the audible output;

receiving a user input to the electronic device;

processing the user input using the voice assistant library executing on the electronic device;

in response to a determination that the user input corresponds to an indication that the user is about to submit verbal input to the electronic device, adjusting the audible output from the first volume level to a second volume level, less than the first volume level; and

following the adjusting;

receiving the verbal input from the user; and

processing the verbal input.

2. The method of claim 1, wherein the electronic device includes a microphone, and the user input to the electronic device comprises detecting by the microphone an audio hotword spoken by the user.

3. The method of claim 1, wherein the user input to the electronic device comprises activation of a user interface element on the electronic device.

4. The method of claim 3, wherein the user interface element comprises an assistant interface button.

5. The method of claim 1, wherein the audio content comprises third-party audiovisual content.

6. The method of claim 1, wherein the audio content comprises casted content.

7. The method of claim 1, further comprising, after receiving the verbal input, adjusting the audible output from the second volume level to the first volume level.

8. An electronic device having a first device type, comprising:

a speaker;

one or more processors; and

memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for;

downloading a voice assistant library configured to execute across a plurality of different electronic device types, including the first device type, wherein the voice-assistant library includes a plurality of voice processing modules, each of the voice processing modules providing one or more voice processing operations that are accessible to application programs executing or executable on the different electronic device types;

configuring the voice assistant library to execute on the electronic device;

after the configuring, identifying a remote location for audio content;

streaming the audio content from the remote location;

producing, via the speaker, an audible output from the audio content at a first volume level; and

while producing the audible output;

receiving a user input to the electronic device;

processing the user input using the voice assistant library executing on the electronic device;

in response to a determination that the user input corresponds to an indication that the user is about to submit verbal input to the electronic device activation input, adjusting the audible output from the first volume level to a second volume level, less than the first volume level;

following the adjusting;

receiving the verbal input from the user; and

processing the verbal input.

9. The device of claim 8, wherein the one or more programs comprise a voice assistant application having one or more application programming interfaces (APIs).

10. The device of claim 9, wherein the one or more APIs include an API function for ducking volume of audio outputs of the device, the API function callable by applications running on the device.

11. The device of claim 9, wherein the one or more APIs include an API for providing a compatibility interface between the voice assistant application and one or more operating systems.

12. The device of claim 9, wherein the one or more APIs include an API for providing an interface between the voice assistant application and hardware functionality of the device.

13. The device of claim 12, further including one or more light emitting diodes (LEDs), and wherein the hardware functionality of the device includes operation of the one or more LEDs.

14. The device of claim 9, wherein the verbal input comprises a user command directed to a second application on the device;

and

wherein the one or more programs further comprise instructions for calling an API function of the one or more APIs in accordance with the user command.

15. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by an audio device having a first device type and including one or more processors, memory, and a speaker, cause the audio device to perform operations comprising:

downloading a voice assistant library configured to execute across a plurality of different electronic device types, including the first device type, wherein the voice-assistant library includes a plurality of voice processing modules, each of the voice processing modules providing one or more voice processing operations that are accessible to application programs executing or executable on the different electronic device types;

configuring the voice assistant library to execute on the audio device;

after the configuring, identifying a remote location for audio content;

streaming the audio content from the remote location;

producing, via the speaker, an audible output from the audio content at a first volume level; and

while producing the audible output;

receiving a user input to the audio device;

in response to a determination that the user input corresponds to an indication that the user is about to submit verbal input to the audio device, adjusting the audible output from the first volume level to a second volume level, less than the first volume level;

following the adjusting;

receiving the verbal input from the user; and

processing the verbal input.

16. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs comprise a voice assistant application and an additional application;

wherein the first volume level is set by the additional application; and

wherein the audible output is adjusted from the first volume level to a second volume level via the voice assistant application.

17. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further comprise instructions for:

determining a query by processing the verbal input;

sending the query to a remote server system;

receiving a response to the query from the remote server system; and

performing an operation in accordance with the response.

18. The non-transitory computer-readable storage medium of claim 15, wherein the one or more programs further comprise instructions for:

after receiving the verbal input, adjusting the audible output from the second volume level to the first volume level.

19. The non-transitory computer-readable storage medium of claim 15, wherein the audio device stores a voice assistant application and one or more additional applications;

and

wherein the audible output comprises output from one of the one or more additional applications.