Voice Control User Interface with Progressive Command Engagement

• US 20170018275A1
• Filed: 09/30/2016
• Published: 01/19/2017
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Gunn, Michael E., Kamdar, Pratik M.
• Granted Patent: US 10,381,010 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/3206 Monitoring of events, devices or parameters that trigger a change in power modality
• CPC Class Codes: G06F 1/3234 Power saving characterised by the action undertaken
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 1/3287 by switching off individual functional units in the computer system
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 5/393 Arrangements for updating the contents of the bit-mapped memory
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 17/24 the user being prompted to utter a password or a predefined phrase
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: Y02D 30/50 in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

A method include placing a first processor in a sleep operating mode and running a second processor that is operative to wake the first processor from the sleep operating mode in response to a speech command phrase. The method includes identifying, by the second processor, a speech command phrase segment and performing a control operation in response to detecting the segment in detected speech. The control operation is performed while the first processor is maintained in the sleep operating mode.

Claims

1. (canceled)

2. A computer-implemented method comprising:

detecting, by a mobile device that is operating in a low-power mode and that is trained to exit the low-power mode upon receipt of a predetermined wake-up command, an utterance of a prefix of the predetermined wake-up command; and

providing, without exiting the low-power mode, a graphical user interface based on detecting the utterance of the prefix of the predetermined wake-up command.

3. The method of claim 2, comprising:

determining that a predetermined period of time has elapsed; and

based on determining that the predetermined period of time has elapsed, deactivating, without exiting the low-power mode, a display of the mobile device.

4. The method of claim 2, wherein the low-power mode maintains applications running on the mobile device in an inactive state.

5. The method of claim 2, comprising:

receiving, from a user, data identifying a security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command;

detecting, by the mobile device and while a display of the mobile device is off, an additional utterance of the prefix of the predetermined wake-up command; and

in response to detecting the additional utterance of the prefix of the predetermined wake-up command and based on receiving the data identifying the security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command, maintaining, without exiting the low-power mode, the display in an off state.

6. The method of claim 2, wherein the graphical user interface is a graphical user interface provided, for display, on the mobile device when the mobile device entered the low-power mode.

7. The method of claim 2, wherein the graphical user interface includes a user-selected background, a current time, and a battery level indicator.

8. The method of claim 7, comprising:

determining that an amount of power remaining in a battery of the mobile device is below a predetermined power level,

wherein the graphical user interface includes the battery level indicator based on determining that the amount of power remaining in the battery of the mobile device is below the predetermined power level.

9. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

detecting, by a mobile device that is operating in a low-power mode and that is trained to exit the low-power mode upon receipt of a predetermined wake-up command, an utterance of a prefix of the predetermined wake-up command; and

providing, without exiting the low-power mode, a graphical user interface based on detecting the utterance of the prefix of the predetermined wake-up command.

10. The system of claim 9, wherein the operations further comprise:

determining that a predetermined period of time has elapsed; and

based on determining that the predetermined period of time has elapsed, deactivating, without exiting the low-power mode, a display of the mobile device.

11. The system of claim 9, wherein the low-power mode maintains applications running on the mobile device in an inactive state.

12. The system of claim 9, wherein the operations further comprise:

receiving, from a user, data identifying a security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command;

detecting, by the mobile device and while a display of the mobile device is off, an additional utterance of the prefix of the predetermined wake-up command; and

in response to detecting the additional utterance of the prefix of the predetermined wake-up command and based on receiving the data identifying the security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command, maintaining, without exiting the low-power mode, the display in an off state.

13. The system of claim 9, wherein the graphical user interface is a graphical user interface provided, for display, on the mobile device when the mobile device entered the low-power mode.

14. The system of claim 9, wherein the graphical user interface includes a user-selected background, a current time, and a battery level indicator.

15. The system of claim 14, wherein the operations further comprise:

determining that an amount of power remaining in a battery of the mobile device is below a predetermined power level,

wherein the graphical user interface includes the battery level indicator based on determining that the amount of power remaining in the battery of the mobile device is below the predetermined power level.

16. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

detecting, by a mobile device that is operating in a low-power mode and that is trained to exit the low-power mode upon receipt of a predetermined wake-up command, an utterance of a prefix of the predetermined wake-up command; and

providing, without exiting the low-power mode, a graphical user interface based on detecting the utterance of the prefix of the predetermined wake-up command.

17. The medium of claim 16, wherein the operations further comprise:

determining that a predetermined period of time has elapsed; and

based on determining that the predetermined period of time has elapsed, deactivating, without exiting the low-power mode, a display of the mobile device.

18. The medium of claim 16, wherein the low-power mode maintains applications running on the mobile device in an inactive state.

19. The medium of claim 16, wherein the operations further comprise:

receiving, from a user, data identifying a security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command;

detecting, by the mobile device and while a display of the mobile device is off, an additional utterance of the prefix of the predetermined wake-up command; and

in response to detecting the additional utterance of the prefix of the predetermined wake-up command and based on receiving the data identifying the security setting that prevents the mobile device from providing, without exiting the low-power mode, the graphical user interface upon detecting the utterance of the prefix of the predetermined wake-up command, maintaining, without exiting the low-power mode, the display in an off state.

20. The medium of claim 16, wherein the graphical user interface is a graphical user interface provided, for display, on the mobile device when the mobile device entered the low-power mode.

21. The medium of claim 16, wherein the graphical user interface includes a user-selected background, a current time, and a battery level indicator.