SYSTEMS AND METHODS FOR COMBINING SELECTION WITH TARGETED VOICE ACTIVATION

• US 20150261494A1
• Filed: 03/14/2014
• Published: 09/17/2015
• Est. Priority Date: 03/14/2014
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Cohen, Gabriel, Faaborg, Alexander
• Application Number:
  US14/213,515
• Publication Number:
  US 20150261494A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

In an example implementation of the disclosed technology, a method may include outputting, for display, an object and receiving an indication of an input gesture entered at a presence-sensitive input device to select the object and activate an audio input device. The method may also include, responsive to receiving the indication of the input gesture, activating the audio input device. The method may also include receiving an indication of an audio command received by the audio input device, the audio command to perform an action on the object. The method may also include, responsive to receiving the indication of the audio command, performing the action on the object indicated by the audio command.

Claims

1. A method, comprising:

outputting, by a computing device, an object for display at a first location of a display device;

receiving, by the computing device, an indication of a predetermined input gesture entered at a first location of a presence-sensitive input device corresponding to the first location of the display device, the predetermined input gesture configured to (i) select the object and (ii) activate an audio input device to receive an audio command to perform an action associated with the object, the predetermined input gesture comprising a hold gesture that is held for at least a predetermined amount of time;

responsive to receiving the indication of the predetermined input gesture and determining that the hold gesture is held for at least the predetermined amount of time, selecting the object and activating, by the computing device, the audio input device to receive an audio command to perform an action on the object;

receiving, by the computing device, an indication of a first predetermined audio command, received by the audio input device, to perform a first predetermined action on the object; and

responsive to receiving the indication of the first predetermined audio command, performing, by the computing device, the first predetermined action on the object.

3. The method of claim 1, further comprising:

determining, by the computing device, based on a contextual association of the object with at least one application executing on the computing device, an available action to perform on the object; and

outputting, by the computing device, for display on the display device, a visual indicator identifying an audio command that causes the computing device to perform the available action on the object.

4. The method of claim 1, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are simultaneously and adjacently positioned proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

5. The method of claim 4, wherein the predetermined input gesture comprises a press-and-hold gesture.

6. The method of claim 1, wherein the predetermined input gesture comprises a gesture wherein an input object moves such as to define a pattern substantially enclosing the object as displayed.

7. The method of claim 1, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are progressively placed proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

2. (canceled)

8. A system, comprising:

one or more processors;

a memory coupled to the one or more processors and storing instructions that, when executed by the one or more processors, cause the system to;

output, for display, an object at a first location of a display device;

receive an indication of a predetermined input gesture entered at a first location of a presence-sensitive input device corresponding to the first location of the display device, the predetermined input gesture configured to cause the system to (i) select the object and (ii) activate an audio input device to receive an audio command to perform an action associated with the object, the predetermined gesture comprising a hold gesture that is held for at least a predetermined amount of time;

responsive to receiving the indication of the predetermined input gesture and determining that the hold gesture is held for at least the predetermined amount of time, selecting the object and activating the audio input device to receive an audio command to perform an action associated with the object;

receive an indication of a first predetermined audio command received by the audio input device to perform a first predetermined action associated with the object; and

responsive to receiving the indication of the first predetermined audio command, perform the first predetermined action associated with the object.

10. The system of claim 8, further comprising:

determining, based on a contextual association of the object with at least one application executing in association with the system, an available action to perform on the object; and

outputting, for display on the display device, a visual indicator identifying an audio command that causes the system to perform the available action on the object.

11. The system of claim 8, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are simultaneously and adjacently positioned proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

12. The system of claim 11, wherein the predetermined input gesture comprises a press-and-hold gesture.

13. The system of claim 8, wherein the predetermined input gesture comprises a gesture wherein an input object moves such as to define a pattern substantially enclosing the object as displayed.

14. The system of claim 8, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are progressively placed proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

9. (canceled)

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause a computing device to:

output an object for display at a first location of a display device;

receive an indication of a predetermined input gesture entered at a first location of the presence-sensitive input device corresponding to the first location of the display device, the predetermined input gesture configured to (i) select the object and (ii) activate an audio input device to receive an audio command to perform an action associated with the object, the predetermined input gesture comprising a hold gesture that is held for at least a predetermined period of time;

responsive to receiving the indication of the predetermined input gesture and determining that the hold gesture is held for at least the predetermined amount of time, activate the audio input device to receive an audio command to perform an action associated with the object;

receive an indication of a first predetermined audio command received by the audio input device to perform a first predetermined action associated with the object; and

responsive to receiving the indication of the first predetermined audio command, perform the first predetermined action associated with the object.

17. The non-transitory computer-readable medium of claim 15, wherein the instructions, when executed by the one or more processors, further cause the computing device to:

determine, based on a contextual association of the object with at least one application executing on the computing device, an available action to perform on the object; and

output, for display on the display device, a visual indicator identifying an audio command that causes the computing device to perform the available action on the object.

18. The non-transitory computer-readable medium of claim 15, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are simultaneously and adjacently positioned proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

19. The non-transitory computer-readable medium of claim 18, wherein the predetermined input gesture comprises a press-and-hold gesture.

20. The non-transitory computer-readable medium of claim 15, wherein the predetermined input gesture comprises a gesture wherein an input object moves such as to define a pattern substantially enclosing the object as displayed.

21. The non-transitory computer-readable medium claim 15, wherein the predetermined input gesture comprises a gesture wherein a plurality of input objects are progressively placed proximate the first location of the presence-sensitive input device that corresponds to the first location of the display device.

16. (canceled)