Toggling between presentation and non-presentation of representations of input

• US 10,386,931 B2
• Filed: 01/27/2016
• Issued: 08/20/2019
• Est. Priority Date: 01/27/2016
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Stewart, Aaron Michael, Yu, Jonathan Jen-Wei, Cook, Thomas Ryan, Skinner, Jeffrey E.
• Primary Examiner(s): Higgs, Stella
• Application Number:
  US15/007,344
• Publication Number:
  US 20170212643A1
• Time in Patent Office: 1,301 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

In one aspect, a device includes a processor, a display accessible to the processor, and storage accessible to the processor. The storage bears instructions executable by the processor to present a user interface (UI) on the display and present at least a first option on the display and a second option on the display. The first option is selectable to present at the device, at least a first representation of first user input of a first input type. The second option is selectable to present, at the device, at least a second representation of second user input of a second input type. The first user input and the second user input pertain to the UI, and the first input type is different from the second input type.

Claims

1. A first device, comprising:

at least one processor;

a display accessible to the at least one processor; and

storage accessible to the at least one processor and bearing instructions executable by the at least one processor to;

present a user interface (UI) on the display;

present at least a first option on the display and a second option on the display, the first option being selectable to present, at the first device, at least a first representation of first user input of a first input type, the second option being selectable to present, at the first device, at least a second representation of second user input of a second input type, the first user input and the second user input pertaining to the UI, the first input type being different from the second input type;

responsive to a first word spoken by a user being identified, correlate the first word to a second word, the second word already presented as part of the UI prior to the first word being identified;

record the first word being spoken by the user, the first word being recorded without additional user input that is eye input and without additional user input that selects a button presented on the display; and

responsive to the correlation, present a graphical object adjacent to the second word, the graphical object indicating the first word as being spoken and indicating available playback of the speaking of the first word.

2. The first device of claim 1, wherein the first input type is eye input, wherein the first representation is presented on the UI, and wherein the first user input is determined to pertain to the UI based at least in part on a determination one or more of:

that a user gestures toward the UI while at least a portion of the first user input is received, that at least a portion of audio received at the first device while at least a portion of the first user input is received contains at least one word that pertains to the UI, that a portion of the UI is touched while at least a portion of the first user input is received.

3. The first device of claim 1, wherein the instructions are executable by the at least one processor to:

present a selector on the display selectable to sequentially present in chronological order various representations of input based on the sequence in which various user inputs respectively associated with the various representations of input are received.

4. The first device of claim 1, wherein the UI is simultaneously accessible to multiple users through different devices, wherein the first user input and the second user input are receivable at the different devices, and wherein the first representation and the second representation are presentable at the different devices.

5. The first device of claim 1, wherein the instructions are executable by the at least one processor to:

present at least a first icon that is also associated with the first input type, the first icon comprising a graphic other than text that visually indicates the first input type, the first icon associated with one item presented on the UI but not others, the first icon being selectable to initiate playback of input associated with the item, the first icon being different from the first and second options.

6. The first device of claim 1, wherein the graphical object comprises an icon, the icon being selectable to initiate playback of the speaking of the first word.

7. The first device of claim 1, wherein the graphical object comprises an image of the user.

8. The first device of claim 7, wherein the image of the user is presented responsive to identification of the user as speaking the first word.

9. The first device of claim 1, wherein presenting the graphical object adjacent to the second word comprises presenting the graphical object within a threshold distance of the second word.

10. The first device of claim 1, wherein the first word and the second word are the same word.

11. A method, comprising:

presenting a user interface (UI) on a display of a device;

toggling between presentation of representations of input at the device and non-presentation of the representations of input at the device based on manipulation of at least one selector presented on the display, wherein the input that is represented is associated with the UI;

responsive to identifying a first word spoken by a user, correlating the first word to a second word, the second word already presented as part of the UI prior to the first word being identified;

recording the first word being spoken by the user, the first word being recorded without additional user input that is eye input and without additional user input that selects a button presented on the display; and

responsive to the correlation, presenting a graphical object adjacent to the second word, the graphical object indicating available playback of the speaking of the first word.

12. The method of claim 11, wherein the graphical object is selectable to initiate playback of the speaking of the first word.

13. The method of claim 11, wherein the graphical object comprises an image of the user.

14. The method of claim 11, wherein presenting the graphical object adjacent to the second word comprises presenting the graphical object within a threshold distance of the second word.

15. The method of claim 11, wherein the first word and the second word are the same word.

16. An apparatus, comprising:

a first processor;

a network adapter; and

storage bearing instructions executable by a second processor for;

presenting a window on a display of a device accessible to the second processor; and

presenting at least a first selector on the display and a second selector on the display, the first selector being selectable to present, at the device, at least a first representation of first user input from a first user, the second selector being selectable to present, at the device, at least a second representation of second user input from a second user different from the first user, the first user input and the second user input pertaining content presented in the window;

responsive to identifying a first word spoken by a user, correlating the first word to a second word, the second word already presented as part of the window prior to the first word being identified;

recording the first word being spoken by the user, the first word being recorded without additional user input that is eye input and without additional user input that selects a button presented on the display; and

responsive to the correlation, presenting a graphical object adjacent to the second word, the graphical object indicating the correlation;

wherein the first processor transfers the instructions over a network via the network adapter.

17. The apparatus of claim 16, wherein the correlation is performed responsive to association of the first word with metadata related to a location at which the second word is presented.

18. The apparatus of claim 16, wherein the graphical object indicates available playback of the speaking of the first word and is selectable to initiate playback of the speaking of the first word.

19. The apparatus of claim 16, wherein the graphical object indicates the second word as being spoken by the user, the first and second words being the same word.

20. The apparatus of claim 16, wherein the graphical object comprises an image of the user.