CONTEXT BASED GESTURE DELINEATION FOR USER INTERACTION IN EYES-FREE MODE

• US 20140215340A1
• Filed: 01/28/2013
• Published: 07/31/2014
• Est. Priority Date: 01/28/2013
• Status: Active Grant

• Current Assignee: Nook Digital, LLC (f/k/a Barnesandnoble.com LLC) (Bahwan CyberTek Pvt Ltd.)
• Original Assignee: Nook Digital, LLC (f/k/a Barnesandnoble.com LLC) (Bahwan CyberTek Pvt Ltd.)
• Inventors: Shetty, Saj, Chattopadhyay, Krishanu, Klein, Douglas
• Granted Patent: US 9,971,495 B2
• Time in Patent Office: Days
• US Class Current: 715/727
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Techniques are disclosed for facilitating the use of an electronic device having a user interface that is sensitive to a user'"'"'s gestures. An “eyes-free” mode is provided in which the user can control the device without looking at the device display. Once the eyes-free mode is engaged, the user can control the device by performing gestures that are detected by the device, wherein a gesture is interpreted by the device without regard to a specific location where the gesture is made. The eyes-free mode can be used, for example, to look up a dictionary definition of a word in an e-book or to navigate through and select options from a hierarchical menu of settings on a tablet. The eyes-free mode advantageously allows a user to interact with the user interface in situations where the user has little or no ability to establish concentrated visual contact with the device display.

Claims

1. A device comprising:

a touch sensor for detecting gestures made by a user; and

a user interface including (a) a content delivery mode in which digital content is delivered to the user, and in which the user interface is configured to respond to a first set of command gestures, and (b) a manual mode in which delivery of the digital content is paused, and in which the user interface is configured to respond to a second set of command gestures, the second set of command gestures including more command gestures than the first set of command gestures,

wherein the first and second sets of command gestures are responded to without regard to a particular location on the touch sensor where a particular gesture is detected.

2. The device of claim 1, wherein the first set of command gestures comprises a transition command gesture that is configured to toggle the user interface back-and-forth between the content delivery and manual modes.

3. The device of claim 1, wherein the first set of command gestures consists essentially of a transition command gesture that is configured to toggle the user interface back-and-forth between the content delivery and manual modes.

4. The device of claim 1, wherein:

the first and second sets of command gestures each comprises a transition command gesture that is configured to toggle the user interface back-and-forth between the content delivery and manual modes; and

the transition command gesture in the first set of command gestures is equivalent to the transition command gesture in the second set of command gestures.

5. The device of claim 1, further comprising a speaker, wherein in the content delivery mode the digital content is delivered to the user via the speaker.

6. The device of claim 1, wherein:

the second set of command gestures comprises a content navigation gesture; and

detection of the content navigation gesture in the manual mode causes a segment of the digital content to be re-delivered to the user.

7. The device of claim 1, wherein:

the second set of command gestures comprises a content navigation gesture;

detection of the content navigation gesture in the manual mode causes a segment of the digital content to be re-delivered to the user; and

the first set of command gestures does not include the content navigation gesture.

8. The device of claim 1, wherein:

the second set of command gestures comprises a content navigation gesture; and

detection of the content navigation gesture in the manual mode causes a segment of the digital content to be highlighted on a display of the device.

9. The device of claim 1, further comprising a text-to-speech module, wherein in the content delivery mode the digital content is converted to an audio signal using the text-to-speech module.

10. The device of claim 1, wherein:

the device is selected from the group consisting of an e-reader, a tablet computer and a smart phone; and

the touch sensor is a touch sensitive display.

11. The device of claim 1, wherein:

the user interface further includes an options overlay;

the second set of command gestures includes a forward transition gesture that, when detected by the touch sensor, causes the device to transition to the options overlay; and

upon transitioning to the options overlay the user interface is further configured to provide for display a plurality of command options.

12. A mobile electronic device comprising:

a touch sensitive display for displaying digital content and detecting gestures made by a user;

a speaker;

a text-to-speech module; and

a user interface including (a) a reading mode in which the text-to-speech module converts the displayed digital content into an audio signal that is played using the speaker, and (b) a manual mode in which the playing of the audio signal generated by the text-to-speech module is paused, wherein;

the user interface is configured to respond to a first set of command gestures detected by the touch sensitive display while in the reading mode,

the user interface is configured to respond to a second set of command gestures detected by the touch sensitive display while in the manual mode,

the first set of command gestures includes fewer command gestures than the second set of command gestures,

the first and second sets of command gestures are responded to without regard to a particular location on the touch sensitive display where a particular gesture is detected, and

a transition command gesture is included in both the first and second set of command gestures, the transition command gesture being configured to toggle the user interface back-and-forth between the reading and manual modes.

13. The mobile electronic device of claim 12, wherein the speaker plays an announcement upon detection of the transition command gesture.

14. The mobile electronic device of claim 12, wherein the first set of command gestures consists essentially of the transition command gesture.

15. The mobile electronic device of claim 12, wherein:

the second set of command gestures comprises a content navigation gesture; and

detection of the content navigation gesture in the manual mode causes a segment of the digital content to be read using the text-to-speech module and the speaker.

16. The mobile electronic device of claim 12, wherein:

the second set of command gestures comprises a content navigation gesture; and

detection of the content navigation gesture in the manual mode causes a segment of the digital content to be copied to a virtual clipboard.

17. A non-transitory computer readable medium encoded with instructions that, when executed by at least one processor, cause an eyes-free control process to be carried out, the control process comprising:

providing a touch sensitive user interface having a reading mode and a manual mode;

aurally presenting digital content in the reading mode;

pausing the aural presentation in the manual mode;

responding to a first set of command gestures when the user interface is in the reading mode; and

responding to a second set of command gestures when the user interface is in the manual mode, wherein;

the first and second sets of command gestures are responded to without regard to a particular location on a touch sensor where a particular gesture is detected, and

a transition command gesture is included in both the first and second set of command gestures, the transition command gesture being configured to toggle the user interface back-and-forth between the reading and manual modes.

18. The non-transitory computer readable medium of claim 17, wherein the first set of command gestures includes fewer commands than the second set of command gestures.

19. The non-transitory computer readable medium of claim 17, wherein the control process further comprises making an audible announcement upon detection of the transition command gesture.

20. The non-transitory computer readable medium of claim 17, wherein the touch sensor is a touch sensitive display.