SYSTEMS AND METHODS FOR INTERACTING WITH COMPUTING DEVICES VIA NON-VISUAL FEEDBACK

• US 20170083173A1
• Filed: 09/23/2015
• Published: 03/23/2017
• Est. Priority Date: 09/23/2015
• Status: Abandoned Application

• Current Assignee: Daniel Novak, Svobodn?k, Petr
• Original Assignee: Daniel Novak, Svobodn?k, Petr
• Inventors: Novak, Daniel, Svobodn?k, Petr
• Application Number:
  US14/863,154
• Publication Number:
  US 20170083173A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: H04M 1/72481 for visually impaired users
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

A method of interacting with a mobile device via non-visual feedback includes receiving a first location-independent gesture from a user via a touch screen of the mobile device. The user may be seeing-impaired or blind. The first location-independent gesture may be translated into a first computer-readable instruction via a processor of the mobile device. An audio response to the user may be provided in response to the first computer-readable instruction via an audio output device of the mobile device. In response to the audio response, a second location-independent gesture may be received from the user via the touch screen. The second location-independent gesture may be translated into a second computer-readable instruction via the processor of the mobile device. In response executing, the second computer readable instruction may be executed via the processor of the mobile device.

Claims

1. A method of interacting with a mobile device, the method comprising

(a) receiving a first location-independent gesture from a user via a touch screen of the mobile device;

wherein the user is seeing-impaired;

(b) translating the first location-independent gesture into a first computer-readable instruction via a processor of the mobile device;

(c) providing, in response to the first computer-readable instruction, an audio response to the user via an audio output device of the mobile device;

(d) receiving, in response to the audio response, a second location-independent gesture from the user via the touch screen;

(e) translating the second location-independent gesture into a second computer-readable instruction via the processor of the mobile device;

(f) executing, in response to the translating step (e), the second computer readable instruction via the processor of the mobile device.

2. The method of claim 1, wherein the first location-independent gesture is different than the second location-independent gesture.

3. The method of claim 1, wherein the first and second location-independent gestures are selected from the group consisting of:

a one-finger tap on the right side of the touch screen;

a one-finger tap on the left side of the touch screen;

a one-finger push anywhere on the touch screen;

a two-finger tap anywhere on the touch screen;

a two-finger push anywhere on the touch screen; and

a one-finger swipe from the bottom of the touch screen to the top.

4. The method of claim 3, wherein a push is a contact of the touch screen having a duration of at least 300 milliseconds second.

5. The method of claim 1, comprising taping a power button of the mobile device in order to access a help mode.

6. The method of claim 3, wherein a one-finger tap on the right side of the touch screen is translated into a computer-readable instruction to advance to a next item in a navigation menu of the mobile device.

7. The method of claim 3, wherein a one-finger tap on the left side of the touch screen is translated into a computer-readable instruction to revert to a previous next item in a navigation menu of the mobile device.

8. The method of claim 3, wherein a one-finger push is translated into a computer-readable instruction to confirm a current next item in a navigation menu of the mobile device when the mobile device is in a menu navigation mode.

9. The method of claim 8, wherein a one-finger push is translated into a computer-readable instruction to answer a call when the mobile device is in a phone mode.

10. The method of claim 8, wherein a one-finger push is translated into a computer-readable instruction to stop an alarm when mobile device is in an alarm mode.

11. The method of claim 3, wherein a two-finger tap is translated into a computer-readable instruction to repeat an audio response when the mobile device is in a menu navigation mode.

12. The method of claim 11, wherein a two-finger tap is translated into a computer-readable instruction to provide audio caller information when the mobile device is in a phone mode.

13. The method of claim 3, wherein a two-finger push is translated into a computer-readable instruction to revert to a previous menu when the mobile device is in a menu navigation mode.

14. The method of claim 13, wherein a two-finger push is translated into a computer-readable instruction to dismiss an incoming call when the mobile device is in a phone mode.

15. The method of claim 13, wherein a two-finger push is translated into a computer-readable instruction to snooze an alarm when the mobile device is in an alarm mode.

16. The method of claim 1, wherein the first computer readable instruction is an instruction to navigate in a menu, wherein the menu is selected from the group comprising:

alarm mode;

text mode;

phone mode;

voice record mode;

calendar mode;

book reader mode;

banknote recognition mode;

magnification mode;

color indication mode; and

calculator mode.

17. A mobile device comprising

a touch screen configured to receive at least a first and a second location-independent gesture from a user of the mobile device;

wherein the user is seeing-impaired.

a processor configured to;

translate the first location-independent gesture into a first computer-readable instruction;

translate the second location-independent gesture into a second computer-readable instruction;

execute the computer-readable instruction; and

an audio output device configured to provide, in response to the first computer-readable instruction, an audio response to the user via an audio output of the mobile device.

18. The mobile device of claim 17 comprising:

a data storage device configured to store at least one text file encoding words;

wherein the processor is configured to interpret the at least one text files provide instructions to the audio output device; and

wherein the audio output device is configured to broadcast the words encoded in the at least one text file in response to the instructions.

19. The mobile device of claim 17 comprising:

a camera configured to capture at least one image; and

wherein the processor is configured to;

recognize a color in the image;

recognize a banknote in the image; and

magnify the image.

20. The mobile device of claim 17 comprising:

an audio input device configured to capture at least one audio recording, and

a data storage device configured to store the at least one audio recording.