User interface device and method for the visually impaired

• US 20030071859A1
• Filed: 08/23/2002
• Published: 04/17/2003
• Est. Priority Date: 08/24/2001
• Status: Abandoned Application

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Takami, Junichi, Lu, Bin
• Application Number:
  US10/226,926
• Publication Number:
  US 20030071859A1
• Time in Patent Office: Days
• US Class Current: 345/865
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G09B 21/007 using both tactile and audible presentation of the information

Abstract

The user interface is provided for the visually impaired to operate a multifunction devices. The user interface is based upon a combination of tactile sensation, tactile position, and sound. The tactile sensation includes the Braille expressions as well as any marker on a template. The tactile position includes the relative position of the user hand on a touch panel. In combination with the tactile sensation or tactile position, the sound interface offers additional information to help the operation of the multifunction machine.

Claims

1. A method of user interfacing a visually impaired user with a multifunction device, comprising the steps of:

assigning a predetermined function to a predetermined surface area of a touch panel;

placing a template over the touch panel, a partial template area of the template corresponding to the predetermined surface area of the touch panel, the partial template area providing a non-visual cue for identification;

inputting an inquiry about the partial template area based upon the non-visual cue;

outputting a voice message about the partial template area in response to the inquiry; and

selecting the predetermined function by making a contact ultimately with the predetermined surface area.

2. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the non-visual cue includes a Braille expression.

3. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the non-visual cue includes a number indicator.

4. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the template is selected from a group of predetermined templates, each of the templates corresponding to a particular set of predetermined functions.

5. The method of user interfacing a visually impaired with a multifunction device according to claim 4 further comprising:

storing the group of the predetermined templates; and

retrieving one of the predetermined templates based upon the particular set of the predetermined functions.

6. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the voice message includes a function name.

7. The method of user interfacing a visually impaired with a multifunction device according to claim 6 wherein the voice message additionally includes a description of the function.

8. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the ultimate contact is made directly with the predetermined surface area of the touch panel by the user.

9. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the ultimate contact is made indirectly with the predetermined surface area of the touch panel through the template by the user.

10. The method of user interfacing a visually impaired with a multifunction device according to claim 1 further comprising an additional step of identifying the visually impaired user.

11. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein the touch panel is divided into the predetermined surface areas that resemble a piano keyboard.

12. The method of user interfacing a visually impaired with a multifunction device according to claim 1 wherein computer instructions are used to facilitate certain steps, the computer instructions being stored in a recording medium.

13. A method of user interfacing a visually impaired user with a multifunction device, comprising the steps of:

dividing a touch panel into predetermined surface areas that resemble a piano keyboard;

assigning a predetermined function to each of the predetermined surface areas;

touching one of the predetermined surface areas in a first predetermined manner indicative of an inquiry;

outputting a sound output about the one of the surface areas in response to the inquiry; and

touching one of the predetermined surface areas in a second predetermined manner to select the predetermined function.

14. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein the sound output includes a unique sound icon.

15. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein the sound output includes a voice message.

16. The method of user interfacing a visually impaired with a multifunction device according to claim 15 wherein the voice message includes a function name.

17. The method of user interfacing a visually impaired with a multifunction device according to claim 16 wherein the voice message additionally includes a description of the function.

18. The method of user interfacing a visually impaired with a multifunction device according to claim 13 further comprising an additional step of identifying the visually impaired user.

19. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein the piano keyboard is selected from a set of predetermined keyboard, each of the keyboards corresponding to a particular set of predetermined functions.

20. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein a set of predetermined surface areas are assigned to predetermined special functions, the predetermined surface areas being detected by tactile sensation.

21. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein one of the predetermined surface areas is disabled, the sound output includes a sound icon and a voice message, at least one of the sound icon and the voice message being modified to indicate a disabled state.

22. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein the sound output including a sound icon and a voice message, at least one of the sound icon and the voice message being generated in stereo to reflect an approximate position on the piano keyboard.

23. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein the sound output is immediately terminated upon detecting the touch on the piano keyboard.

24. The method of user interfacing a visually impaired with a multifunction device according to claim 13 wherein computer instructions are used to facilitate certain steps, the computer instructions being stored in a recording medium.

25. The method of user interfacing a visually impaired with a multifunction device according to claim 13 further includes an additional step of detecting a set of predetermined movements over the keyboard in one of predetermined shapes to select a predetermined function.

26. A user interface system for facilitating a visually impaired operator to use a multifunction device, comprising:

a touch input unit for non-visually indicating predetermined functions and for receiving a tactile input;

a control unit connected to said touch input unit for determining a control signal based upon the tactile input; and

a sound generating unit connected to said control unit for outputting a sound in response to the control signal.

27. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 26 wherein said touch input unit further comprises a touch screen for indicating the predetermined functions and a template placed over said touch screen for non-visually indicating the predetermined functions.

28. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 27 wherein said template including a non-visual cue for each of the predetermined function.

29. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 28 wherein said template includes a series of holes to access the predetermined functions on the touch screen.

30. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 28 wherein said template includes a series of buttons to make a contact with said touch screen for the predetermined functions.

31. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 28 wherein said template is a seal to be placed over said touch screen.

32. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 28 further comprising a keypad input unit for inputting a number indicated by the non-visual cue for an inquiry, said sound generating unit outputting a voice message including a function name and a function description of one of the predetermined functions that is associated with the number.

33. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 27 further comprising:

a template storage unit for storing a plurality of said templates, each of said templates being used for a particular set of the predetermined functions; and

a template retrieving unit connected to said template storage unit for retrieving one of said templates from said template storage unit and placing said retrieved template over said touch screen.

34. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 26 wherein said touch input unit further includes function areas that are arranged in a piano key board.

35. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 34 wherein said control unit determines a first predetermined touch and a second predetermined touch based upon the tactile input, the first predetermined touch indicative of a long touch for an inquiry, the second predetermined touch indicative of a short touch for selection.

36. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 35 wherein said sound generating unit outputs a sound output in response to the first predetermined touch.

37. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 36 wherein the sound output includes a function name and a function description.

38. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 36 wherein the sound output includes a sound icon indicative a position on the piano key board.

39. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 35 wherein said sound generating unit generates a sound output in stereo in response to the first predetermined touch.

40. The user interface system for facilitating a visually impaired operator to use a multifunction device according to claim 35 wherein said control unit executes one of the predetermined functions based upon the second predetermined touch.