Apparatus operation device and method, image forming apparatus using the same device and method, and computer program product therefore

• US 20030218642A1
• Filed: 04/23/2003
• Published: 11/27/2003
• Est. Priority Date: 04/30/2002
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Sakayori, Tetsuya, Kato, Yoshinaga
• Granted Patent: US 7,318,198 B2
• Time in Patent Office: Days
• US Class Current: 715/853
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 1/00384 Key input means, e.g. buttons or keypads electromechanical details of key input means in general H01H13/00
• CPC Class Codes: H04N 1/00405 Output means output arrangements for computers G06F3/00
• CPC Class Codes: H04N 1/00488 providing an audible output to the user
• CPC Class Codes: H04N 1/0049 providing a visual indication to the user, e.g. using a lamp H04N1/00408 takes precedence

Abstract

An apparatus operation device for operating an apparatus comprising an operation input device configured to allow a user to input an instruction for operating the apparatus without using eyesight, and an output device configured to output information informing the user of a status of inputting the instruction for operating the apparatus and a result of inputting the instruction for operating the apparatus by a sound and a voice so that the user can operate the apparatus without using eyesight.

Claims

1. An apparatus operation device for operating an apparatus, comprising:

an operation input device configured to allow a user to input an instruction for operating the apparatus without using eyesight; and

an output device configured to output information informing the user of a status of inputting the instruction for operating the apparatus and a result of inputting the instruction for operating the apparatus by a sound and a voice so that the user can operate the apparatus without using eyesight.

2. The apparatus operation device according to claim 1, wherein the output device is configured to output information informing the user of a progress and/or a result of the operation of the apparatus by a sound and a voice when an operation is performed and/or completed by the apparatus according to the input instruction.

3. The apparatus operation device according to claim 1, further comprising:

an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure; and

wherein the instruction for operating the apparatus is input by the user by moving a presently pointed position on the operation menu to a desired operation or setting item in the operation menu to select the desired operation or setting item to be set, and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device.

4. The apparatus operation device according to claim 3, wherein each of the operation items and the setting items in the operation menu has a function number.

5. The apparatus operation device according to claim 3, wherein the operation input device comprises:

a directional movement key for moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set;

a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu; and

wherein the instruction for operating the apparatus is input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item with the directional movement key to select the desired operation or setting item to be set, and by confirming selection of the desired operation or setting item at the presently pointed position on the operation menu with the confirmation key.

6. The apparatus operation device according to claim 3, further comprising:

a voice recognition device;

wherein the operation input device comprises a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu; and

wherein the instruction for operating the apparatus is input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition of a word uttered by the user corresponding to the desired operation or setting item by the voice recognition device, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

7. The apparatus operation device according to claim 4, further comprising:

a voice recognition device,

wherein the operation input device comprises a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu, and

wherein the instruction for operating the apparatus is input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition of a function number uttered by the user of the desired operation or setting item by the voice recognition device, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

8. The apparatus operation device according to claim 4, wherein the operation input device comprises a ten-key pad, and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein the instruction for operating the apparatus is input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item by inputting a function number of the desired operation or setting item with the ten-key pad, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

9. The apparatus operation device according to claim 3, wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, the output device outputs the information informing a result of inputting the instruction for operating the apparatus by a sound icon corresponding to a type of the selected operation or setting item.

10. The apparatus operation device according to claim 3, wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, the output device outputs the information informing a result of inputting the instruction for operating the apparatus by an operation sound or a piece of background music (BGM), and wherein the output operation sound or a piece of BGM depends upon a position of the selected operation or setting item on the operation menu.

11. The apparatus operation device according to claim 9, wherein when the output device outputs the information informing a result of inputting the instruction by the sound icon, a property of the sound icon is changed.

12. The apparatus operation device according to claim 10, wherein when the output device outputs the information informing a result of inputting the instruction by the operation sound or piece of BGM, a property of the operation sound or piece of BGM is changed.

13. The apparatus operation device according to claim 3, wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, a name of the desired operation or setting item at the presently pointed position and a setting value to the desired operation or setting item are read by a voice by the output device.

14. The apparatus operation device according to claim 13, wherein when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice by the output device, a property of the voice is changed.

15. The apparatus operation device according to claim 14, wherein when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice by the output device, if the desired operation or setting item at the presently pointed position on the operation menu is an invalid operation or setting item, a pitch of the voice is changed to be lower than when the desired operation or setting item at the presently pointed position on the operation menu is a valid operation or setting item.

16. The apparatus operation device according to claim 14, wherein when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice by the output device, if the desired operation or setting item at the presently pointed position on the operation menu is a selected operation or setting item or an operation or setting item to which a setting value has been set, a pitch of the voice is changed to be higher than when the desired operation or setting item at the presently pointed position on the menu is a non-selected operation or setting item or an operation or setting item to which a setting value has not been set.

17. The apparatus operation device according to claim 14, wherein when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice by the output device, if the desired operation or setting item at the presently pointed position on the operation menu is an operation item having sub-class operation items or setting items in a lower layer of the operation item in the layered tree-structure of the operation menu, a reverberant sound is added to the voice.

18. The apparatus operation device according to claim 3, wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, if the desired operation or setting item at the presently pointed position on the operation menu is a setting item to which a numerical value is to be input, a piece of BGM is output by the output deice until the numerical value has been input to the setting item.

19. The apparatus operation device according to claim 3, wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, a setting content of the desired operation or setting item is output by a voice by the output device.

20. The apparatus operation device according to claim 3, wherein the operation input device comprises a setting confirmation key that is configured, when operated, to sequentially move the presently pointed position on the operation menu to operation items and/or setting items for which predetermined setting values have been changed;

and

wherein when the setting confirmation key is operated and the presently pointed position on the operation menu is sequentially moved to the operation items and/or setting items for which predetermined setting values have been changed, sequentially, respective contents of the operation items and/or setting items are output by voices by the output device.

21. The apparatus operation device according to claim 3, wherein the operation input device comprises a partial clear key for returning setting values in operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, for which predetermined setting values have been changed, to respective predetermined setting values;

and

wherein when the partial clear key is operated, for each of the operation items and/or setting items for which predetermined setting value have been changed, an inquiry about whether or not a setting value to the operation or setting item is to be returned to a predetermined setting value of the operation or setting item is output by a voice by the output device.

22. The apparatus operation device according to claim 3, wherein the operation input device comprises a partial clear key for returning setting values in operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, for which predetermined setting values have been changed, to respective predetermined setting values, and

wherein when the partial clear key is operated, an inquiry about whether or not all of setting values to the operation items and/or setting items for which predetermined setting values have been changed are to be returned to respective predetermined setting values is output by a voice by the output device.

23. The apparatus operation device according to claim 3, further comprising:

a display device;

wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, the output device outputs a content of the selected desired operation or setting item at the presently pointed position by a voice and the display device displays the content of the selected desired operation or setting item.

24. The apparatus operation device according to claim 3, further comprising:

a display device; and

a visual input device configured to allow a user to input an instruction for operating the apparatus using eyesight;

wherein when the instruction for operating the apparatus has been input by the user by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position with the operation input device, the output device outputs a content of the selected desired operation or setting item at the presently pointed position by a voice and the display device displays the content of the selected desired operation or setting item; and

wherein when an instruction for operating the apparatus relative to the content of the selected desired operation or setting item displayed by the display device has been input by the visual input device, the output device outputs information informing the user of a status and a result of inputting the instruction for operating the apparatus by the visual input device by a sound and a voice.

25. The operation device according to claim 1, wherein the apparatus is an image forming apparatus.

26. The operation device according to claim 1, wherein the apparatus is a multi-function peripheral.

132. An image forming apparatus, comprising:

an image forming device configured to form an image on a recording medium; and

the apparatus operation device according to claim 1, wherein the image forming device is operated by the apparatus operation device.

134. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium and including the apparatus operation device according to claim 1, the image forming apparatus being configured to be operated by the apparatus operation device; and

a personal computer connected with the image forming apparatus;

wherein an operating system of the apparatus operation device for operating the image forming apparatus in a non-visual mode for operating the image forming apparatus without using eyesight is incorporated in the personal computer.

136. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium and including the apparatus operation device according to claim 1, the image forming apparatus being configured to be operated by the apparatus operation device;

a personal computer connected with the image forming apparatus; and

wherein a part of the apparatus operation device relating to an operation of the image forming apparatus in a non-visual mode for operating the image forming apparatus without using eyesight is incorporated in the personal computer.

27. An apparatus operation device for operating an apparatus, comprising:

an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure;

wherein the apparatus is configured to be operated by selecting or setting a value to a setting item in the operation menu;

the apparatus operation device further comprising;

an operation support information file configured to store, for each keyword, operation support information including information of operation items and setting items including the keyword and voice information about the operation items and the setting items including the keyword, the information of the operation items and the setting items including the keyword and the voice information being associated with each other;

a help operation part configured to retrieve operation support information corresponding to a result of recognizing a keyword uttered by a user from the operation support information file and to cause the voice information of the retrieved operation support information to be output so that the user can select a setting item relating to the keyword uttered by the user based upon the voice information; and

wherein when the apparatus is switched from a visual mode to a non-visual operation mode for operating the apparatus without using eyesight, the apparatus is operated by determining a setting item, that has been selected by the user via the help operation part relative to the keyword uttered by the user, to be a setting item designated by the user.

28. The apparatus operation device according to claim 27, wherein the operation support information for each keyword is configured to include information of a group of operation items and setting items of the operation menu in a tree-structure;

wherein the operation support information for a keyword is generated by searching operation items and setting items in the operation menu that include the keyword, retrieving the operation items and setting items including the keyword, retrieving operation items in intermediary layers in a navigating path from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists, assembling the retrieved operation items and setting items into the tree-structure, assembling voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items, the information of the generated group of operation items and setting items and the voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items being associated with each other.

29. The apparatus operation device according to claim 27, wherein the voice information of the operation support information is generated using recorded voice data, and when outputting the voice information, the recorded voice data is reproduced.

30. The apparatus operation device according to claim 27, wherein the voice information of the operation support information is generated using compressed voice data, and when outputting the voice information, the compressed voice data is reproduced after having been decompressed.

31. The apparatus operation device according to claim 27, wherein the voice information of the operation support information is generated using text data, and when outputting the voice information, the text data is read using voice synthesis.

32. The apparatus operation device according to claim 27, wherein when a plurality of setting items relating to the keyword uttered by the user exist in the retrieved operation support information, the help operation part is configured to output voice guidance for the user to select one of the plurality of setting items relating to the keyword uttered by the user.

33. The apparatus operation device according to claim 32, wherein the voice guidance is configured such that the voice information explaining names of operation items or setting items is output sequentially starting from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists.

34. The apparatus operation device according to claim 33, wherein the help operation part is configured to allow the user to select the one of the plurality of setting items relating to the keyword using a ten-key pad or by a voice.

35. The apparatus operation device according to claim 27, further comprising:

a headset provided with a microphone for inputting an instruction for operating the apparatus by a voice and a headphone for outputting a result of operating the apparatus according to the input instruction by a sound and a voice, and a voice guidance for helping the user in operating the apparatus, the headset being configured to be connected with the apparatus operation device; and

wherein the apparatus is switched between the non-visual mode and the visual mode by a condition of the headset.

36. The apparatus operation device according to claim 35, further comprising:

a headset placement part for placing the headset;

a determining part configured to determine whether or not the headset is placed on the headset placement part; and

wherein the apparatus is switched between the non-visual mode and the visual mode by a result of determining with the determining part whether or not the headset is placed on the headset placement part.

37. The apparatus operation device according to claim 36, wherein when the determining part has determined that the headset is not placed on the headset placement part, the apparatus is switched to the non-visual mode.

38. The apparatus operation device according to claim 36, wherein when the determining part has determined that the headset is placed on the headset placement part, the apparatus is switched to the visual mode.

39. The apparatus operation device according to claim 36, wherein the determining part determines whether or not the headset is placed on the headset placement part by causing the headset placement part to be moved by weight of the headset.

40. The apparatus operation device according to claim 27, wherein the apparatus is configured such that when the apparatus is in the non-visual mode, an operation of the apparatus in the visual mode is not allowed.

41. The apparatus operation device according to claim 35, wherein the apparatus is configured to be switched between the non-visual mode and the visual mode when the headset is not placed on the headset placement part.

42. The operation device according to claim 27, wherein the apparatus is an image forming apparatus.

43. The operation device according to claim 27, wherein the apparatus is a multi-function peripheral.

133. An image forming apparatus, comprising:

an image forming device configured to form an image on a recording medium; and

the apparatus operation device according to claim 27, wherein the image forming device is operated by the apparatus operation device.

135. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium and including the apparatus operation device according to claim 27, the image forming apparatus being configured to be operated by the apparatus operation device; and

a personal computer connected with the image forming apparatus;

wherein an operating system of the apparatus operation device for operating the image forming apparatus in a non-visual mode for operating the image forming apparatus without using eyesight is incorporated in the personal computer.

137. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium and including the apparatus operation device according to claim 27, the image forming apparatus being configured to be operated by the apparatus operation device;

a personal computer connected with the image forming apparatus; and

wherein a part of the apparatus operation device relating to an operation of the image forming apparatus in a non-visual mode for operating the image forming apparatus without using eyesight is incorporated in the personal computer.

44. An apparatus operation method for operating an apparatus, comprising:

inputting an instruction for operating the apparatus without using eyesight; and

outputting information informing a user of a status of inputting the instruction for operating the apparatus and a result of inputting the instruction by a sound and a voice so that the user can operate the apparatus without using eyesight.

45. The apparatus operation method according to claim 44, wherein in the outputting step, when an operation is performed and/or completed by the apparatus according to the instruction for operating apparatus input in the inputting step, information informing the user of a progress and/or a result of the operation of the apparatus is output by a sound and a voice.

46. The apparatus operation method according to claim 44, wherein the apparatus comprises an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving a presently pointed position on the menu to a desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position.

47. The apparatus operation method according to claim 46, wherein each of the operation items and the setting items in the operation menu has a function number.

48. The apparatus operation method according to claim 46, wherein the apparatus comprises a directional movement key for moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu with the directional movement key to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position on the menu with the confirmation key.

49. The apparatus operation method according to claim 46, wherein the apparatus comprises a voice recognition device and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation item;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition by the voice recognition device of a word uttered by the user corresponding to the desired operation or setting item, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

50. The apparatus operation method according to claim 47, wherein the apparatus comprises a voice recognition device and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition by the voice recognition device of a function number of the desired operation or setting item, uttered by the user, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

51. The apparatus operation method according to claim 47, wherein the apparatus comprises a ten-key pad, and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item by inputting a function number of the desired operation or setting item with the ten-key pad, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

52. The apparatus operation method according to claim 46, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step the information informing a result of inputting the instruction for operating the apparatus is output by a sound icon corresponding to a type of the selected desired operation or setting item.

53. The apparatus operation method according to claim 46, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step the information informing a result of inputting the instruction for operating the apparatus is output by an operation sound or a piece of BGM;

wherein the output operation sound or piece of BGM depends upon a position of the selected desired operation or setting item on the operation menu.

54. The apparatus operation method according to claim 52, wherein in the outputting step, when the information informing a result of inputting the instruction for operating the apparatus is output by the sound icon, a property of the sound icon is changed.

55. The apparatus operation method according to claim 53, wherein in the outputting step, when the information informing a result of inputting the instruction for operating the apparatus is output by the operation sound or the piece of BGM, a property of the operation sound or piece of BGM is changed.

56. The apparatus operation method according to claim 46, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a name of the desired operation or setting item and a setting value to the desired operation or setting item are read by a voice.

57. The apparatus operation method according to claim 56, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, a property of the voice is changed.

58. The apparatus operation method according to claim 57, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation or setting item at the presently pointed position on the operation menu is an invalid operation or setting item, a pitch of the voice is changed to be lower than when the desired operation or setting item at the presently pointed position on the operation menu is a valid operation or setting item.

59. The apparatus operation method according to claim 57, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation or setting item at the presently pointed position on the operation menu is a selected operation or setting item or an operation or setting item to which a setting value has been set, a pitch of the voice is changed to be higher than when the desired operation or setting item at the presently pointed position on the menu is a non-selected operation or setting item or an operation or setting item to which a setting value has not been set.

60. The apparatus operation method according to claim 57, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation item at the presently pointed position on the operation menu is an operation item having sub-class operation items or setting items in a lower layer of the operation item in the layered tree-structure of the operation menu, a reverberant sound is added to the voice.

61. The apparatus operation method according to claim 46, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, if the selected desired setting item at the presently pointed position on the operation menu is a setting item to which a numerical value is to be input, in the outputting step a piece of BGM is output until the numerical value is input for the setting item.

62. The apparatus operation method according to claim 46, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a content of the desired operation or setting item is output by a voice.

63. The apparatus operation method according to claim 46, wherein the apparatus comprises a setting confirmation key that is configured, when operated, to move the presently pointed position on the operation menu to operation items and/or setting items in which predetermined setting values have been changed, sequentially;

wherein in the inputting step, if the setting confirmation key is operated, the presently pointed position on the operation menu is moved sequentially to the operation items and/or setting items in which predetermined setting values have been changed; and

wherein when the setting confirmation key has been operated and the presently pointed position on the operation menu has been moved sequentially to the operation items and/or setting items in which predetermined setting values have been changed in the inputting step, in the outputting step respective contents of the operation items and/or setting items are output by voices.

64. The apparatus operation method according to claim 46, wherein the apparatus comprises a partial clear key for returning setting values of operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, in which predetermined setting values have been changed, to the respective predetermined setting values;

and

wherein when the partial clear key has been operated in the inputting step, in the outputting step, for each of the operation items and/or setting items in which predetermined setting value have been changed, an inquiry about whether or not a setting value to the operation or setting item is to be returned to a predetermined setting value of the operation or setting item is output by a voice.

65. The apparatus operation method according to claim 46, wherein the apparatus comprises a partial clear key for returning setting values of operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, in which predetermined setting values have been changed, to the respective predetermined setting values;

and

wherein when the partial clear key is operated in the inputting step, in the outputting step an inquiry about whether or not all of setting values of the operation items and/or setting items in which predetermined setting values have been changed are to be returned to the respective predetermined setting values is output by a voice.

66. The apparatus operation method according to claim 46, wherein the apparatus comprises a display device, and wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the present pointed position in the inputting step, in the outputting step, a content of the selected desired operation or setting item at the presently pointed position is output by a voice and is displayed by the display device.

67. The apparatus operation method according to claim 46, wherein the apparatus comprises a display device and a visual input device configured to allow a user to input an instruction for operating the apparatus using eyesight;

wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a content of the selected desired operation or setting item at the presently pointed position is output by a voice and is displayed by the display device; and

wherein when an instruction for operating the apparatus relative to the content of the selected desired operation or setting item displayed by the display device has been input by the visual input device in the inputting step, in the outputting step information informing a status and a result of inputting the instruction for operating the apparatus by the visual input device is output by a sound and a voice.

68. The apparatus operation method according to claim 44, wherein the apparatus is an image forming apparatus.

69. The apparatus operation method according to claim 44, wherein the apparatus is a multi-function peripheral.

70. An apparatus operation method for operating an apparatus, the apparatus comprising an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure and being configured to be operated by selecting or setting a value to a setting item in the operation menu,

the method comprising:

storing operation support information for each keyword in an operation support information file, the operation support information comprising information of operation items and setting items including the keyword and voice information about the operation items and setting items including the keyword, wherein the information of the operation items and setting items including the keyword and the voice information are associated with each other; and

retrieving operation support information corresponding to a result of recognizing a keyword uttered by a user from the operation support information file and causing voice information of the retrieved operation support information to be output so that the user can select a setting item relating to the keyword uttered by the user based upon the voice information;

wherein when the apparatus is switched from a visual operation mode to a non-visual operation mode for operating the apparatus without using eyesight, the apparatus is operated by determining a setting item, which has been selected by the user in the retrieving step related to the keyword uttered by the user, to be a setting item designated by the user.

71. The apparatus operation method according to claim 70, wherein the operation support information for each keyword is configured to include information of a group of operation items and setting items of the operation menu in a tree-structure, wherein the operation support information for a keyword is generated by searching operation items and setting items in the operation menu that include the keyword, retrieving the operation items and setting items including the keyword, retrieving operation items in intermediary layers in a navigating path from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists, assembling the retrieved operation items and setting items into the tree-structure, and assembling voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items of the operation menu, the information of the generated group of operation items and setting items of the operation menu and the voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items of the operation menu being associated with each other.

72. The apparatus operation method according to claim 70, wherein the voice information of the operation support information is generated using recorded voice data, and in the retrieving step when the voice information is output, the recorded voice data is reproduced.

73. The apparatus operation method according to claim 70, wherein the voice information of the operation support information is generated using compressed voice data, and in the retrieving step when the voice information is output, the compressed voice data is reproduced after having been decompressed.

74. The apparatus operation method according to claim 70, wherein the voice information of the operation support information is generated using text data, and in the retrieving step when the voice information is output, the text data is read using voice synthesis.

75. The apparatus operation method according to claim 70, wherein in the retrieving step, when a plurality of setting items relating to the keyword uttered by the user exist in the retrieved operation support information, voice guidance for the user to select one of the plurality of setting items relating to the keyword uttered by the user is output.

76. The apparatus operation method according to claim 75, wherein the voice guidance is configured such that the voice information explaining names of operation items or setting items is output sequentially starting from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists.

77. The apparatus operation method according to claim 76, wherein in the retrieving step, the user is allowed to select one of the plurality of setting items relating to the keyword using a ten-key pad or by a voice.

78. The apparatus operation method according to claim 70, the apparatus comprising a headset provided with a microphone for inputting an instruction for operating the apparatus by a voice and a headphone for outputting a result of operating the apparatus according to the input instruction by a sound and a voice and a voice guidance for helping the user in operating the apparatus, the headset being configured to be connected with the apparatus;

the method further comprising;

switching the apparatus between the non-visual mode and a visual mode for operating the apparatus and/or using a touch panel of the apparatus by a condition of the headset.

79. The apparatus operation method according to claim 78, the apparatus further including a headset placement part for placing the headset,

the method further comprising:

determining whether or not the headset is placed on the headset placement part;

wherein in the switching step, the apparatus is switched between the non-visual mode and the visual mode by a result of determining whether or not the headset is placed on the headset placement part in the determining step.

80. The apparatus operation method according to claim 79, wherein when the determining step has determined as that the headset is not placed on the headset placement part, the apparatus is switched to the non-visual mode in the switching step.

81. The apparatus operation method according to claim 79, wherein when the determining step has determined as that the headset is placed on the headset placement part, the apparatus is switched to the visual mode in the switching step.

82. The apparatus operation method according to claim 79, wherein in the determining step whether or not the headset is placed on the headset placement part is determined by causing the headset placement part to be moved by the weight of the headset.

83. The apparatus operation method according to claim 70, wherein the apparatus is configured such that when the apparatus is in the non-visual mode, an operation of the apparatus in the visual mode is not allowed.

84. The apparatus operation method according to claim 78, wherein the apparatus is configured to be switched between the non-visual mode and the visual mode when the headset is not placed on the headset placement part.

85. The apparatus operation method according to claim 70, wherein the apparatus is an image forming apparatus.

86. The apparatus operation method according to claim 70, wherein the apparatus is a multi-function peripheral.

93. The computer program product according to claim 70, wherein the apparatus comprises a voice recognition device and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition by the voice recognition device of a function number of the desired operation or setting item, uttered by the user, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

87. A computer program product stored on a computer readable medium, the computer product comprising:

computer program instructions for causing the operation of an apparatus, the operation comprising the steps of;

inputting an instruction for operating the apparatus without using eyesight; and

outputting information informing a user of a status of inputting the instruction for operating the apparatus and a result of inputting the instruction by a sound and a voice so that the user can operate the apparatus without using eyesight.

88. The computer program product according to claim 87, wherein in the outputting step, when an operation is performed and/or completed by the apparatus according to the instruction for operating apparatus input in the inputting step, information informing the user of a progress and/or a result of the operation of the apparatus is output by a sound and a voice.

89. The computer program product according to claim 87, wherein the apparatus comprises an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving a presently pointed position on the menu to a desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position.

90. The computer program product according to claim 89, wherein each of the operation items and the setting items in the operation menu has a function number.

91. The computer program product according to claim 89, wherein the apparatus comprises a directional movement key for moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu with the directional movement key to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position on the menu with the confirmation key.

92. The computer program product according to claim 89, wherein the apparatus comprises a voice recognition device and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item with voice recognition by the voice recognition device of a word uttered by the user corresponding to the desired operation or setting item, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

94. The computer program product according to claim 90, wherein the apparatus comprises a ten-key pad, and a confirmation key for confirming selection of the desired operation or setting item at the presently pointed position on the operation menu;

and

wherein in the inputting step, the instruction for operating the apparatus is input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set by designating the desired operation or setting item by inputting a function number of the desired operation or setting item with the ten-key pad, and by confirming selection of the designated desired operation or setting item at the presently pointed position with the confirmation key.

95. The computer program product according to claim 89, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step the information informing a result of inputting the instruction for operating the apparatus is output by a sound icon corresponding to a type of the selected desired operation or setting item.

96. The computer program product according to claim 89, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step the information informing a result of inputting the instruction for operating the apparatus is output by an operation sound or a piece of BGM;

wherein the output operation sound or piece of BGM depends upon a position of the selected desired operation or setting item on the operation menu.

97. The computer program product according to claim 95, wherein in the outputting step, when the information informing a result of inputting the instruction for operating the apparatus is output by the sound icon, a property of the sound icon is changed.

98. The computer program product according to claim 96, wherein in the outputting step, when the information informing a result of inputting the instruction for operating the apparatus is output by the operation sound or the piece of BGM, a property of the operation sound or piece of BGM is changed.

99. The computer program product according to claim 89, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a name of the desired operation or setting item and a setting value to the desired operation or setting item are read by a voice.

100. The computer program product according to claim 99, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, a property of the voice is changed.

101. The computer program product according to claim 100, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation or setting item at the presently pointed position on the operation menu is an invalid operation or setting item, a pitch of the voice is changed to be lower than when the desired operation or setting item at the presently pointed position on the operation menu is a valid operation or setting item.

102. The computer program product according to claim 100, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation or setting item at the presently pointed position on the operation menu is a selected operation or setting item or an operation or setting item to which a setting value has been set, a pitch of the voice is changed to be higher than when the desired operation or setting item at the presently pointed position on the menu is a non-selected operation or setting item or an operation or setting item to which a setting value has not been set.

103. The computer program product according to claim 100, wherein in the outputting step, when the name of the desired operation or setting item at the presently pointed position on the operation menu is read by the voice, if the desired operation item at the presently pointed position on the operation menu is an operation item having sub-class operation items or setting items in a lower layer of the operation item in the layered tree-structure of the operation menu, a reverberant sound is added to the voice.

104. The computer program product according to claim 89, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, if the selected desired setting item at the presently pointed position on the operation menu is a setting item to which a numerical value is to be input, in the outputting step a piece of BGM is output until the numerical value is input for the setting item.

105. The computer program product according to claim 89, wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a content of the desired operation or setting item is output by a voice.

106. The computer program product according to claim 89, wherein the apparatus comprises a setting confirmation key that is configured, when operated, to move the presently pointed position on the operation menu to operation items and/or setting items in which predetermined setting values have been changed, sequentially;

wherein in the inputting step, if the setting confirmation key is operated, the presently pointed position on the operation menu is moved sequentially to the operation items and/or setting items in which predetermined setting values have been changed; and

wherein when the setting confirmation key has been operated and the presently pointed position on the operation menu has been moved sequentially to the operation items and/or setting items in which predetermined setting values have been changed in the inputting step, in the outputting step respective contents of the operation items and/or setting items are output by voices.

107. The computer program product according to claim 89, wherein the apparatus comprises a partial clear key for returning setting values of operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, in which predetermined setting values have been changed, to the respective predetermined setting values;

and

wherein when the partial clear key has been operated in the inputting step, in the outputting step, for each of the operation items and/or setting items in which predetermined setting value have been changed, an inquiry about whether or not a setting value of the operation or setting item is to be returned to a predetermined setting value of the operation or setting item is output by a voice.

108. The computer program product according to claim 89, wherein the apparatus comprises a partial clear key for returning setting values of operation items and/or setting items in lower layers of the presently pointed position on the operation menu in the layered tree-structure of the operation menu, in which predetermined setting values have been changed, to the respective predetermined setting values;

and

wherein when the partial clear key has been operated in the inputting step, in the outputting step an inquiry about whether or not all of setting values of the operation items and/or setting items in which predetermined setting values have been changed are to be returned to the respective predetermined setting values is output by a voice.

109. The computer program product according to claim 89, wherein the apparatus comprises a display device;

and

wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step, a content of the selected desired operation or setting item at the presently pointed position is output by a voice and is displayed by the display device.

110. The computer program product according to claim 89, wherein the apparatus comprises a display device and a visual input device configured to allow a user to input an instruction for operating the apparatus using eyesight;

wherein when the instruction for operating the apparatus has been input by moving the presently pointed position on the operation menu to the desired operation or setting item in the operation menu to select the desired operation or setting item to be set and by confirming selection of the desired operation or setting item at the presently pointed position in the inputting step, in the outputting step a content of the selected desired operation or setting item at the presently pointed position is output by a voice and is displayed by the display device; and

wherein when an instruction for operating the apparatus relative to the content of the selected desired operation or setting item displayed by the display device has been input by the visual input device in the inputting step, in the outputting step information informing a status and a result of inputting the instruction for operating the apparatus by the visual input device is output by a sound and a voice.

111. The computer program product according to claim 87, wherein the apparatus is an image forming apparatus.

112. The computer program product according to claim 87, wherein the apparatus is a multi-function peripheral.

113. The computer program product of claim 87, wherein the computer program product is loadable into an internal memory of a computer.

138. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium;

a personal computer connected with the image forming apparatus and in which the computer program product according to claim 113 is loaded; and

wherein the image forming apparatus is operated according to the computer program instructions of the computer program product.

114. A computer program product stored on a computer readable medium, the computer product comprising:

computer program instructions for causing the operation of an apparatus, wherein the apparatus comprises an operation menu in which operation items for a function of the apparatus and setting items for each operation item are arranged in a layered tree-structure and being configured to be operated by selecting or setting a value to a setting item in the operation menu, the operation comprising the steps of;

storing operation support information for each keyword in an operation support information file, the operation support information comprising information of operation items and setting items including the keyword and voice information about the operation items and setting items including the keyword, wherein the information of the operation items and setting items including the keyword and the voice information are associated with each other; and

retrieving operation support information corresponding to a result of recognizing a keyword uttered by a user from the operation support information file and causing voice information of the retrieved operation support information to be output so that the user can select a setting item relating to the keyword uttered by the user based upon the voice information,

wherein when the apparatus is switched from a visual operation mode to a non-visual operation mode for operating the apparatus without using eyesight, the apparatus is operated by determining a setting item, which has been selected by the user in the retrieving step related to the keyword uttered by the user, to be a setting item designated by the user.

115. The computer program product according to claim 114, wherein the operation support information for each keyword is configured to include information of a group of operation items and setting items of the operation menu in a tree-structure, wherein the operation support information for a keyword is generated by searching operation items and setting items in the operation menu that include the keyword, retrieving the operation items and setting items including the keyword, retrieving operation items in intermediary layers in a navigating path from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists, assembling the retrieved operation items and setting items into the tree-structure, and assembling voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items of the operation menu, the information of the generated group of operation items and setting items of the operation menu and the voice information explaining names of operation items or setting items at respective nodes of the tree-structure of the generated group of operation items and setting items of the operation menu being associated with each other.

116. The computer program product according to claim 114, wherein the voice information of the operation support information is generated using recorded voice data, and in the retrieving step when the voice information is output, the recorded voice data is reproduced.

117. The computer program product according to claim 114, wherein the voice information of the operation support information is generated using compressed voice data, and in the retrieving step when the voice information is output, the compressed voice data is reproduced after having been decompressed.

118. The computer program product according to claim 114, wherein the voice information of the operation support information is generated using text data, and in the retrieving step when the voice information is output, the text data is read using voice synthesis.

119. The computer program product according to claim 114, wherein in the retrieving step, when a plurality of setting items relating to the keyword uttered by the user exist in the retrieved operation support information, voice guidance for the user to select one of the plurality of setting items relating to the keyword uttered by the user is output.

120. The computer program product according to claim 119, wherein the voice guidance is configured such that the voice information explaining names of operation items or setting items is output sequentially starting from an uppermost layer in the layered tree-structure of the operation menu in which an operation item or setting item including the keyword exists to a lowermost layer in the layered tree-structure of the operation menu in which a setting item including the keyword exists.

121. The computer program product according to claim 120, wherein in the retrieving step, the user is allowed to select one of the plurality of setting items relating to the keyword using a ten-key pad or by a voice.

122. The computer program product according to claim 114, the apparatus comprising a headset provided with a microphone for inputting an instruction for operating the apparatus by a voice and a headphone for outputting a result of operating the apparatus according to the input instruction by a sound and a voice and a voice guidance for helping the user in operating the apparatus, the headset being configured to be connected with the apparatus,

the operation further comprising the step of:

switching the apparatus between the non-visual mode and a visual mode for operating the apparatus using a touch panel of the apparatus and/or by a condition of the headset.

123. The computer program product according to claim 122, the apparatus further including a headset placement part for placing the headset,

the operation further comprising the step of:

determining whether or not the headset is placed on the headset placement part;

wherein in the switching step, the apparatus is switched between the non-visual mode and the visual mode by a result of determining whether or not the headset is placed on the headset placement part in the determining step.

124. The computer program product according to claim 123, wherein when the determining step has determined as that the headset is not placed on the headset placement part, the apparatus is switched to the non-visual mode in the switching step.

125. The computer program product according to claim 123, wherein when the determining step has determined as that the headset is placed on the headset placement part, the apparatus is switched to the visual mode in the switching step.

126. The computer program product according to claim 123, wherein in the determining step whether or not the headset is placed on the headset placement part is determined by causing the headset placement part to be moved by the weight of the headset.

127. The computer program product according to claim 114, wherein the apparatus is configured such that when the apparatus is in the non-visual mode, an operation of the apparatus in the visual mode is not allowed.

128. The computer program product according to claim 122, wherein the apparatus is configured to be switched between the non-visual mode and the visual mode when the headset is not placed on the headset placement part.

129. The computer program product according to claim 114, wherein the apparatus is an image forming apparatus.

130. The computer program product according to claim 114, wherein the apparatus is a multi-function peripheral.

131. The computer program product of claim 114, wherein the computer program product is loadable into an internal memory of a computer.

139. An image forming system, comprising:

an image forming apparatus configured to form an image on a recording medium;

a personal computer connected with the image forming apparatus and in which the computer program product according to claim 131 is loaded; and

wherein the image forming apparatus is operated according to the computer program instructions of the computer program product.