GUIDANCE INFORMATION DISPLAY DEVICE

• US 20140126018A1
• Filed: 10/30/2013
• Published: 05/08/2014
• Est. Priority Date: 11/06/2012
• Status: Active Grant

• Current Assignee: Konica Minolta Inc.
• Original Assignee: Konica Minolta Inc.
• Inventors: Sugimoto, Yasuaki
• Granted Patent: US 9,760,168 B2
• Time in Patent Office: Days
• US Class Current: 358/1.15
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/1204 resulting in reduced user or operator actions, e.g. presetting, automatic actions, using hardware token storing data
• CPC Class Codes: G06F 3/1253 Configuration of print job parameters, e.g. using UI at the client
• CPC Class Codes: G06F 3/1256 User feedback, e.g. print preview, test print, proofing, pre-flight checks
• CPC Class Codes: G06F 3/128 Direct printing, e.g. sending document file, using memory stick, printing from a camera
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 1/00251 with an apparatus for taking photographic images, e.g. a camera
• CPC Class Codes: H04N 1/00408 Display of information to the user, e.g. menus
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/00493 Particular location of the interface or console
• CPC Class Codes: H04N 1/00503 Customising to a particular machine or model, machine function or application
• CPC Class Codes: H04N 1/00803 Presence or absence of information
• CPC Class Codes: H04N 1/00806 According to type of the original, e.g. colour paper or transparency, or reading a plurality of different types of original
• CPC Class Codes: H04N 1/00809 : Orientation
• CPC Class Codes: H04N 1/00811 : according to user specified instructions, e.g. user selection of reading mode
• CPC Class Codes: H04N 1/00814 : according to a detected condition or state of the reading apparatus, e.g. temperature
• CPC Class Codes: H04N 1/00824 : for displaying or indicating, e.g. a condition or state details of displaying or indicating means H04N1/00405
• CPC Class Codes: H04N 1/2158 : using a detachable storage unit
• CPC Class Codes: H04N 1/2323 : according to characteristics of the reproducing medium, e.g. type, size or availability
• CPC Class Codes: H04N 1/2346 : according to a detected condition or state of the reproducing device, e.g. temperature or ink quantity
• CPC Class Codes: H04N 1/2392 : for displaying or indicating, e.g. a condition or state details of displaying or indicating means H04N1/00405

Abstract

Disclosed is a guidance information display device, including: a display unit; a camera unit; an action detecting unit to detect a specific action of a user; and a control unit to instruct the display unit to display guidance information when the specific action is detected by the action detecting unit and a specific instrument to be operated is shot by the camera unit, the displayed guidance information corresponding to a combination of the detected specific action and the shot instrument to be operated.

Claims

1. A guidance information display device, comprising:

a display unit;

a camera unit;

an action detecting unit configured to detect a specific action of a user; and

a control unit configured to instruct the display unit to display guidance information when the specific action is detected by the action detecting unit and a specific instrument to be operated is shot by the camera unit, the displayed guidance information corresponding to a combination of the detected specific action and the shot instrument to be operated.

2. The guidance information display device of claim 1, wherein the control unit instructs the display unit to display the guidance information corresponding to the combination of the detected specific action and the shot instrument to be operated, in accordance with a state of the instrument to be operated or a portion of the instrument to be operated, which is shot by the camera unit.

3. The guidance information display device of claim 1, wherein the action detecting unit detects the specific action in accordance with an image obtained by the camera unit.

4. The guidance information display device of claim 1, wherein the specific action is a specific input operation carried out for an operating unit of the instrument to be operated.

5. The guidance information display device of claim 3, wherein the specific action is a specific gesture of the user.

6. The guidance information display device of claim 1, wherein the action detecting unit comprises a sound detecting unit to detect specific sound information as the specific action.

7. The guidance information display device of claim 2, further comprising a communication unit,

wherein the control unit obtains information relating to the state of the instrument to be operated, by using the communication unit.

8. The guidance information display device of claim 2, wherein the control unit recognizes the state of the instrument to be operated, in accordance with an image of the instrument to be operated, which is obtained by the camera unit.

9. The guidance information display device of claim 7, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches an external memory and the instrument comprising a connection I/F unit for the external memory, the control unit obtains information relating to the connection I/F unit of the instrument to be operated, by using the communication unit and instructs the display unit to display the guidance information in accordance with the obtained information relating to the connection I/F unit.

10. The guidance information display device of claim 9, wherein the control unit obtains information relating to a status of the connection I/F unit by using the communication unit and instructs the display unit to display the information relating to the connection I/F unit which is available for connection of the external memory which the user picks up or watches, as the guidance information.

11. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches a blank sheet and an image forming apparatus having a function of printing an image on the blank sheet, the control unit instructs the display unit to display information indicating a position of a feed tray which is matched with a size of the blank sheet, as the guidance information.

12. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches an original for which a duplex printing is carried out and a reading device having a function of optically reading both surfaces of a sheet, the control unit instructs the display unit to display the guidance information relating to a setting for reading both surfaces of the original.

13. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches an original and a reading device having a function of optically reading both surfaces of a sheet, only when a print situation of the original is not matched with a one-side/two-side reading setting of the reading device, the control unit instructs the display unit to display the guidance information relating to a switching of the one-side/two-side reading setting.

14. The guidance information display device of claim 3, wherein the control unit instructs the display unit to display the guidance information corresponding to the combination of the detected specific action and the shot instrument to be operated, in accordance with a portion of the instrument to be operated, which is shot by the camera unit;

and

in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches a letter head sheet and an image forming apparatus having a function of printing an image on the letter head sheet, when the shot portion of the image forming apparatus is a feed tray of the image forming apparatus, the control unit instructs the display unit to display the guidance information relating to a correct setting of the letter head sheet to the feed tray.

15. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user intends to arrange two sheets of an original in order on a platen glass of a reading device having a function of optically reading the original and the reading device, the control unit instructs the display device to display the guidance information relating to a method for setting a second sheet of the original so as to match a direction of the second sheet with a direction of a first sheet of the original according to the direction of the first sheet which is shot by the camera unit when the specific action is detected.

16. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches a stapler or a clip and an image forming apparatus having a function of printing an image on sheets, the control unit judges whether the sheets can be bound by the image forming apparatus, and

when the control unit judges that the sheets can be bound by the image forming apparatus, the control unit instructs the display device to display the guidance information relating to a function of binding the sheets in the image forming apparatus.

17. The guidance information display device of claim 3, wherein in case that the combination of the detected specific action and the shot instrument to be operated is a combination of the specific action in which the user picks up or watches a punch machine and an image forming apparatus having a function of printing an image on a sheet, the control unit judges whether the sheet can be punched by the image forming apparatus, and

when the control unit judges that the sheet can be punched by the image forming apparatus, the control unit instructs the display unit to display the guidance information relating to a punching function of the image forming apparatus.

18. The guidance information display device of claim 1, wherein the display unit is a head-mounted display in which an image is overlapped with an outside scene by using a half mirror, and

the camera unit is provided in the head-mounted display.

19. The guidance information display device of claim 1, wherein the control unit instructs the display unit to display the guidance information by overlapping the guidance information with an actual image of the instrument to be operated.