TRANSMISSION-TYPE DISPLAY DEVICE, DISPLAY CONTROL METHOD, AND COMPUTER PROGRAM

• US 20180259775A1
• Filed: 03/01/2018
• Published: 09/13/2018
• Est. Priority Date: 03/13/2017
• Status: Abandoned Application

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Ono, Takehiro, Mori, Yuichi
• Application Number:
  US15/909,554
• Publication Number:
  US 20180259775A1
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 9/44 Arrangements for executing specific programs
• CPC Class Codes: G06F 9/445 Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

A transmission-type display device includes: a light-transmissive image display unit; a function information acquisition unit which acquires function information of an operation target device; a display control unit which causes an operation GUI of the operation target device to be displayed, using the acquired function information; and an operation detection unit which detects a predetermined gesture of a user of the transmission-type display device. The display control unit causes the operation GUI to be displayed as superimposed on an external field transmitted through the image display unit and visually recognized, at a display position determined according to a position of the detected gesture.

Claims

1. A transmission-type display device comprising:

a light-transmissive image display unit;

a function information acquisition unit which acquires function information of an operation target device;

a display control unit which causes an operation GUI of the operation target device to be displayed, using the acquired function information; and

an operation detection unit which detects a predetermined gesture of a user of the transmission-type display device,

wherein the display control unit causes the operation GUI to be displayed as superimposed on an external field transmitted through the image display unit and visually recognized, at a display position determined according to a position of the detected gesture.

2. The transmission-type display device according to claim 1, wherein

the display position of the operation GUI is determined as a relative position to the position of the detected gesture as a reference.

3. The transmission-type display device according to claim 1, wherein

the display control unit causes the operation GUI to be displayed in an area excluding a center part on the image display unit.

4. The transmission-type display device according to claim 1, wherein

the display control unit causes at least one of image, name, and color associated in advance with a function indicated by the acquired function information, to be displayed on the operation GUI.

5. The transmission-type display device according to claim 1, wherein

content of an operation on the operation GUI and a gesture of the user are associated with each other in advance, and

the display control unit executes an operation on the operation GUI according to the detected gesture of the user.

6. The transmission-type display device according to claim 1, wherein

the function information acquisition unit acquires the function information, triggered by completion of connection between the operation target device and the transmission-type display device.

7. The transmission-type display device according to claim 1, wherein

the display control unit causes the operation GUI to be displayed if the detected gesture is a predetermined gesture.

8. The transmission-type display device according to claim 1, wherein

the display control unit causes the operation GUI to be displayed if a gesture of the user is detected in a display area of the image display unit.

9. The transmission-type display device according to claim 1, wherein

the display control unit causes information related to the function information to be displayed in an area where the operation GUI is not displayed, in the display area of the image display unit.

10. A display control method for a transmission-type display device having a light-transmissive image display unit, the method comprising:

acquiring function information of an operation target device;

causing an operation GUI of the operation target device to be displayed, using the acquired function information;

detecting a predetermined gesture of a user of the transmission-type display device; and

causing the operation GUI to be displayed as superimposed on an external field transmitted through the image display unit and visually recognized, at a display position determined according to a position of the detected gesture.

11. A computer program for achieving a display control method for a transmission-type display device having a light-transmissive image display unit, the computer program causing a computer to achieve functions of:

acquiring function information of an operation target device;

causing an operation GUI of the operation target device to be displayed, using the acquired function information;

detecting a predetermined gesture of a user of the transmission-type display device; and

causing the operation GUI to be displayed as superimposed on an external field transmitted through the image display unit and visually recognized, at a display position determined according to a position of the detected gesture.