Display device, method of controlling display device, and program

• US 10,296,104 B2
• Filed: 02/03/2017
• Issued: 05/21/2019
• Est. Priority Date: 02/16/2016
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Sendai, Kaori, Nishizawa, Kazuo, Kimura, Fusashi, Takano, Masahide
• Primary Examiner(s): Lee, Nicholas J
• Application Number:
  US15/424,110
• Publication Number:
  US 20170235380A1
• Time in Patent Office: 837 Days
• Field of Search: None
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

An HMD includes an image display unit that makes a user visually perceive an image, and an control device, capable of being moved independently of the image display unit, which includes a six-axis sensor detecting a movement and a track pad receiving an operation. The HMD controls the display of the image display unit in accordance with the movement detected by the six-axis sensor in a state where the track pad receives an operation.

Claims

1. A head-mounted display device including a display that makes a user visually perceive an image, the head-mounted display device comprising:

an operation device, capable of being moved independently of the display, which includes a sensor detecting a movement of the operation device and an input device receiving an operation different from the detection of the sensor; and

a processor programmed to;

control displaying of the display in accordance with the movement detected by the sensor when the input device receives an operation; and

detect the operation received by the input device within a set time after the sensor detects start of a movement as a trigger for controlling the display based on the movement of the operation device.

2. The display device according to claim 1,

wherein the input device receives at least any one of a pressing operation and a contact operation.

3. The display device according to claim 1,

wherein the processor is further programmed to change a display magnification of an image displayed on the display when a movement corresponding to an operation of rotating the operation device is detected by the sensor.

4. The display device according to claim 1,

wherein the processor is further programmed to change an image displayed on the display in a direction which is set in advance, when a movement corresponding to an operation of lifting down the operation device or an operation of lifting up the operation device is detected by the sensor.

5. The display device according to claim 1,

wherein the processor is further programmed to change display of the display in a state where the input device receives an operation, and then fixedly sets a change in the display of the display when the operation is canceled.

6. The display device according to claim 1,

wherein the processor is further programmed to perform a predetermined function when the input device receives an operation, and perform a normal mode in which the predetermined function is performed when the input device receives an operation and a display operation mode in which the display of the display is controlled in accordance with the movement detected by the sensor in a state where the input device receives an operation, in a changeover manner.

7. The display device according to claim 6,

wherein when execution of performing the display operation mode has started, the processor is further programmed to reflect a detection history detected by the sensor during a period between when the sensor detects start of a movement and when the input device receives an operation, to thereby control display of the display.

8. The display device according to claim 1,

wherein the operation device includes a second processor that is programmed to receive a position indication operation.

9. The display device according to claim 8,

wherein the processor is further programmed to change display of the display on the basis of a display position corresponding to a position which is indicated by a position indication operation received by the second processor in a state where the position indication operation is received by the second processor and the input device receives an operation.

10. The display device according to claim 9,

wherein the processor is further programmed to display an image displayed on the display in an enlarged or reduced manner, centering on the display position corresponding to the position which is indicated by the position indication operation received by the second processor.

11. The display device according to claim 8,

wherein the second processor functions as the input device.

12. The display device according to claim 9, further comprising:

a display sensor that detects a movement of the display,

wherein the processor is further programmed to specify an indication position of an operation received by the second processor at a timing when the display sensor detects a predetermined movement.

13. The display device according to claim 1,

wherein the processor is further programmed to perform control of moving an image displayed on the display in a first display operation direction and a second display operation direction paired with the first display operation direction, and

wherein the first display operation direction is associated with a first movement direction detected by the sensor, and the second display operation direction is associated with a second movement direction detected by the sensor.

14. The display device according to claim 1,

wherein the operation device is a wearable device which is worn on the user'"'"'s body.

15. A head-mounted display device including a display that makes a user visually perceive an image, the head-mounted display device comprising:

an operation device, capable of being moved independently of the display, which includes a sensor detecting a movement of the operation device,

wherein the operation device includes an input device that receives an operation; and

a processor programmed to;

control displaying of the display in accordance with the movement detected by the sensor;

perform a first display change corresponding to a movement in a first movement direction which is detected by the sensor and a second display change corresponding to a movement in a second movement direction which is detected by the sensor, as a process performed on an image displayed on the display;

start the first display change when the movement in the first movement direction is detected, and then stops the first display change when the movement in the second movement direction is detected by the sensor; and

detect the operation received by the input device within a set time after the sensor detects start of a movement as a trigger for controlling the display based on the movement of the operation device.

16. The display device according to claim 15,

wherein the processor is further programmed to perform the first display change when the movement in the first movement direction is detected by the sensor, and performs the second display change when the movement in the second movement direction is detected by the sensor.

17. The display device according to claim 15,

wherein the processor is further programmed to change display of the display in accordance with the movement detected by the sensor in a state where the input device receives an operation.

18. The display device according to claim 15,

wherein the operation device is a wearable device which is worn on the user'"'"'s body.

19. A method of controlling a head-mounted display device including a display that makes a user visually perceive an image, the method comprising:

moving an operation device independently of the display, the operation device including a sensor and an input device;

detecting, by the sensor, a movement of the operation device;

receiving an operation by the input device;

controlling display of the display in accordance with the movement detected by the sensor when the input device receives an operation; and

detecting the operation received by the input device within a set time after the sensor detects start of a movement as a trigger for controlling the display based on the movement of the operation device.

20. A method of controlling a head-mounted display device including a display that makes a user visually perceive an image, the method comprising:

moving an operation device independently of the display, the operation device including a sensor and an input device that receives an operation;

detecting, by the sensor, a movement of the operation device;

performing a first display change corresponding to a movement in a first movement direction which is detected by the sensor and a second display change corresponding to a movement in a second movement direction which is detected by the sensor, as a process performed on an image displayed on the display;

starting the first display change when the movement in the first movement direction is detected, and then stopping the first display change when the movement in the second movement direction is detected by the sensor; and

detecting the operation received by the input device within a set time after the sensor detects start of a movement as a trigger for controlling the display based on the movement of the operation device.