Head mounted display and control method for head mounted display

• US 10,261,327 B2
• Filed: 01/19/2018
• Issued: 04/16/2019
• Est. Priority Date: 01/31/2017
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Nishizawa, Kazuo
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US15/875,654
• Publication Number:
  US 20180217379A1
• Time in Patent Office: 452 Days
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A head mounted display includes a control section that switches between a single-touch mode and a multi-touch mode in a case where an operation in a preset aspect is detected, and, in the multi-touch mode, in a case where a pseudo-pointer is moved to a corresponding position outside a display region of an image display section according to an operation on an operation surface, the control section changes a display aspect of the pseudo-pointer.

Claims

1. A head mounted display comprising:

a head mounted type display section that is mounted on the head of a user;

an operation unit that is provided with an operation surface;

a detection section that detects an operation; and

a control section that is configured to execute a single-operation mode in which a first object which is an operation target is displayed on the display section, and a display position of the first object is changed according to an operation on the operation surface, and a multi-operation mode in which the first object and a second object are displayed on the display section, and display positions of the first object and the second object are changed according to an operation on the operation surface, and switches between the single-operation mode and the multi-operation mode in a case where an operation in a preset aspect is detected by the detection section,

wherein, in the multi-operation mode, in a case where the second object is moved to a corresponding position outside a display region of the display section according to an operation on the operation surface, the control section changes a display aspect of the second object.

2. The head mounted display according to claim 1,

wherein, in the multi-operation mode, the control section sets a coordinate management region for managing display positions of the first object and the second object, and changes coordinates indicating display positions of the first object and the second object in the coordinate management region according to an operation on the operation surface, and

wherein the coordinate management region has a size larger than a size of the display region.

3. The head mounted display according to claim 1,

wherein, in a case where an operation mode is changed to the multi-operation mode, the control section displays an auxiliary image indicating an operation position of an operation on the operation surface.

4. The head mounted display according to claim 3,

wherein, in a case where the operation position of an operation on the operation surface is located in a preset region of the operation surface, the control section displays the auxiliary image.

5. The head mounted display according to claim 1,

wherein the detection section detects movement of the display section, and

wherein, in a case where preset movement of the display section is detected by the detection section, the control section determines that an operation in a preset aspect is detected, and changes an operation mode from the single-operation mode to the multi-operation mode.

6. The head mounted display according to claim 1, further comprising:

an imaging section that captures an image in a range including external scenery visually recognized through the display section,

wherein, in a case where an image of the operation unit provided with the operation surface is included in an image captured by the imaging section, the control section determines that an operation in a preset aspect is detected, and changes an operation mode from the single-operation mode to the multi-operation mode.

7. The head mounted display according to claim 1,

wherein the operation unit includes a button for switching between the single-operation mode and the multi-operation mode, and

wherein, in a case where a pressing operation on the button is detected, the control section determines that an operation in a preset aspect is detected, and changes an operation mode from the single-operation mode to the multi-operation mode.

8. The head mounted display according to claim 7,

wherein the control section sets an operation mode to the multi-operation mode while the pressing operation on the button is continuously detected, and changes an operation mode to the single-operation mode in a case where the pressing operation on the button is not detected.

9. The head mounted display according to claim 1,

wherein, in the multi-operation mode, the control section displays the second object at a display position opposite to the first object with a set position which is set on the basis of an operation in a preset aspect interposed therebetween.

10. The head mounted display according to claim 9,

wherein, in the multi-operation mode, the control section switches between a first aspect in which the second object is displayed at a position which is point symmetric to the first object with the set position as the symmetric center, and a second aspect in which the second object is displayed at a position which is linearly symmetric to the first object with the set position as a symmetric axis.

11. The head mounted display according to claim 10,

wherein the detection section measures a touch area or pressing force on the operation surface in a case where a touch operation on the operation surface is performed, and

wherein the control section selects one of the first aspect and the second aspect on the basis of at least one of the touch area and the pressing force measured by the detection section.

12. The head mounted display according to claim 1,

wherein, in the multi-operation mode, the control section changes a display position of the first object according to an operation on the operation surface, and changes a display position of the second object according to a change of the display position of the first object.

13. The head mounted display according to claim 1,

wherein, in the multi-operation mode, in a case where continuous positions on the operation surface are indicated by a single indicator, the control section changes display positions of the first object and the second object.

14. The head mounted display according to claim 1,

wherein, in the multi-operation mode, the control section performs a process corresponding to changes of display positions of the first object and the second object.

15. A control method for a head mounted display including a head mounted type display section mounted on the head of a user, an operation unit provided with an operation surface, and a detection section detecting an operation, the method comprising:

executing a single-operation mode in which a first object which is an operation target is displayed on the display section, and a display position of the first object is changed according to an operation on the operation surface, and a multi-operation mode in which the first object and a second object are displayed on the display section, and display positions of the first object and the second object are changed according to an operation on the operation surface, and switching between the single-operation mode and the multi-operation mode in a case where an operation in a preset aspect is detected by the detection section; and

erasing display of the second object from a display region, in the multi-operation mode, in a case where the second object is moved to a corresponding position outside the display region of the display section according to an operation on the operation surface.