Display apparatus and method of controlling display apparatus

• US 10,001,857 B2
• Filed: 05/09/2016
• Issued: 06/19/2018
• Est. Priority Date: 05/13/2015
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Kimura, Fusashi
• Primary Examiner(s): McLoone, Peter D
• Application Number:
  US15/149,710
• Publication Number:
  US 20160334911A1
• Time in Patent Office: 771 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A display apparatus includes an image display unit that allows a user to view an image. The display apparatus includes an operation detection unit that detects an operation on a track pad and a control unit that displays an operation target display object on the image display unit. The control unit controls a display position of the display object in response to an operation on the track pad, obtains a movement direction of the display object in response to a change in an operation position on the track pad, moves the display position of the display object, and stops moving the display object in a case in which an operation on the track pad corresponds to a preset ending condition.

Claims

1. A display apparatus comprising:

a display unit;

an operation detection unit that detects an operation on an operation surface; and

a control unit that causes the display unit to display an operation target display object and controls a display position of the display object in response to an operation on the operation surface,

wherein the control unit moves the display position of the display object in response to a change in an operation position on the operation surface detected by the operation detection unit and stops moving the display position of the display object in a case in which the operation detection unit detects an operation corresponding to a preset ending condition,

wherein the operation surface is in a separate housing spaced from a housing of the display unit, and

wherein the control unit detects the operation position in a case in which the operation detection unit detects a touch of an operation body on the operation surface, and the control unit determines that the operation corresponds to the ending condition in a case in which the operation detection unit detects that the touch is released, and then a predetermined time passes after a detection is made that the touch is released and no further touching is detected.

2. The display apparatus according to claim 1,

wherein the control unit sets a movement direction of the display position of the display object to a direction corresponding to a movement direction of the operation position on the operation surface.

3. The display apparatus according to claim 2,

wherein after the operation detection unit detects an operation on the operation surface, the control unit displays the display object at the display position corresponding to the operation position of the operation surface while a process of obtaining a movement direction of the display position of the display object is performed.

4. The display apparatus according to claim 1,

wherein the control unit sets a movement speed of the display position of the display object to a speed corresponding to a movement amount or a movement speed of the operation position on the operation surface.

5. The display apparatus according to claim 1,

wherein the control unit changes at least one of a movement speed and a movement direction of the display position of the display object in a case in which the operation position on the operation surface detected by the operation detection unit is changed during movement of the display position of the display object.

6. The display apparatus according to claim 1,

wherein the control unit changes at least one of a movement speed and a movement direction of the display position of the display object in response to an operation position of a new touch detected by the operation detection unit in a case in which the operation detection unit detects that the touch is released, and then the operation detection unit detects the touch on the operation surface within the predetermined time.

7. The display apparatus according to claim 1, further comprising:

an operation device that has the operation surface; and

a posture detection unit that detects a posture of the operation device or a change in the posture,

wherein the control unit changes at least one of a movement speed and a movement direction of the display position of the display object in response to the posture of the operation device or the change in the posture detected by the posture detection unit during movement of the display position of the display object.

8. The display apparatus according to claim 1,

wherein an area or a size in which the operation detection unit detects an operation on the operation surface is less than an area or a size of a display region in which an image is displayed by the display unit.

9. The display apparatus according to claim 1,

wherein a shape of the operation surface is a different shape from a display region in which an image is displayed by the display unit.

10. The display apparatus according to claim 1,

wherein the display apparatus is a head mounted display, the housing of the display unit is configured to be mounted on a user'"'"'s head such that the display unit is in front of the user'"'"'s eyes, and the operation surface is in a control device.

11. A display apparatus comprising:

a display unit;

an operation detection unit that detects an operation on an operation surface; and

a control unit that generates input data on a virtual input plane according to an operation detected by the operation detection unit,

wherein the control unit starts generating the input data on the virtual input plane in response to an operation of moving an operation position on the operation surface in a case in which the operation detection unit detects the operation, and the control unit stops generating the input data in a case in which the operation detection unit detects an operation corresponding to a preset ending condition,

wherein the operation surface is in a separate housing spaced from a housing of the display unit, and

wherein the control unit detects the operation position in a case in which the operation detection unit detects a touch of an operation body on the operation surface, and the control unit determines that the operation corresponds to the ending condition in a case in which the operation detection unit detects that the touch is released, and then a predetermined time passes after a detection is made that the touch is released and no further touching is detected.

12. The display apparatus according to claim 11,

wherein the input data generated by the control unit includes at least one of an input position on the virtual input plane, a movement direction of the input position inside the virtual input plane, and a movement speed of the input position inside the virtual input plane.

13. The display apparatus according to claim 12,

wherein the control unit sets at least one of the movement direction of the input position inside the virtual input plane and the movement speed of the input position inside the virtual input plane, which are included in the input data, according to a movement speed or a movement amount of the operation position detected by the operation detection unit.

14. The display apparatus according to claim 11,

wherein the operation detection unit detects a touch position as an operation position according to an operation of touching the operation surface with an operating body.

15. The display apparatus according to claim 11,

wherein the control unit is able to generate three-dimensional input data including the virtual input plane and a direction perpendicular to the virtual input plane according to an operation detected by the operation detection unit, and generates the input data including a component of the direction perpendicular to the virtual input plane in a case in which the operation detection unit detects an operation at a plurality of operation positions on the operation surface.

16. The display apparatus according to claim 11, further comprising:

an operation device that has the operation surface; and

a posture detection unit that detects a posture of the operation device or a change in the posture,

wherein the control unit changes correspondence between the operation surface and the virtual input plane in response to the posture of the operation device detected by the posture detection unit or the change in the posture.

17. The display apparatus according to claim 11,

wherein the virtual input plane is associated with a display region of the display unit, and

wherein the control unit causes the display unit to display an operation target display object and controls a display position of the display object in correspondence to the input data.

18. A method of controlling a display apparatus, the method comprising:

controlling the display apparatus including a display unit;

detecting an operation on an operation surface;

causing the display unit to display an operation target display object and controlling a display position of the display object in response to an operation on the operation surface; and

moving the display position of the display object in response to a change in an operation position on the operation surface and stopping moving the display position of the display object in a case in which an operation performed on the operation surface and corresponding to a preset ending condition is detected,

wherein the operation surface is in a separate housing spaced from a housing of the display unit, and

wherein the operation position is detected in a case in which a touch of an operation body on the operation surface is detected, and the operation corresponding to the ending condition is detected in a case in which the touch is released is detected, and then a predetermined time passes after a detection is made that the touch is released and no further touching is detected.