Wearable Display, Computer-Readable Medium Storing Program and Method for Receiving Gesture Input

• US 20150009103A1
• Filed: 09/24/2014
• Published: 01/08/2015
• Est. Priority Date: 03/29/2012
• Status: Abandoned Application

• Current Assignee: Brother Kogyo Kabushiki Kaisha
• Original Assignee: Brother Kogyo Kabushiki Kaisha
• Inventors: Ito, Kunihiro, Inoue, Hiroshi
• Application Number:
  US14/495,448
• Publication Number:
  US 20150009103A1
• Time in Patent Office: Days
• US Class Current: 345/8
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A wearable display control device may perform extracting, storing, obtaining, determining and controlling. The extracting may extract a characteristic quantity indicating a characteristic of a particular part. The storing may store a first characteristic quantity in a memory. The obtaining may obtain gesture data of the particular part from second captured data captured after the first characteristic quantity is stored in the memory. The gesture data may indicate a gesture of the particular part. The determining may determine whether the first characteristic quantity corresponds to a second characteristic quantity extracted from the second captured data. The controlling may control a specific process that controls a display device in response to determining that the first characteristic quantity corresponds to the second characteristic quantity and may not control the specific process in response to determining that the first characteristic quantity does not correspond to the second characteristic quantity.

Claims

1. A wearable display control device comprising:

one or more processors; and

a memory storing computer-readable instructions therein, the computer-readable instructions, when executed by the one or more processors, causing the wearable display control device to perform processes comprising;

extracting a characteristic quantity from captured data including first captured data and second captured data obtained from a camera, the characteristic quantity indicating a characteristic of a particular part, the particular part being a reference for a gesture input;

storing a first characteristic quantity in first storage, the first characteristic quantity being the characteristic quantity extracted from the first captured data;

obtaining gesture data of the particular part from the second captured data, the second captured data being captured by the camera after the first characteristic quantity is stored in the first storage, the gesture data indicating a gesture of the particular part;

determining whether the first characteristic quantity stored in the first storage corresponds to a second characteristic quantity, the second characteristic quantity being extracted from the second captured data; and

controlling a specific process that controls a display device in response to determining that the first characteristic quantity corresponds to the second characteristic quantity and not controlling the specific process in response to determining that the first characteristic quantity does not correspond to the second characteristic quantity, the specific process being stored in second storage in association with the gesture data.

2. The wearable display control device according to claim 1, wherein the storing comprises storing the first characteristic quantity before starting to obtain the gesture data.

3. The wearable display control device according to claim 1, wherein the storing comprises storing the first characteristic quantity after starting to obtain the gesture data and when an instruction to store the first characteristic quantity is received by the wearable display control device.

4. The wearable display control device according to claim 1, further comprises:

an attaching portion configured to be mountable on a head of a user and to detachably support the display device; and

the camera provided in at least one of the display device and the attaching portion.

5. The wearable display control device according to claim 4, further comprises:

an acceleration sensor provided in the display device and configured to detect acceleration corresponding to movement of the display device and generate an acceleration signal based on the detected acceleration,

wherein the computer-readable instructions, when executed by the one or more processors, instruct the one or more processors to perform processes further comprising;

determining whether a moving direction of the particular part indicated by the gesture data is opposite to a moving direction of the camera specified by the acceleration signal,

wherein the controlling further comprises not controlling the specific process in response to determining that the moving direction of the particular part is opposite to the moving direction of the camera.

6. The wearable display control device according to claim 4, wherein controlling the specific process comprises controlling the display device to change a displayed image from one image to another image.

7. The wearable display control device according to claim 4, wherein the first characteristic quantity and the second characteristic quantity vary according a distance between the camera and the particular part.

8. The wearable display control device according to claim 1, wherein the particular part is a hand of a user.

9. A non-transitory computer-readable medium storing computer readable instructions, the instructions, when executed by a processor of a wearable display control device, perform processes comprising:

extracting a characteristic quantity from captured data including first captured data and second captured data obtained from a camera of the wearable display control device, the characteristic quantity indicating a characteristic of a particular part, the particular part being a reference for a gesture input;

storing a first characteristic quantity in first storage, the first characteristic quantity being the characteristic quantity extracted from the first captured data;

obtaining gesture data of the particular part from the second captured data, the second captured data being captured by the camera after the first characteristic quantity is stored in the first storage, the gesture data indicating a gesture of the particular part;

determining whether the first characteristic quantity stored in the first storage corresponds to a second characteristic quantity, the second characteristic quantity being extracted from the second captured data; and

controlling a specific process that controls a display device in response to determining that the first characteristic quantity corresponds to the second characteristic quantity and not controlling the specific process in response to determining that the first characteristic quantity does not correspond to the second characteristic quantity, the specific process being stored in second storage in association with the gesture data.

10. The non-transitory computer-readable medium according to claim 9, wherein storing comprises storing the first characteristic quantity before starting to obtain the gesture data.

11. The non-transitory computer-readable medium according to claim 9, wherein the storing comprises storing the first characteristic quantity after starting to obtain the gesture data and when an instruction to store the first characteristic quantity is received by the wearable display control device.

12. The non-transitory computer-readable medium according to claim 9, further comprises:

determining whether a moving direction of the particular part indicated by the gesture data is opposite to a moving direction of a camera of the wearable display control device, the moving direction being specified by an acceleration signal received from an acceleration sensor of the wearable display control device,

wherein the controlling comprises not controlling the specific process in response to determining that the moving direction of the particular part is opposite to the moving direction of the camera.

13. The non-transitory computer-readable medium according to claim 9, wherein controlling the specific process comprises controlling the display device to change a displayed image from one image to another image.

14. The non-transitory computer-readable medium according to claim 9, wherein the first characteristic quantity and the second characteristic quantity vary according a distance between the camera and the particular part.

15. A method comprising:

extracting a characteristic quantity from captured data obtained from a camera of a wearable display control device, the characteristic quantity indicating a characteristic of a particular part, the particular part being a reference for a gesture input;

obtaining gesture data of the particular part from the captured data, the gesture data indicating a gesture of the particular part;

determining whether a first characteristic quantity stored in a first memory corresponds to a second characteristic quantity, the second characteristic quantity being extracted from the captured data; and

controlling a specific process that controls a display device in response to determining that the first characteristic quantity corresponds to the second characteristic quantity and not controlling the specific process in response to determining that the first characteristic quantity does not correspond to the second characteristic quantity, the specific process being stored in a second memory in association with the gesture data.

16. The method according to claim 15 further comprises:

storing the first characteristic quantity in the first memory, the first characteristic quantity being the characteristic quantity extracted from another captured data before starting to obtain the gesture data.

17. The method according to claim 16, wherein storing further comprises storing the first characteristic quantity in the first memory after starting to obtain the gesture data and when an instruction to store the first characteristic quantity is received by the wearable display control device.

18. The method according to claim 15, further comprises:

determining whether a moving direction of the particular part indicated by the gesture data is opposite to a moving direction of a camera of the wearable display control device, the moving direction being specified by an acceleration signal received from an acceleration sensor of the wearable display control device,

wherein the controlling comprises not controlling the specific process in response to determining that the moving direction of the particular part is opposite to the moving direction of the camera.

19. The method according to claim 15, wherein controlling the specific process comprises controlling the display device to change a displayed image from one image to another image.

20. The method according to claim 15, wherein the first characteristic quantity and the second characteristic quantity vary according a distance between the camera and the particular part.