HEAD MOUNTED DISPLAY APPARATUS AND IMAGE SHARING SYSTEM USING THE SAME

• US 20110128364A1
• Filed: 11/19/2010
• Published: 06/02/2011
• Est. Priority Date: 11/30/2009
• Status: Abandoned Application

• Current Assignee: Brother Kogyo Kabushiki Kaisha
• Original Assignee: Brother Kogyo Kabushiki Kaisha
• Inventors: Ono, Takatoshi
• Application Number:
  US12/950,399
• Publication Number:
  US 20110128364A1
• Time in Patent Office: Days
• US Class Current: 348/78
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A head mounted display external objects includes: an imaging unit imaging external objects; a first image acquiring unit configured acquiring a first image which shows first information of the work being done by the user; a second image acquiring unit acquiring a plurality of second images which are relevant to specific parts of the first image, the second images showing second information relevant to the first information of the work shown by the first image; a determining unit determining whether or not the plurality of second images are relevant to the work being done by the user, based on the image of external objects; an image forming unit forming, by an image beam, the first image and at least one of the second images determined by the determining unit to be relevant to the work being done by the user.

Claims

1. A head mounted display external objects comprising:

an imaging unit configured to image external objects;

a first image acquiring unit configured to acquire a first image which shows first information of the work being done by the user;

a second image acquiring unit configured to acquire a plurality of second images which are relevant to specific parts of the first image, the second images showing second information relevant to the first information of the work shown by the first image;

a determining unit configured to determine whether or not the plurality of second images are relevant to the work being done by the user, based on the image of external objects;

an image forming unit configured to form, by an image beam, the first image and at least one of the second images determined by the determining unit to be relevant to the work being done by the user.

2. The head mounted display apparatus according to claim 1, wherein

the first image comprises a manual image, the contents of which is sequentially converted according to a state of the work being done by the user, in order to show contents and order of the work to the user according to the state of work being done by the user, and

the specific parts of the first image comprises a page number or an index attached to the manual image.

3. The head mounted display apparatus according to claim 1 further comprising a specifying unit configured to specify an object image which is relevant to the work which the user are doing, in the external objects, and

wherein the determining unit determines the second image that is relevant to the object image.

4. The head mounted display apparatus according to claim 3, comprising a shape-recognizable unit configured to recognize a partial shape of a plurality of partial images, which is a part of the external objects,

wherein the specifying unit specifies, as the object image, the partial image having the partial shape conforming to the shape of any one of the second images.

5. The head mounted display apparatus according to claim 3, comprising:

a eye-imaging unit configured to image an eye of the user; and

an point-acquiring unit configured to acquire an intersecting point between a direction to which the user'"'"'s eye directs, and the image of the external objects,

wherein the specifying unit specifies, as the object image, the partial image at the intersecting point, which is a part of the image of the external objects.

6. The head mounted display apparatus according to claim 3 further comprising a finger-recognizable unit configured to recognize a finger shape of a finger image of the user, which is a part of the image of the external objects,

wherein the specifying unit specifies, as the object image, the partial image pointed by the finger image, which is a part of the plurality of partial images.

7. The head mounted display apparatus according to claim 1, wherein the first information comprises contents and order of the work, and the second information comprises an image of a successful case where the work related to the first information is successfully done or an image of a case of failure of failure where the work related to the first information is failed.

8. An image sharing system comprising:

the plurality of head mounted display apparatuses according to claim 1; and

an information processing unit connected to the head mounted display apparatuses,

wherein each of the head mounted display apparatuses comprises an image supplying unit configured to supply the image of the external objects to the information processing unit,

wherein the information processing unit comprises;

a first image memory part that stores the first image in advance;

a second image memory part that stores the second image in advance; and

a control unit storing, as new second images, the plurality of the image of external objects supplied from the image supplying units of the plurality of head mounted display apparatuses, in the second image memory part,

wherein the first image acquiring unit acquires the first image stored in the information processing unit,

wherein the second image acquiring unit acquires the plurality of second images stored in the information processing unit.

9. A method of controlling a head mounted display apparatus comprising:

imaging external objects;

acquiring a first image which shows first information of the work being done by the user, which is relevant to the external objects;

acquiring a plurality of second images which are relevant to specific parts of the first image, the second images showing second information relevant to the first information of the work shown by the first image;

determining whether or not the plurality of second images are relevant to the work being done by the user, based on the external objects;

forming, by an image beam, the first image and at least one of the second images determined by the determining unit to be relevant to the work being done by the user.