HEAD-MOUNTED INTEGRATED INTERFACE

• US 20150138065A1
• Filed: 11/21/2013
• Published: 05/21/2015
• Est. Priority Date: 11/21/2013
• Status: Abandoned Application

• Current Assignee: NVIDIA Corporation
• Original Assignee: NVIDIA Corporation
• Inventors: Alfieri, Robert
• Application Number:
  US14/086,109
• Publication Number:
  US 20150138065A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A head mounted integrated interface (HMII) is presented that may include a wearable head-mounted display unit supporting two compact high resolution screens for outputting a right eye and left eye image in support of the stereoscopic viewing, wireless communication circuits, three-dimensional positioning and motion sensors, and a processing system which is capable of independent software processing and/or processing streamed output from a remote server. The HMII may also include a graphics processing unit capable of also functioning as a general parallel processing system and cameras positioned to track hand gestures. The HMII may function as an independent computing system or as an interface to remote computer systems, external GPU clusters, or subscription computational services, The HMII is also capable linking and streaming to a remote display such as a large screen monitor.

Claims

1. A user-wearable apparatus comprising:

at least one display disposed in front of an eye of a user and configured to present a computer-generated image to the user;

at least two cameras, each camera being associated with a respective field-of-view, wherein the respective fields-of-view overlap to allow a gesture of the user to be captured;

a gesture input module coupled to the at least two cameras and configured to receive visual data from the at least two cameras and identify the user gesture within the visual data, wherein the identified gesture is used to affect the computer-generated image presented to the user.

2. The apparatus of claim 1, wherein the gesture input module is configured to map the identified gesture to a predetermined action in a virtual environment, wherein the predetermined action is used to generate the computer-generated image presented to the user.

3. The apparatus of claim 1, further comprising a power module configured to power the apparatus and permit mobile operation of the apparatus.

4. The apparatus of claim 1, wherein the at least two cameras are disposed on the apparatus such that, when the apparatus is worn by the user, the respective fields-of-view capture user gestures below a bottom surface of the apparatus.

5. The apparatus of claim 1, wherein the gesture input module is configured to distinguish the user gesture using at least sub-millimeter movement resolution.

6. The apparatus of claim 1, wherein the at least one display comprises a first screen and a second screen, each screen being disposed in front of a respective eye of the user, and wherein a first image displayed on the first screen and a second image displayed on the second screen are perceived by the user as the computer-generated image.

7. The apparatus of claim 1 further comprising a wireless network adapter configured to communicate with a remote computing device to create the computer-generated image based on the identified gesture.

8. The apparatus of claim 7, wherein the wireless network adapter is further configured to communicate with a remote display in order to display at least a portion of the computer-generated image on the remote display.

9. The apparatus of claim 1, further comprising logic configured to switch the apparatus into a mode of operation wherein, without external communication with any remote device;

the gesture input module is configured to receive visual data from the at least two cameras and identify the gesture within the visual data, and

the identified gesture is used to affect the computer-generated image presented to the user.

10. A method for providing an image to a user, the method comprising:

capturing visual data using at least two cameras disposed on a user-wearable apparatus, each camera being associated with a respective field-of-view, wherein the respective fields-of-view overlap to allow a gesture of the user to be captured;

indentifying, using the user-wearable apparatus, the user gesture within the visual data; and

generating the image displayed to the user based on the identified gesture, wherein the image is presented on a display integrated into the user-wearable apparatus.

11. The method of claim 10, further comprises:

mapping the identified gesture to a predetermined action in a virtual environment, wherein the predetermined action is used to generate the image presented to the user.

12. The method of claim 10, further comprising a power module configured to power the apparatus and permit mobile operation of the apparatus.

13. The method of claim 10, wherein the at least two cameras are disposed on the apparatus such that, when the apparatus is worn by the user, the respective fields-of-view capture user gestures below a bottom surface of the apparatus.

14. The method of claim 10, wherein the user gesture is identified using at least sub-millimeter movement resolution.

15. The method of claim 10, further comprising:

displaying a first image on a first screen of the display; and

displaying a second image on a second screen of the display, wherein the first and second screens are disposed in front of a respective eye of the user, and wherein the first image and the second image are perceived by the user as a combined image.

16. The method of claim 10, further comprising wirelessly communicating with a remote computing system that provides additional graphics processing for generating the image displayed to the user based on the identified gesture.

17. A system comprising:

an apparatus configured to be wearable on a head of a user;

the apparatus comprising;

at least one display disposed in front of an eye of the user and configured to present a computer-generated image to the user,

a wireless network adapter; and

a remote computing system configured to communicate with the wireless network adapter, the remote computing system comprising graphic processing unit (GPU) cluster configured to generate at least a portion of the computer-generated image presented on the display of the apparatus.

18. The system of claim 17 wherein the remote computing system is associated with a subscription service that provides access to the GPU clusters for a fee.

19. The system of claim 17, wherein the remote computing system is a cloud-based resource.

20. The system of claim 17, further comprising a wide-access network configured to provide connectivity between the wireless adapter and the remote computing resource, wherein the remote computing system is configured to use data compression when communicating with the wireless network adapter.