MODULAR MULTI-MODE VIRTUAL REALITY HEADSET

• US 20170039766A1
• Filed: 08/07/2015
• Published: 02/09/2017
• Est. Priority Date: 08/07/2015
• Status: Active Grant

• Current Assignee: KAYA Dynamics LLC
• Original Assignee: Ariadne's Thread (Usa), Inc.
• Inventors: PASSMORE, Charles Gregory, LI, Adam
• Granted Patent: US 9,990,008 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0176 characterised by mechanical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 3/012 Head tracking input arrangements

Abstract

A modular virtual reality headset that may be operated in multiple modes. Embodiments enable a mount with modular receivers having electronic and mechanical interfaces that accept swappable modules. Swappable modules may include swappable display modules, swappable audio modules, and swappable sensor modules. Embodiments enable multiple modes of operation, including for example a virtual mode to display virtual reality environments, a real mode to display images of the real environment surrounding the user, and an augmented reality mode that overlays real scenes with other information. Embodiments may also provide multiple modes of operation for audio.

Claims

1. A modular multi-mode virtual reality headset comprising

amount configured to be attached to a head of a user;

a display processor coupled to said mount;

a display module receiver coupled to said mount;

one or more swappable display modules, each configured to be detachably coupled to said display module receiver and located in front of said user'"'"'s eyes when coupled to said display module receiver, each comprising

one or more displays;

optionally one or more cameras;

optionally one or more display user input controls;

a display module electronic interface integrated into said display module receiver, comprising

a pixel channel that transfers pixel data from said display processor to said one or more displays;

a camera video channel that transfers camera video captured by said one or more cameras to said display processor;

a camera control channel that transfers camera control commands from said display processor to said one or more cameras;

a display user input channel that transfers user input commands from said one or more optional display user input controls to said display processor;

wherein said display processor is configured to function in a plurality of operating modes comprising

a virtual mode wherein

said pixel data is generated from a model or a stored capture;

a real mode wherein

said pixel data comprises said camera video;

an augmented reality mode wherein

said pixel data comprises said camera video overlaid with text or graphics or images generated or obtained by said display processor.

2. The system of claim 1 further comprising

one or more audio module receivers coupled to said mount;

an audio mixing processor coupled to said mount;

one or more swappable audio modules, each configured to be detachably coupled to one of said one or more audio module receivers and located proximal to one or more of said user'"'"'s ears when coupled to said audio module receiver, each comprising

one or more speakers;

optionally one or more microphones;

optionally one or more audio user input controls;

an audio module electronic interface integrated into each of said one or more audio module receivers, each comprising

an audio output channel that transfers output sound data from said audio mixing processor to said one or more speakers;

an audio input channel that transfers input sound data captured by said one or more microphones to said audio mixing processor;

a microphone control channel that transfers microphone control commands from said audio mixing processor to said one or more microphones;

an audio user input channel that transfers user input commands from said one or more optional audio user input controls to said audio mixing processor;

wherein said audio mixing processor is configured to function in a plurality of operating modes comprising

a virtual mode wherein

said output sound data is generated from a model or a stored capture;

a real mode wherein

said output sound data comprises said input sound data;

an augmented reality mode wherein

said output sound data comprises said input sound data modified by said audio mixing processor.

3. The system of claim 1 further comprising

one or more sensor module receivers coupled to said mount;

a sensor data processor coupled to said mount;

one or more swappable sensor modules, each configured to be detachably coupled to one of said one or sensor module receivers, each comprising one or more sensors that measure one or sensor data values indicative of one or more of

a position of said user;

an orientation of said user;

a change in the position of said user;

a change in the orientation of said user;

a sensor module electronic interface integrated into each of said one or more sensor module receivers, each comprising

a sensor data channel that transfers sensor data from said one or more sensors to said sensor data processor;

wherein said sensor data processor

calculates said position of said user, or said orientation of said user, or both of said position of said user and said orientation of said user, from said one or more sensor data values;

transfers said position of said user, or said orientation of said user, or both of said position of said user and said orientation of said user to said display processor.

4. The system of claim 1, wherein one or more of said one or more swappable display modules comprise

a left display located in front of a left eye of said user, wherein said left display is tangent to a left plane;

a right display located in front of a right eye of a user, wherein said right display is tangent to a right plane;

one or more lenses located between the left and right eyes of said user and the left and right displays;

wherein

an angle between said left plane and said right plane is less than 180 degrees, when measured from a side closest to the left and right eyes of said user;

said left display forms a left display image by said one or more lenses that is substantially in focus for said left eye of said user;

said right display forms a right display image by said one or more lenses that is substantially in focus for said right eye of said user;

said left display image viewed by said left eye of said user extends across a wider horizontal field of view than said left display viewed by said left eye of said user without said one or more lenses; and

,

said right display image viewed by said right eye of said user extends across a wider horizontal field of view than said right display viewed by said right eye of said user without said one or more lenses.

5. The system of claim 4 wherein

said left display is substantially flat;

and,

said right display is substantially flat.

6. The system of claim 4 wherein at least one of said one or more lenses comprise a gradient index lens.

7. The system of claim 4 wherein at least one of said one or more lenses comprise a Fresnel lens.

8. The system of claim 4 wherein at least one of said one or more lenses comprise a holographic optical element.

9. The system of claim 4 wherein a combined horizontal field of view of said left display image and said right display image is at least 120 degrees.

10. The system of claim 4 wherein a combined horizontal field of view of said left display image and said right display image is at least 150 degrees.

11. The system of claim 4 wherein a combined horizontal field of view of said left display image and said right display image is at least 180 degrees.

12. The system of claim 4, wherein one or more of said one or more swappable display modules further comprise

a left peripheral light emitter located on a left side of said left display;

a right peripheral light emitter located on a right side of said right display;

wherein

light from said left peripheral light emitter is projected left of the left display image; and

,

light from said right peripheral light emitter is projected right of the right display.

13. The system of claim 12, wherein said left peripheral light emitter and said right peripheral light emitter each comprise a plurality of peripheral light pixels located at different vertical positions.

14. The system of claim 13, wherein a vertical resolution of said peripheral light pixels is less than a vertical resolution of each of said one or more displays.

15. The system of claim 12, wherein one or more of said one or more swappable display modules further comprise

one or more left reflective surfaces located to the left of said one or more displays;

one or more right reflective surfaces located to the right of said one or more displays;

wherein

at least a portion of said light from said left peripheral light emitter is reflected from said one or more left reflective surfaces towards said left eye of said user;

at least a portion of said light from said right peripheral light emitter is reflected from said one or more right reflective surfaces towards said right eye of said user.

16. The system of claim 12, wherein a total horizontal field-of-view spanned by said left display image, said right display image, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 180 degrees.

17. A modular multi-mode virtual reality headset comprising

a mount configured to be attached to a head of a user;

a display processor coupled to said mount;

a display module receiver coupled to said mount;

one or more swappable display modules, each configured to be detachably coupled to said display module receiver and located in front of said user'"'"'s eyes when coupled to said display module receiver, each comprising

one or more displays;

optionally one or more cameras;

optionally one or more display user input controls;

a display module electronic interface integrated into said display module receiver, comprising

a pixel channel that transfers pixel data from said display processor to said one or more displays;

a camera video channel that transfers camera video captured by said one or more cameras to said display processor;

a camera control channel that transfers camera control commands from said display processor to said one or more cameras;

a display user input channel that transfers user input commands from said one or more optional display user input controls to said display processor;

one or more audio module receivers coupled to said mount;

an audio mixing processor coupled to said mount;

one or more swappable audio modules, each configured to be detachably coupled to one of said one or more audio module receivers and located proximal to one or more of said user'"'"'s ears when coupled to said audio module receiver, each comprising

one or more speakers;

optionally one or more microphones;

optionally one or more audio user input controls;

an audio module electronic interface integrated into each of said one or more audio module receivers, each comprising

an audio output channel that transfers output sound data from said audio mixing processor to said one or more speakers;

an audio input channel that transfers input sound data captured by said one or more microphones to said audio mixing processor;

a microphone control channel that transfers microphone control commands from said audio mixing processor to said one or more microphones;

an audio user input channel that transfers user input commands from said one or more optional audio user input controls to said audio mixing processor;

one or more sensor module receivers coupled to said mount;

a sensor data processor coupled to said mount;

one or more swappable sensor modules, each configured to be detachably coupled to one of said one or sensor module receivers, each comprising one or more sensors that measure one or sensor data values indicative of one or more of

a position of said user;

an orientation of said user;

a change in the position of said user;

a change in the orientation of said user;

a sensor module electronic interface integrated into each of said one or more sensor module receivers, each comprising

a sensor data channel that transfers sensor data from said one or more sensors to said sensor data processor;

wherein said display processor is configured to function in a plurality of operating modes comprising

a virtual mode wherein

said pixel data is generated from a model or a stored capture;

a real mode wherein

said pixel data comprises said camera video;

an augmented reality mode wherein

said pixel data comprises said camera video overlaid with text or graphics or images generated or obtained by said display processor;

wherein said audio mixing processor is configured to function in a plurality of operating modes comprising

a virtual mode wherein

said output sound data is generated from a model or a stored capture;

a real mode wherein

said output sound data comprises said input sound data;

an augmented reality mode wherein

said output sound data comprises said input sound data modified by said audio mixing processor;

wherein said sensor data processor

calculates said position of said user, or said orientation of said user, or both of said position of said user and said orientation of said user, from said one or more sensor data values;

transfers said position of said user, or said orientation of said user, or both of said position of said user and said orientation of said user to said display processor and to said audio mixing processor.

18. The system of claim 17, wherein one or more of said one or more swappable display modules comprise

a left display located in front of a left eye of said user, wherein said left display is tangent to a left plane;

a right display located in front of a right eye of a user, wherein said right display is tangent to a right plane;

one or more lenses located between the left and right eyes of said user and the left and right displays;

wherein

an angle between said left plane and said right plane is less than 180 degrees, when measured from a side closest to the left and right eyes of said user;

said left display forms a left display image by said one or more lenses that is substantially in focus for said left eye of said user;

said right display forms a right display image by said one or more lenses that is substantially in focus for said right eye of said user;

said left display image viewed by said left eye of said user extends across a wider horizontal field of view than said left display viewed by said left eye of said user without said one or more lenses; and

,

said right display image viewed by said right eye of said user extends across a wider horizontal field of view than said right display viewed by said right eye of said user without said one or more lenses;

at least one of said one or more lenses comprise a gradient index lens or a Fresnel lens or a holographic optical element.

19. The system of claim 18 wherein

said left display is substantially flat;

and,

said right display is substantially flat.

20. The system of claim 18, wherein one or more of said one or more swappable display modules further comprise

a left peripheral light emitter located on a left side of said left display and comprising a plurality of peripheral light pixels located at different vertical positions;

a right peripheral light emitter located on a right side of said right display and comprising a plurality of peripheral light pixels located at different vertical positions;

wherein

a vertical resolution of said peripheral light pixels is less than a vertical resolution of each of said one or more displays.

light from said left peripheral light emitter is projected left of the left display image; and

,

light from said right peripheral light emitter is projected right of the right display

a total horizontal field-of-view spanned by said left display image, said right display image, said light from said left peripheral light emitter viewed by said user, and said light from said right peripheral light emitter viewed by said user is at least 180 degrees.