SYSTEM AND METHOD FOR RENDERING VIRTUAL REALITY INTERACTIONS

• US 20190066384A1
• Filed: 08/21/2018
• Published: 02/28/2019
• Est. Priority Date: 08/30/2017
• Status: Active Grant

• Current Assignee: Ronald H. Winston
• Original Assignee: Ronald H. Winston
• Inventors: Winston, Ronald H.
• Granted Patent: US 11,145,124 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

A Virtual Reality (VR) computer system and method including a VR headset to be worn by at least one user; one or more pupil sensors located in the VR headset configured and operative to capture and track pupil movement of the at least one user wearing the VR headset; and at least one camera device operative to capture video image of at least one user wearing the VR headset. A computer processor is instructed to generate a two-dimensional (2D) image of the least one user such that an image of the VR headset is virtually removed from the image of the at least one user wearing the VR headset.

Claims

1. A method for creating Virtual Reality (VR) interactions between two or more users wherein at least one user is wearing a VR headset, comprising:

generating a two-dimensional (2D) image of at least one user wearing a VR headset using a camera device wherein positioned in the headset is one or more sensors that detect and record pupil images;

tracking the pupil movement of the user using the one or more sensors;

removing a headset image from the generared 2D image of the user wearing the headset; and

stitching in the detected and recorded pupil image of the at least one user so as to be superimposed in an area proximate to where the headset image was removed from the at least one user such that the generated 2D image of the at least one can be viewed by another user whereby an image of the VR headset worn by the at least one user is removed and replaced by the at least one user'"'"'s pupils.

2. The method as recited in claim 1, wherein the 2D image is created using a webcam.

3. The method as recited in claim 1, wherein the one or more sensors include infrared LED sensors.

4. The method as recited in claim 3, wherein the one or more sensors further include micro video camera for recording aspects of a user'"'"'s pupil.

5. The method as recited in claim 1, wherein user'"'"'s may view each other in real-time.

6. A computer-readable storage medium accessed by a computer system for providing instructions and data to the computer system that cause the computer system to perform the following:

receive from a camera device an image of at least one user wearing a VR headset;

utlizing one or more sensors located in the VR headset, capture and track pupil movement of the at least one user wearing the VR headset;

generate a two-dimensional (2D) image of the least one user using the camera device such that an image of the VR headset is virtually removed from the image of the at least one user wearing the VR headset; and

stitching in the generated 2D image a detected and recorded pupil image of the at least one user captued by the one or more sensors such that the at least one user'"'"'s pupil image is superimposed proximate to the location the headset image was virtually removed from the generated 2D image of the at least one user such that another user can view a VR image of the at least one user having pupil images superimposed in the area the headset image was virtually removed.

7. The computer system as recited in claim 6, wherein the camera device is a webcam.

8. The computer system as recited in claim 6, wherein the one or more sensors located in the VR headset include infrared LED sensors.

9. The computer system as recited in claim 8, wherein the one or more sensors further include a video camera for capturing video image of the user'"'"'s pupil.

10. The computer system as recited in claim 6, wherein the generated 2D image of the user having the superimposed pupil image and movement is rendered in real-time.

11. A Virtual Reality (VR) computer system, comprising:

a VR headset to be worn by at least one user;

one or more pupil sensors located in the VR headset configured and operative to capture and track pupil movement of the at least one user wearing the VR headset;

at least one camera device operative to capture video image of at least one user wearing the VR headset;

a computer processor having instrutions to;

receive from the camera device a video image of the at least one user wearing the VR headset;

utlizing the one or more pupil sensors, capture and track pupil movement of the at least one user wearing the VR headset;

generate a two-dimensional (2D) image of the least one user such that an image of the VR headset is virtually removed from the image of the at least one user wearing the VR headset; and

stitching in the generated 2D image detected and recorded pupil image of the user captued by the one or more sensors such that the at least one user'"'"'s pupil image is superimposed proximate to the location the headset image was virtually removed from the generated 2D image of the at least user such that another user can view a VR image of the at least one user having the superimposed pupil image and movement such that the at least one user was not wearing the VR headset.

12. The VR system as recited in claim 11, wherein the camera device is a webcam.

13. The VR system as recited in claim 11, wherein the one or more sensors located in the VR headset include infrared LED sensors.

14. The VR system as recited in claim 13, wherein the one or more sensors further include a video camera for capturing video image of the user'"'"'s pupil.

15. The VR system as recited in claim 11, wherein the generated 2D image of the user having the superimposed pupil image and movement is rendered in real-time.