Body-centric mobile point-of-view augmented and virtual reality

• US 10,134,188 B2
• Filed: 12/21/2015
• Issued: 11/20/2018
• Est. Priority Date: 12/21/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Needham, Bradford H.
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US14/976,428
• Publication Number:
  US 20170178364A1
• Time in Patent Office: 1,065 Days
• Field of Search: 345633
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Embodiments of a system and methods for displaying virtual or augmented reality are generally described herein. An image of a user may be captured using a camera. Real space in the image may be mapped and a first orientation may be determined relative to a static portion of the user, using the image. A first portion of a virtual reality image may be displayed on a display screen. In response to determining a second orientation of the device relative to the static portion of the user, a second portion of the virtual reality image may be displayed on a display screen.

Claims

1. A device to display virtual reality, the device comprising:

a camera to;

capture an image of a user;

processing circuitry to;

map real space that is visible to the camera using the image;

determine a first relative orientation between the device and a static portion of the user using the image; and

determine that the first relative orientation is maintained while a position of the device and the user together changes relative to a fixed object;

a display device to;

display a first portion of a virtual reality image on a display screen of the device;

maintain display of the first portion of the virtual reality image in response to the processing circuitry determining that the first relative orientation is maintained while the position of the device and the user together changes relative to the fixed object; and

display, in response to the processing circuitry determining a second relative orientation between the device and the static portion of the user, a second portion of the virtual reality image on the display screen, wherein a third relative orientation between a head of the user and the device is maintained from the first relative orientation to the second relative orientation.

2. The device of claim 1, wherein the portion of the user is a torso captured in the image.

3. The device of claim 2, wherein to determine the orientation, the processing circuitry is to create a three-dimensional model of the torso and determine a location and orientation of the three-dimensional model of the torso relative to the display.

4. The device of claim 2, wherein to determine the orientation, the processing circuitry is to determine edges of shoulders of the torso.

5. The device of claim 1, wherein the device includes virtual reality glasses.

6. The device of claim 1, further comprising an accelerometer, and wherein to determine the first orientation of the device relative to the static portion of the user, the processing circuitry is to determine the first orientation using the accelerometer.

7. A method for displaying virtual reality, the method comprising:

capturing, at a device, an image of a user using a camera of the device;

mapping real space that is visible to the camera using the image;

determining a first relative orientation between the device and a static portion of the user using the image;

displaying a first portion of a virtual reality image on a display screen of the device;

determining that the first relative orientation is maintained while a position of the device and the user together changes relative to a fixed object;

maintaining display of the first portion of the virtual reality image in response to determining that the first relative orientation is maintained while the position of the device and the user together changes relative to the fixed object; and

in response to determining a second relative orientation between the device and the static portion of the user, displaying a second portion of the virtual reality image on the display screen, wherein a third relative orientation between a head of the user and the device is maintained from the first relative orientation to the second relative orientation.

8. The method of claim 7, wherein the portion of the user is a torso captured in the image.

9. The method of claim 8, wherein determining the first orientation includes creating a three-dimensional model of the torso and determining a location and orientation of the three-dimensional model of the torso relative to the display.

10. The method of claim 9, wherein determining the first orientation includes determining edges of shoulders of the torso.

11. The method of claim 7, wherein the device is a mobile device.

12. The method of claim 7, wherein the device includes virtual reality glasses.

13. The method of claim 12, wherein determining the first orientation includes determining a third orientation of a head relative to a torso using a sensor.

14. The method of claim 7, wherein capturing the image of the user includes capturing the image with a wide-angle camera.

15. The method of claim 7, wherein capturing the image of the user includes capturing the picture using a depth camera.

16. The method of claim 7, wherein mapping real space and determining the first orientation of the device include using simultaneous location and mapping.

17. The method of claim 7, wherein determining the first orientation includes using a sensor attached to the static portion of the user.

18. The method of claim 7, wherein determining the first orientation of the device relative to the static portion of the user includes determining the first orientation using an accelerometer.

19. At least one non-transitory machine readable medium including instructions that, when executed, cause the machine to perform operations for displaying virtual reality, the operations comprising:

capturing, at a device, an image of a user using a camera of the device;

mapping real space that is visible to the camera using the image;

determining a first relative orientation between the device and a static portion of the user using the image;

displaying a first portion of a virtual reality image on a display screen of the device;

determine that the first relative orientation is maintained while a position of the device and the user together changes relative to a fixed object;

maintain display of the first portion of the virtual reality image in response to determining that the first relative orientation is maintained while the position of the device and the user together changes relative to the fixed object; and

in response to determining a second relative orientation between the device and the static portion of the user, displaying a second portion of the virtual reality image on the display screen, wherein a third relative orientation between a head of the user and the device is maintained from the first relative orientation to the second relative orientation.

20. The at least one machine readable medium of claim 19, wherein the portion the user is a torso captured in the image.

21. The at least one machine readable medium of claim 20, wherein determining the first orientation includes creating a three-dimensional model of the torso and determining a location and orientation of the three-dimensional model of the torso relative to the display.

22. The at least one machine readable medium of claim 20, wherein determining the first orientation includes determining edges of shoulders of the torso.

23. The at least one machine readable medium of claim 19, wherein the device includes virtual reality goggles.

24. The at least one machine readable medium of claim 19, wherein determining the first orientation includes determining a second orientation of a head relative to a torso using a sensor.