METHOD AND SYSTEM FOR PROVIDING AT LEAST A PORTION OF CONTENT HAVING SIX DEGREES OF FREEDOM MOTION

• US 20200134779A1
• Filed: 05/03/2019
• Published: 04/30/2020
• Est. Priority Date: 10/26/2018
• Status: Active Grant

• Current Assignee: Kagenova Ltd
• Original Assignee: Kagenova Ltd
• Inventors: McEwen, Jason D., Wallis, Christopher G.R., Ender, Martin
• Granted Patent: US 10,902,554 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 3/16 Spatio-temporal transformations, e.g. video cubism
• CPC Class Codes: G06T 3/18 Image warping, e.g. rearranging pixels individually
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation

Abstract

The present invention provides a method for providing with at least a portion of content having six degrees-of-freedom in a virtual environment, comprising: receiving, by at least one processor, the portion of content for the virtual environment; associating, by the at least one processor, at least one of a first geometric shape and a second geometric shape with the portion of content; projecting, by the at least one processor, the portion of content onto a first point of a surface of the first geometric shape; determining, by the at least one processor, based on the projecting of the portion of content onto the first point, a first outcome relating to the portion of content at the first position; projecting, by the at least one processor, the portion of content onto a second point of the surface of the first geometric shape or of a surface of the second geometric shape, the second point being different than the first point; determining, by the at least one processor, based on the projecting of the portion of content onto the second point, a second outcome relating to the portion of content at a second position in the virtual environment, the second position being different than the first position; and reformatting, by the at least one processor and based on the first outcome and the second outcome, the portion of content to have six degrees-of-freedom providing rotational motion and positional motion in the virtual environment.

Claims

1. A method for providing with at least a portion of content having six degrees-of-freedom in a virtual environment, comprising

receiving, by at least one processor, the portion of content for the virtual environment;

associating, by the at least one processor, at least one of a first geometric shape and a second geometric shape with the portion of content;

projecting, by the at least one processor, the portion of content onto a first point of a surface of the first geometric shape;

determining, by the at least one processor, based on the projecting of the portion of content onto the first point, a first outcome relating to the portion of content at the first position;

projecting, by the at least one processor, the portion of content onto a second point of the surface of the first geometric shape or of a surface of the second geometric shape, the second point being different than the first point;

determining, by the at least one processor, based on the projecting of the portion of content onto the second point, a second outcome relating to the portion of content at a second position in the virtual environment, the second position being different than the first position; and

reformatting, by the at least one processor and based on the first outcome and the second outcome, the portion of content to have six degrees-of-freedom providing rotational motion and positional motion in the virtual environment.

2. The method of claim 1, wherein the projecting of the portion of content onto the first point and the second point comprises:

mapping, by the at least one processor, the portion of content onto the first point of the surface of the geometric surface, and

mapping, by the at least one processor, the portion of content onto the second point of the surface of the first geometric shape or of the surface of the second geometric shape.

3. The method of claim 1, wherein the second point of the surface of the first geometric shape is projected onto the first geometric shape and the first geometric shape is a three-dimensional sphere.

4. The method of claim 1, wherein the second point of the surface of the first geometric shape is projected onto the surface of the second geometric shape.

5. The method of claim 4, wherein each of the first geometric shape and the second geometric shape is a sphere, and wherein a center of the first geometric shape is displaced from a center of the second geometric shape.

6. The method of claim 4, wherein:

the second point is projected onto the surface of the first geometric shape and the surface of the second geometric shape, and

the determining of the second outcome is performed separately using the surface of the first geometric shape and the surface of the second geometric shape.

7. The method of claim 4, wherein the determining of the first outcome or the determining of the second outcome comprises:

dividing, by the at least one processor, the portion of content into a plurality of regions including a first and second foreground region and a first and second background region, wherein the first foreground region and the first background region is projected onto the first geometric shape and the second foreground region and the second background region is projected onto the second geometric shape such that the first geometric shape comprises the first foreground region and the first background region and the second geometric shape comprises the second foreground region and the second background region; and

distorting, by the at least one processor, the first geometric shape and the second geometric shape.

8. The method of claim 1, further comprising:

converting, by the at least one processor, the portion of content to provide 360°

of information of the portion of content.

9. The method of claim 8, wherein:

the receiving the portion of content for the virtual environment comprises receiving to the portion of content from a first camera and a second camera, and

the associating the at least one of the first geometric shape and the second geometric shape with the portion of content comprises associating at least one of the first geometric shape and the second geometric shape with the first camera and the second camera, respectively.

10. The method of claim 9, wherein the first camera or and the second camera is configured to move at a given velocity based on a direction of movement or a distance of an object, wherein each of the direction of movement and the distance of the object relates to a first point of reference and a second point of reference in the portion of the content for the virtual environment.

11. The method of claim 9, further comprising:

calibrating, by the at least one processor, the first moving camera or the second moving camera based on a distance of a first point of reference from an object at a second point of reference in the portion of the content for the virtual environment.

12. The method of claim 1, wherein the portion of content comprises one of a sound, an image, and a video.

13. The method of claim 1, wherein each of the first geometric shape and the second geometric shape is a sphere.

14. The method of claim 12, wherein the sphere is three-dimensional.

15. A system, comprising:

a memory comprising instructions; and

at least one processor coupled to the memory, wherein the instructions are configured to cause the processor to;

receive at least a portion of content for a virtual environment;

associate at least one of a first geometric shape and a second geometric shape with the portion of content;

project the portion of content onto a first point of a surface of the first geometric shape;

determine, based on the projection of the portion of content onto the first point, a first outcome relating to the portion of content at the first position;

project the portion of content onto a second point of the surface of the first geometric shape or of a surface of the second geometric shape, the second point being different than the first point;

determine, based on the projecting of the portion of content onto the second point, a second outcome relating to the portion of content at a second position in the virtual environment, the second position being different than the first position; and

reformat, based on first outcome and the second outcome, the portion of content to have six degrees-of-freedom providing rotational motion and positional motion in the virtual environment.

16. The system of claim 15, wherein the second point of the surface of the first geometric shape is projected onto the first geometric shape and the first geometric shape is a three-dimensional spherical model.

17. The system of claim 15, wherein the second point of the surface of the first geometric shape is projected onto the surface of the second geometric shape.

18. The system of claim 15, wherein during at least one of the determine the first outcome and determine the second outcome, the processor is configured to:

divide the portion of content into a plurality of regions including a first and second foreground region and a first and second background region, wherein the first foreground region and the first background region is projected onto the first geometric shape and the the second foreground object and the second background object is projected onto the second geometric shape such that the first geometric shape comprises the first foreground region and the first background region and the second geometric shape comprises the second foreground region and the second background region; and

distort the first geometric and the second geometric shape.

19. The system of claim 15, wherein the portion of content comprises one of a sound, an image, and a video.

20. A tangible computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

receiving at least a portion of content for a virtual environment;

associating at least one of a first geometric shape and a second geometric shape with the portion of content;

projecting the portion of content onto a first point of a surface of the first geometric shape;

determining, based on the projection of the portion of content onto the first point, a first outcome relating to the portion of content at the first position;

projecting the portion of content onto a second point of the surface of the first geometric shape or of a surface of the second geometric shape, the second point being different than the first point;

determining, based on the projecting of the portion of content onto the second point, a second outcome relating to the portion of content at a second position in the virtual environment, the second position being different than the first position; and

reformatting, based on the first outcome and the second outcome, the portion of content to have six degrees-of-freedom including rotational motion and positional motion in the virtual environment.