METHODS AND SYSTEMS FOR MERGING REAL WORLD MEDIA WITHIN A VIRTUAL WORLD

• US 20170291107A1
• Filed: 04/10/2017
• Published: 10/12/2017
• Est. Priority Date: 04/11/2016
• Status: Active Grant

• Current Assignee: Charles Chungyohl Lee
• Original Assignee: Charles Chungyohl Lee
• Inventors: Lee, Charles Chungyohl
• Granted Patent: US 10,150,034 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/833 Hand-to-hand fighting, e.g. martial arts competition A63F13/837 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Embodiments disclosed herein provide systems and methods for blending real world choreographed media within a virtual world, wherein the choreographed real world media is inserted into a moving template within the virtual world. Embodiments utilize software and camera hardware configured to capture real world media, wherein the software may insert the real world media within a template to insert images of a user within the virtual world. Embodiments may allow media capturing choreographed movements to be placed within a moving template within the virtual world.

Claims

1. A system for merging real world media into a virtual world, the system comprising:

a camera configured to record a performance video including frames, wherein the performance video includes real world movements of a user, the performance video including first time data corresponding with a performance frame zero;

a game interface configured to create a virtual world including a moving avatar within a reference video, the reference video including second time data corresponding with a reference frame zero;

a template interface configured to create a template within the virtual world based on movement of the avatar, the template being a blank area within the virtual world;

a match frame pair interface configured to transform the performance video such that the real world movements of the user align with the template based on the movement of the avatar, wherein the match frame pair interface is configured to create an initial match frame pair at a location where an image of the user within the performance video aligns with the template within the reference video, wherein the first time data associated with the performance video corresponds with a different frame number than the second time data.

2. The system of claim 1, wherein the performance video includes first positioning data and the reference video includes second positioning data.

3. The system of claim 2, further including:

a graphical user interface configured to alter the performance video, wherein via the graphical user interface the user is configured to align the first positioning data of the user within the performance video with the second positioning data associated with a location of the template within the reference video.

4. The system of claim 1, further including a second match frame pair, the second match frame pair associated a second frame of the performance video with a second frame of the reference video.

5. The system of claim 4, wherein the second match frame pair includes third time data associated with the second frame of the performance video and fourth time data associated with the second frame of the reference video, wherein a number of frames between the performance frame zero and the second frame of the performance video is different than a number of frames between the reference frame zero and the reference frame zero.

6. The system of claim 5, wherein an output video is created including a plurality of match frame pairs, wherein the plurality of match frame pairs include the first match frame pair and the second match frame pair.

7. The system of claim 1, wherein the template is a larger size than the avatar in the virtual world.

8. The system of claim 7, wherein the template is positioned at a same location as the avatar within the virtual world.

9. The system of claim 1, wherein the template is configured to be rotated in the virtual world, wherein a first degree of rotation of the template within the virtual world is less than a second degree of rotation of the avatar within the virtual world.

10. The system of claim 1, wherein the template is configured to be warped to add three dimensionality on in the virtual world.

12. The method of claim 1, wherein the performance video includes first positioning data and the reference video includes second positioning data.

13. The method of claim 12, further including:

altering, via a graphical user interface, the performance video to align the first positioning data of the user within the performance video with the second positioning data associated with a location of the template within the reference video.

15. The method of claim 4, wherein the second match frame pair includes third time data associated with the second frame of the performance video and fourth time data associated with the second frame of the reference video, wherein a number of frames between the performance frame zero and the second frame of the performance video is different than a number of frames between the reference frame zero and the reference frame zero.

16. The method of claim 5, further comprising:

creating an output video including a plurality of match frame pairs, wherein the plurality of match frame pairs include the first match frame pair and the second match frame pair.

11. A method for merging real world media into a virtual world, the method comprising:

recording a performance video including frames, wherein the performance video includes real world movements of a user, the performance video including first time data corresponding with a performance frame zero;

creating a virtual world including a moving avatar within a reference video, the reference video includes second time data corresponding with a reference frame zero;

creating a template within the virtual world based on movement of the avatar, the template being a blank area within the virtual world;

transforming, via a match frame pair interface, the performance video such that the real world movements of the user align with the template based on the movement of the avatar, wherein the match frame pair interface is configured to create an initial match frame pair at a location where an image of the user within the performance video aligns with the template within the reference video, wherein the first time data associated with the performance video corresponds with a different frame number than the second time data.

14. The method of claim 11, further including a second match frame pair, the second match frame pair associated a second frame of the performance video with a second frame of the reference video.

17. The method of claim 11, wherein the template is a larger size than the avatar in the virtual world.

18. The method of claim 17, further comprising:

positioning the template at a same location as the avatar within the virtual world.

19. The method of claim 11, further comprising:

rotating the template in the virtual world, wherein a first degree of rotation of the template within the virtual world is less than a second degree of rotation of the avatar within the virtual world.

20. The method of claim 11, further comprising:

warping the template to add three dimensionality in the virtual world.