Personal communication via immersive computing environment

• US 20190066378A1
• Filed: 08/23/2017
• Published: 02/28/2019
• Est. Priority Date: 08/23/2017
• Status: Abandoned Application

• Current Assignee: Blueprint Reality, Inc.
• Original Assignee: Blueprint Reality, Inc.
• Inventors: Sheftel, Benjamin James
• Application Number:
  US15/684,005
• Publication Number:
  US 20190066378A1
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/525 Changing parameters of virtual cameras
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: H04L 65/1059 End-user terminal functionalities specially adapted for real-time communication
• CPC Class Codes: H04L 65/1063 Application servers providing network services systems providing special services to telephonic subscribers H04M3/42
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

An immersive computing system generates a virtual reality or mixed reality video relating to a user of the system and transmits it to a user of a remote device. The remote device sends a video relating to the remote user to the user of the immersive system. The video from the remote user is incorporated into the virtual world of the immersive user, enabling personal communication between the remote user and the immersive user, without the immersive user needing to exit the virtual world. The video transmitted from the immersive system to the remote user may be a first-person or a third-person view. The remote device may be conventional and transmit a real-world video, or immersive and transmit a virtual or mixed reality video.

Claims

1. A method for enabling personal communication comprising the steps of:

receiving, in an immersive computing system, a first video feed transmitted via a network from a source;

creating, by the immersive computing system, a three-dimensional computer-generated scene comprising a virtual screen;

adjusting the first video feed to fit the virtual screen;

displaying a first view of the three-dimensional computer-generated scene with the adjusted first video feed on an immersive device within the immersive computing system;

generating, by the immersive computing system, a second video feed, the second video feed being of a second view of the three-dimensional computer-generated scene; and

transmitting the second video feed via the network to the source.

2. The method according to claim 1, wherein:

the source is a non-immersive computing device; and

the first video feed is a real-world video feed;

the method further comprising;

receiving the first video feed from a camera on the non-immersive computing device; and

displaying the second video feed on the non-immersive computing device.

3. The method according to claim 1, wherein the second view is a first-person view corresponding to an immersive user of the immersive computing system.

4. The method according to claim 3, further comprising adjusting the second view of the three-dimensional computer-generated scene in response to movement of the immersive device.

5. The method according to claim 1, further comprising:

videoing an immersive user of the immersive computing system with a digitally removable background to create a raw video stream;

removing the background from the raw video stream to result in a subject video stream;

compositing the subject video stream into the second view of the three-dimensional computer-generated scene to result in the second video feed.

6. The method according to claim 1, further comprising:

receiving, by the immersive computing system, a selection from a user of the immersive computing system of either a first-person view or a third-person view; and

generating the second video feed according to the selection.

7. The method according to claim 1, wherein:

the source is another immersive computing system; and

the first video feed is another computer-generated video feed;

the method further comprising;

generating the first video feed by the other immersive computing system; and

displaying the second video feed on another immersive computing device connected to the other immersive computing system.

8. The method according to claim 7, wherein:

the first video feed is a first person view corresponding to an immersive user of the other immersive computing system.

9. The method according to claim 7, further comprising:

videoing an immersive user of the other immersive computing system with a digitally removable background to create a raw video stream;

removing the background from the raw video stream to result in a subject video stream;

compositing the subject video stream into the first video feed.

10. The method according to claim 1, wherein the first video feed and the second video feed are transmitted via a server connected to the network.

11. The method according to claim 1, further comprising making an audio connection between the source and the immersive computing system.

12. The method of claim 1, wherein the second view is identical to the first view.

13. The method of claim 1, further comprising displaying, in the first view, a second virtual screen showing the second view.

14. A system for enabling personal communication comprising:

a source that provides a first video feed;

a network connected to the source; and

an immersive computing system comprising an immersive device, the immersive computing system connected via the network to the source and configured to;

receive the first video feed;

create a three-dimensional computer-generated scene comprising a virtual screen;

adjust the first video feed to fit the virtual screen;

display, on the immersive device, a first view of the three-dimensional computer-generated scene including the adjusted first video feed;

generate a second video feed, the second video feed being of a second view of the three-dimensional computer-generated scene; and

transmit the second video feed via the network to the source.

15. The system according to claim 14, wherein:

the source is a non-immersive computing device comprising a camera;

the first video feed is a real-world video feed obtained by the camera; and

the second video feed is displayed on the non-immersive computing device.

16. The system according to claim 14, wherein:

the second view is a first-person view corresponding to an immersive user of the immersive computing system; and

the immersive computing system is further configured to adjust the second view of the three-dimensional computer-generated scene in response to movement of the immersive device.

17. The system according to claim 14, wherein the second video feed comprises a video of an immersive user of the immersive computing system with a background removed, the video of the immersive user being composited into the second view of the three-dimensional computer-generated scene.

18. The system according to claim 14, wherein the immersive computing system is further configured to:

receive a selection from a user of the immersive computing system of either a first-person view or a third-person view; and

generate the second video feed according to the selection.

19. The system according to claim 18, wherein the user of the immersive computing system is one of multiple users virtually present in the three-dimensional computer-generated scene.

20. The system according to claim 14, wherein:

the source is another immersive computing system; and

the first video feed is another computer-generated video feed;

and the other immersive computing system is configured to;

generate the first video feed; and

display the second video feed on another immersive computing device connected to the other immersive computing system.

21. The system according to claim 20, wherein the first video feed is either:

a first-person view corresponding to an immersive user of the other immersive computing system;

or

a third-person view of the immersive user of the other immersive computing system.

22. The system according to claim 14, further comprising a server connected to the network, wherein the first video feed and the second video feed are transmitted via the server.

23. The system according to claim 14, further comprising an audio connection between the source and the immersive computing system.

24. A non-transitory computer readable medium comprising computer-readable instructions, which, when executed by a processor cause an immersive computing system to:

receive a first video feed transmitted via a network from a source;

create a three-dimensional computer-generated scene comprising a virtual screen;

adjust the first video feed to fit the virtual screen;

display a first view of the three-dimensional computer-generated scene with the adjusted first video feed on an immersive device within the immersive computing system;

generate a second video feed, the second video feed being of a second view of the three-dimensional computer-generated scene; and

transmit the second video feed via the network to the source.