System and method for creating virtual presence

• US 8,831,780 B2
• Filed: 07/05/2012
• Issued: 09/09/2014
• Est. Priority Date: 07/05/2012
• Status: Active Grant

• Current Assignee: New Millennium Software International, L.L.C.
• Original Assignee: Arkady Linshitz, Stanislav Zelivinski
• Inventors: Zelivinski, Stanislav, Linshitz, Arkady
• Primary Examiner(s): HOLLOWAY, JASON R
• Application Number:
  US13/542,387
• Publication Number:
  US 20140012417A1
• Time in Patent Office: 796 Days
• Field of Search: 700/248, 700/249, 700/250, 700/253, 700/255, 700/257, 700/258, 700/259, 700/262, 700/264, 900/1, 900/46, 900/47, 900/50
• US Class Current: 700/257
• CPC Class Codes: B25J 9/1689 Teleoperation
• CPC Class Codes: G05B 2219/40161 Visual display of machining, operation, remote viewing
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: H04N 21/214 Specialised server platform, e.g. server located in an airplane, hotel, hospital arrangements specially adapted for local area broadcast systems H04H20/61
• CPC Class Codes: H04N 21/2146 located in mass transportation means, e.g. aircraft, train or bus flight-deck installations for entertainment or communications B64D11/0015; arrangements specially adapted for transportation systems in broadcast systems H04H20/62; moving wireless networks H04W84/005
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82

Abstract

A Global Virtual Presence (SGVP) platform integrates communications, robotics and Men Machine Interface (MMI) technologies and provides a unique way of delivering virtual presence experience to a user. The user can control a Robotic Virtual Explorer Devices (RVEDs) and receive a real-time media stream at his virtual terminal. In addition to real-time interactive video feeds, the system provides a pre-recorded video feed gallery of various most unreachable areas of the world, thereby providing a feeling of virtual-like presence to people, who may never see these places due to physical and financial constraints.

Claims

1. A Global Virtual Presence (GVP) system for providing a user with a virtual presence experience via a virtual reality, the system comprising:

at least one virtual presence terminal (VPT) configured to provide a user with a virtual presence interface;

at least one robotic virtual explorer device (RVED) configured to acquire a virtual presence media, the RVED is controllable by the user via the virtual presence interface;

at least one VPT Command and Control Unit (CCU) connected to the VPT configured to process and send operational directives and receive the virtual presence media and render the virtual presence media to the user via the virtual presence interface;

at least one RVED Command and Control Unit (CCU) connected to the RVED configured to process and send the operational directives to the RVED and receive and process the virtual presence media from the RVED, wherein;

the VPT CCU is connected to the RVED CCU over a wide area network;

the user connects to the RVED via the virtual presence interface and sends the operational directives to the VPT CCU;

the VPT CCU sends the operational directives to the RVED CCU, providing the operational directives to the RVED over a wireless connection;

the RVED acquires the virtual presence media and provides it to the RVED CCU over the wireless connection, which sends it to the VPT CCU over the wide area network;

the VPT CCU provides the virtual presence media to the VPT virtual presence interface;

a virtual geo-fence is mapped to a toured area containing movement of the RVED; and

wherein the RVED is continuously controlled via virtual reality controls, and is configured to display a video feed as a virtual reality.

2. The system of claim 1, wherein the RVED is any of:

an aerial virtual explorer;

a marine virtual explorer;

a land virtual explorer; and

an extraterrestrial virtual explorer.

3. The system of claim 1, wherein the RVED has at least one video camera installed on it configured to capture a video stream based on the operational directives received from the user.

4. The system of claim 1, wherein the RVED CCU is connected to a plurality of the VPT CCUs.

5. The system of claim 1, wherein the RVED CCU is a remote server.

6. The system of claim 1, wherein the RVED CCU is a ground control station.

7. The system of claim 1, wherein the RVED has an array of video cameras configured to capture a view area of 360 degrees and providing 3D effects.

8. The system of claim 1, wherein the VPT CCU is a server hosting a pre-recorded video feeds database.

9. The system of claim 8, wherein the user receives the pre-recorded video feeds from the VPT CCU upon request.

10. The system of claim 1, wherein the VPT is any of:

a smart TV;

a tablet;

a computer;

a Smartphone;

3D glasses; and

a virtual reality helmet.

11. The system of claim 1, wherein the RVED CCU buffers the operational directives received from the VPT CCU and analyzes the operational directives according to safety of movements of the RVED identified in the operational directives.

12. The system of claim 11, wherein, if the operational directives are deemed unsafe by the RVED CCU, the RVED CCU corrects the directives and provides them to the RVED.

13. The system of claim 1, wherein the RVED buffers the operational directives received from the VPT CCU and analyzes the operational directives according to the safety of its movements as identified in the operational directives.

14. The system of claim 1, wherein the virtual presence media is any of:

a video stream;

an audio stream; and

sensory data.

15. The system of claim 1, wherein the user selects the RVED from a plurality of the available RVEDS presented to the user via the virtual presence interface.

16. The system of claim 1, wherein the RVED CCU determines where to route the video stream received from the RVED.

17. The system of claim 1, wherein the VPT CCU converts a video stream into a virtual reality stream that is compatible with a virtual reality end user terminal.

18. The system of claim 17, wherein the virtual reality end user terminal is a head mounted display (HMD).

19. A Global Virtual Presence (GVP) system for providing a user with a virtual presence experience via a virtual reality, the system comprising:

at least one virtual presence terminal (VPT) configured to provide a user with a virtual presence interface;

at least one robotic virtual explorer device (RVED) configured to acquire a virtual presence media, the RVED is controllable by the user via the virtual presence interface;

at least one VPT Command and Control Unit (CCU) configured to connect to the VPT and process and send operational directives and receive the virtual presence media and render the virtual presence media to the user via the virtual presence interface;

at least one RVED Command and Control Unit (CCU) configured to connect to the RVED and process and send the operational directives to the RVED and receive and process the virtual presence media from the RVED, wherein;

the VPT CCU is connected to the RVED CCU over a wide area network;

the user connects to the RVED via the virtual presence interface and sends the operational directives to the VPT CCU;

the VPT CCU sends the operational directives to the RVED CCU, which provides the operational directives to the RVED over a wireless connection;

the RVED acquires the virtual presence media and provides it to the RVED CCU over the wireless connection;

the RVED CCU sends the virtual presence media to the VPT CCU over the wide area network;

the VPT CCU is configured to provide the virtual presence media to the VPT virtual presence interface; and

the virtual presence media, controlled by the user of the RVED, is indexed for playback requests by the users, and, the RVED is continuously controlled by the user via virtual reality controls.

20. A Global Virtual Presence (GVP) system for providing a user with a virtual presence experience, the system comprising:

at least one virtual presence terminal (VPT) configured to provide a user with a virtual presence interface;

at least one robotic virtual explorer device (RVED) configured to acquire a virtual presence media, the RVED is controllable by the user via the virtual presence interface;

at least one VPT Command and Control Unit (CCU) connected to the VPT and configured to process and send operational directives and receive the virtual presence media and render the virtual presence media to the user via the virtual presence interface;

at least one RVED Command and Control Unit (CCU) connected to the RVED, configured to process and send the operational directives to the RVED and receive and process the virtual presence media from the RVED, wherein;

the VPT CCU is connected to the RVED CCU over a wide area network;

the user connects to the RVED via the virtual presence interface and sends the operational directives to the VPT CCU;

the VPT CCU sends the operational directives to the RVED CCU, providing the operational directives to the RVED over a wireless connection;

the RVED acquires the virtual presence media and provides it to the RVED CCU over the wireless connection, which sends it to the VPT CCU over the wide area network;

the VPT CCU provides the virtual presence media to the VPT virtual presence interface; and

the VPT is implemented on a virtual reality helmet, the virtual reality helmet controls movement of the RVED displaying video as virtual reality.