Virtual Interactive Presence Systems and Methods

• US 20100295921A1
• Filed: 05/19/2008
• Published: 11/25/2010
• Est. Priority Date: 05/18/2007
• Status: Active Grant

• Current Assignee: UAB Research Foundation (University of Alabama System)
• Original Assignee: UAB Research Foundation (University of Alabama System)
• Inventors: Dillavou, Marcus W., Guthrie, Barton, Ross, Douglas, Shih, Alan M., Shum, Philip C.
• Granted Patent: US 8,520,024 B2
• Time in Patent Office: Days
• US Class Current: 348/14.08
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: H04N 13/194 Transmission of image signals

Abstract

Provided herein are methods and systems for virtual interactive presence.

Claims

1. A method for virtual interactive presence comprising:

rendering a common field of interest that reflects the physical presence of a remote user and a local user;

rendering interaction between the remote user and the local user in the common field of interest; and

continuously updating the common field of interest such that the presence of the remote user is rendered in real time to the local user and the presence of the local user is rendered in real time to the remote user.

2. The method of claim 1, wherein the common field of interest is rendered such that the remote user experiences the common field of interest similarly to the local user.

3. The method of claim 1 or 2, wherein the local user experiences the remote user'"'"'s physical presence in a manner that enables continuous interaction in the common field of interest with the remote user.

4. The method of claim 1, 2 or 3, further comprising:

rendering the physical presence of a local object in the common field; and

rendering interaction between the local user and the local object in the common field.

5. The method of claim 1 or 4, further comprising:

rendering the physical presence of a local object in the common field of interest; and

rendering interaction between the remote user and the local object in the common field of interest.

6. A method for virtual interactive presence comprising:

rendering a local field of interest that reflects the physical presence of a local object, a volumetric image of the local object, and a local user;

rendering interaction between the local object, the volumetric image, and the local user in the local field of interest; and

continuously updating the local field of interest such that the presence of the local object and the volumetric image of the local object is rendered in real time to the local user.

7. The method of claim 6, wherein the local object is a patient and the volumetric image of the local object is a medical image of a part of the patient.

8. The method of claim 7, wherein the medical image is one of, an x-ray image, an MRI image, or a CT image.

9. The method of claim 6, further comprising superimposing, by the local user, the volumetric image onto the local object.

10. The method of claim 6 or 9, further comprising adjusting, by the local user, a property of the volumetric image.

11. The method of claim 10, wherein the property is one or more of transparency, spatial location, and scale.

12. The method of claim 6, further comprising rendering a local tool in the local field of interest.

13. The method of claim 12, further comprising rendering the local tool in accurate spatial relation to the rendering of the local object.

14. A system for virtual interactive presence, comprising:

a virtual presence display, configured for displaying a common field of interest;

a local sensor, configured for obtaining local virtual presence data;

a network interface, configured for transmitting local virtual presence data and receiving remote virtual presence data; and

a processor, coupled to the virtual presence display, the local sensor, and the network interface, wherein the processor is configured to perform steps comprising,

rendering a common field of interest that reflects the physical presence of a remote user and a local user based on the local virtual presence data and the remote virtual presence data,

rendering interaction between the remote user and the local user in the common field of interest,

continuously updating the common field of interest such that the presence of the remote user is rendered in real time to the local user and the presence of the local user is rendered in real time to the remote user, and

outputting the common field of interest to the virtual presence display.

15. The system of claim 14, wherein the virtual presence display is one or more of a stereoscopic display and a monoscopic display.

16. The system of claim 14, wherein the sensor is one or more of a camera, an infrared sensor, and a depth scan sensor.

17. The system of claim 14, wherein the common field of interest is rendered such that the remote user experiences the common field of interest similarly to the local user.

18. The system of claim 14 or 17, wherein the local user experiences the remote user'"'"'s physical presence in a manner that enables continuous interaction in the common field of interest with the remote user.

19. The system of claim 14, 17 or 18, wherein the processor is further configured to perform steps comprising:

rendering the physical presence of a local object in the common field of interest; and

rendering interaction between the local user and the local object in the common field of interest.

20. The system of claim 14 or 19, wherein the processor is further configured to perform steps comprising:

rendering the physical presence of a local object in the common field of interest; and

rendering interaction between the remote user and the local object in the common field of interest.

21. A system for virtual interactive presence, comprising:

a virtual presence display, configured for displaying a local field of interest;

a local sensor, configured for obtaining local virtual presence data;

a processor, coupled to the virtual presence display and the local sensor, wherein the processor is configured to perform steps comprising,

rendering a local field of interest that reflects the physical presence of a local object and a local user based on the local virtual presence data and a volumetric image of the local object,

rendering interaction between the local object, the volumetric image, and the local user in the local field of interest,

continuously updating the local field of interest such that the presence of the local object and the volumetric image of the local object is rendered in real time to the local user, and

outputting the local field of interest to the virtual presence display.

22. The system of claim 21, wherein the virtual presence display is one or more of a stereoscopic display and a monoscopic display.

23. The system of claim 21, wherein the sensor is one or more of a camera, an infrared sensor, and a depth scan sensor.

24. The system of claim 21, wherein the local object is a patient and the volumetric image of the local object is a medical image of a part of the patient.

25. The system of claim 24, wherein the medical image is one of, an x-ray image, an MRI image, or a CT image.

26. The system of claim 21, wherein the processor is further configured to perform steps comprising superimposing, by the local user, the volumetric image onto the local object.

27. The system of claim 21, wherein the processor is further configured to perform steps comprising adjusting, by the local user, a property of the volumetric image.

28. The system of claim 27, wherein the property is one or more of transparency, spatial location, and scale.

29. The system of claim 21, wherein the processor is further configured to perform steps comprising rendering a local tool in the local field of interest.

30. The system of claim 29, wherein the processor is further configured to perform steps comprising rendering the local tool in accurate spatial relation to the rendered local object.