APPARATUS AND METHOD FOR SUPPORTING INTERACTIVE AUGMENTED REALITY FUNCTIONALITIES

• US 20190108683A1
• Filed: 03/24/2017
• Published: 04/11/2019
• Est. Priority Date: 04/01/2016
• Status: Active Grant

• Current Assignee: Interdigital Vc Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: PCMS Holdings Incorporated (InterDigital, Inc.)
• Inventors: Valli, Seppo T., Siltanen, Pekka K.
• Granted Patent: US 10,762,712 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Augmented reality (AR) telepresence systems and methods are disclosed for obtaining a 3D model of a physical location from a 3D-capture system comprising one or more 3D depth sensors disposed throughout the physical location, generating a truncated 3D model of the physical location, the truncated 3D model corresponding to the intersection of the generated 3D model and a field of view of a user terminal camera at the physical location, and transmitting the truncated 3D model to a remote location.

Claims

1. A method comprising:

obtaining a 3D model of a physical location from a 3D-capture system comprising one or more 3D depth sensors disposed throughout the physical location;

generating a truncated 3D model of the physical location, the truncated 3D model corresponding to the intersection of the generated 3D model and a field of view of a user terminal camera at the physical location; and

transmitting the truncated 3D model to a remote location.

2. The method of claim 1, wherein the field of view of the user terminal camera is determined at least in part by identifying image data related to positions of markers in the physical location and using the positions to determine the field of view of the user terminal camera.

3. The method of claim 1, wherein a display device at the remote location displays an arbitrary view point of the truncated 3D model including rendered objects only within a field of view of the user terminal camera.

4. The method of claim 1, further comprising receiving location information for placing a virtual object in the 3D model of the physical location.

5. The method of claim 4, wherein the location information corresponds to a location in the physical location inside the truncated 3D model.

6. The method of claim 4, wherein the location information corresponds to a location in the physical location outside the truncated 3D model.

7. The method of claim 4, further comprising obtaining a 3D model of the virtual object from a database.

8. The method of claim 4, further comprising receiving a 3D model of the virtual object from the remote location.

9. The method of claim 1, further comprising receiving a virtual camera control command from the remote location, and responsively generating a corresponding perspective view of the truncated 3D model.

10. The method of claim 1, further comprising:

generating a second truncated 3D model corresponding to the intersection of the generated 3D model and a second field of view of a second user terminal camera at the physical location; and

transmitting the second truncated 3D model to a second remote location.

11. A system comprising a non-transitory computer readable medium for carrying one or more instructions, wherein the one or more instructions, when executed by one or more processors, causes the one or more processors to perform the steps of:

obtaining a 3D model of a physical location from a 3D-capture system comprising one or more 3D depth sensors disposed throughout the physical location;

generating a truncated 3D model of the physical location, the truncated 3D model corresponding to the intersection of the generated 3D model and a field of view of a user terminal camera at the physical location; and

transmitting the truncated 3D model to a remote location.

12. The system of claim 11, wherein the non-transitory computer readable medium comprises instructions for determining the field of view of the user terminal camera at least in part by identifying image data related to positions of markers in the physical location and using the positions to determine the field of view of the user terminal camera.

13. The system of claim 11, wherein a display device at the remote location displays an arbitrary view point of the truncated 3D model including rendered objects only within a field of view of the user terminal camera.

14. The system of claim 11, wherein the non-transitory computer readable medium further comprises instructions for receiving location information for placing a virtual object in the 3D model of the physical location.

15. The system of claim 14, wherein the location information corresponds to a location in the physical location inside the truncated 3D model.

16. The system of claim 14, wherein the location information corresponds to a location in the physical location outside the truncated 3D model.

17. The system of claim 14, wherein the non-transitory computer readable medium further comprises instructions for obtaining a 3D model of the virtual object from a database.

18. The system of claim 14, wherein the non-transitory computer readable medium further comprises instructions for receiving a 3D model of the virtual object from the remote location.

19. The system of claim 11, wherein the non-transitory computer readable medium further comprises instructions for receiving a virtual camera control command from the remote location, and responsively generating a corresponding perspective view of the truncated 3D model.

20. The system of claim 11, wherein the non-transitory computer readable medium further comprises instructions for:

generating a second truncated 3D model corresponding to the intersection of the generated 3D model and a second field of view of a second user terminal camera at the physical location; and

transmitting the second truncated 3D model to a second remote location.