View Point Representation for 3-D Scenes

• US 20100020068A1
• Filed: 07/22/2009
• Published: 01/28/2010
• Est. Priority Date: 07/23/2008
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: PVI Virtual Media Services, LLC (Altice USA, Inc.)
• Inventors: House, Gregory
• Granted Patent: US 8,786,596 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: G06T 15/20 Perspective computation

Abstract

Techniques are described for deriving information, including graphical representations, based on perspectives of a 3D scene by utilizing sensor model representations of location points in the 3D scene. A 2D view point representation of a location point is derived based on the sensor model representation. From this information, a data representation can be determined. The 2D view point representation can be used to determine a second 2D view point representation. Other techniques include using sensor model representations of location points associated with dynamic objects in a 3D scene. These sensor model representations are generated using sensor systems having perspectives external to the location points and are used to determine a 3D model associated with a dynamic object. Data or graphical representations may be determined based on the 3D model. A system for obtaining information based on perspectives of a 3D scene includes a data manager and a renderer.

Claims

1. A computer-implemented method for generating information based on perspectives of a three-dimensional (3D) scene comprising:

obtaining a two dimensional (2D) view point representation of a location point in the 3D scene based on a sensor model representation, wherein the sensor model representation is generated using a sensor system having a perspective external to the location point; and

determining, with a processor-based computing device, a data representation from the 2D view point representation without finding 3D coordinates of the location point.

2. The computer-implemented method of claim 1, wherein obtaining comprises:

receiving the sensor model representation of the location point in the 3D scene; and

deriving, with a processor-based computing device, the two dimensional (2D) view point representation of the location point based on the sensor model representation, without finding 3D coordinates of the location point.

3. The computer-implemented method of claim 1, wherein the determining includes using at least two angle measurements.

4. The computer-implemented method of claim 1, wherein the determining includes determining a distance measurement between the location point and a second location point.

5. The computer-implemented method of claim 1, wherein determining includes determining a motion distance relative to time.

6. The computer-implemented method of claim 1, further comprising:

providing a graphical image within a larger image of the 3D scene based upon the generated data representation.

7. The computer-implemented method of claim 6, wherein the providing includes providing the graphical image during a display of the 3D scene.

8. The computer-implemented method of claim 1, wherein the determining includes determining a second 2D view point representation from a second perspective external to the location point.

9. The computer-implemented method of claim 1, wherein the determining includes automatically determining a data representation.

10. The computer-implemented method of claim 1, wherein the determining includes determining a 3D location in space based on a normalized vector of the location point.

11. A computer-implemented method for generating information based on perspectives of a three-dimensional (3D) scene comprising:

receiving a first sensor model representation of a first location point associated with a first dynamic object in the 3D scene, wherein the first sensor model representation is generated by a first sensor system having a first perspective external to the first location point;

receiving a second sensor model representation of a second location point associated with a second dynamic object in the 3D scene, wherein the second sensor model representation is generated by a second sensor system having a second perspective external to the second location point;

determining, with a processor-based computing device, a 3D model associated with the second dynamic object based on the first sensor model representation; and

determining, with a processor-based computing device, a data representation based on the 3D model associated with the second dynamic object.

12. The computer-implemented method of claim 11, wherein the first dynamic object and the second dynamic object are the same dynamic object.

13. The computer-implemented method of claim 11, wherein the determining includes automatically determining a data representation.

14. The computer-implemented method of claim 11, wherein determining a 3D model includes generating a first plane associated with the second dynamic object at a fixed angle relative to a second plane associated with the first location point.

15. The computer-implemented method of claim 14, wherein determining a data representation includes determining a graphical representation.

16. The computer-implemented method of claim 11, further comprising:

enabling a user to select a portion of the 3D scene using a view port; and

generating a graphical representation based on the 3D model associated with the second dynamic object and the selected portion of the 3D scene.

17. The computer-implemented method of claim 16, wherein the enabling includes enabling a user to select a portion of the 3D scene using at least one of pan, tilt and zoom (PTZ) controls.

18. The computer-implemented method of claim 16, wherein the enabling includes enabling a user to select a moving location point of at least one of the first dynamic object and the second dynamic object.

19. The computer-implemented method of claim 16, wherein the enabling includes enabling a user to select a perspective of the second dynamic object.

20. A system for generating information based on perspectives of a three-dimensional (3D) scene comprising:

an object tracker configured to determine a two dimensional (2D) view point representation of a location point in the 3D scene based on a sensor model representation, wherein the sensor model representation is generated using a sensor system having a perspective external to the location point; and

a data manager configured to determine a data representation from the 2D view point representation.

21. The system of claim 20, wherein the sensor system comprises an imaging device.

22. The system of claim 20, wherein the data manager is further configured to use the 2D view point representation to determine a second 2D view point representation.

23. The system of claim 20, further comprising:

a renderer configured to display a graphical image within a larger image of the 3D scene based upon the data representation.

24. A system for generating information based on perspectives of a three-dimensional (3D) scene comprising:

a data manager configured to

receive a first sensor model representation of a first location point associated with a first dynamic object in the 3D scene, wherein the first sensor model representation is generated by a first sensor system having a first perspective external to the first location point;

receive a second sensor model representation of a second location point associated with a second dynamic object in the 3D scene, wherein the second sensor model representation is generated by a second sensor system having a second perspective external to the second location point; and

determine a 3D model associated with the second dynamic object based on the first sensor model representation; and

a renderer configured to

determine a graphical representation based on the 3D model associated with the second dynamic object.

25. The system of claim 24, wherein the first dynamic object and the second dynamic object are the same dynamic object.

26. The system of claim 24, wherein the first sensor system and the second sensor system are the same sensor system.

27. The system of claim 24, wherein at least one of the first sensor system and the second sensor system are imaging devices.

28. The system of claim 24, further comprising:

an object tracker configured to determine the first sensor model representation and the second sensor model representation.

29. The system of claim 24, wherein the data manager is further configured to generate a first plane associated with the second dynamic object at a fixed angle relative to a second plane associated with the first location point.

30. The system of claim 24, further comprising:

an operator control configured to enable a user to select a portion of the 3D scene using a view port, and

wherein the renderer is configured to generate a graphical representation based on the 3D model associated with the second dynamic object and the selected portion of the 3D scene.

31. The system of claim 30, wherein the operator control is configured to enable a user to select a portion of the 3D scene using at least one of pan, tilt and zoom (PTZ) controls.

32. The system of claim 30, wherein the operator control is configured to enable a user to select a moving location point of at least one of the first dynamic object or the second dynamic object.

33. The system of claim 30, wherein the operator control is configured to enable a user to select a perspective of the second dynamic object.

34. The system of claim 30, wherein the renderer is configured to provide a graphical image during a display of the 3D scene based on the generated graphical representation.

35. A system for generating information based on perspectives of a three-dimensional (3D) scene comprising:

a data manager configured to

receive a first sensor model representation of a first location point associated with a first dynamic object in the 3D scene, wherein the first sensor model representation is generated by a first sensor system having a first perspective external to the first location point; and

receive a second sensor model representation of a second location point associated with a second dynamic object in the 3D scene, wherein the second sensor model representation is generated by a second sensor system having a second perspective external to the second location point;

determine a 3D model associated with the second dynamic object based on the first sensor model representation; and

determine a data representation based on the 3D model associated with the second dynamic object.

36. The system of claim 35, further comprising:

an object tracker configured to determine the first sensor model representation and the second sensor model representation.

37. The system of claim 35, wherein the data manager is further configured to generate a first plane associated with the second dynamic object at a fixed angle relative to a second plane associated with the first location point.

38. The system of claim 35, further comprising:

a renderer further configured to generate a graphical representation based on the 3D model associated with the second dynamic object and the selected portion of the 3D scene.