Method and apparatus for automated projection mapping previsualization

• US 10,360,723 B2
• Filed: 08/08/2017
• Issued: 07/23/2019
• Est. Priority Date: 08/08/2017
• Status: Active Grant

• Current Assignee: Christie Digital Systems USA Incorporated (Ushio Incorporated)
• Original Assignee: Christie Digital Systems USA Incorporated (Ushio Incorporated)
• Inventors: Mills, Shawn David, Klassen, Gerhard Dietrich, Faragher, Ian Chadwyck
• Primary Examiner(s): Pringle-Parker, Jason A
• Application Number:
  US15/671,280
• Publication Number:
  US 20190051041A1
• Time in Patent Office: 714 Days
• Field of Search: None
• CPC Class Codes: E02F 5/145 control and indicating devices
• CPC Class Codes: E02F 9/261 Surveying the work-site to be treated
• CPC Class Codes: G01S 19/43 using carrier phase measurements, e.g. kinematic positioning; using long or short baseline interferometry
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09B 29/106 using electronic means
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

A method and apparatus for automated projection mapping previsualization is provided. A computer model of an object is received, at a controller of a device, from a publicly accessible remote mapping server, the computer model comprising a publicly available three-dimensional computer model, the computer model defining an object in geographic coordinates and elevation coordinates, the object located at given geographic coordinates. The controller generates a time dependent previsualization projection mapping model for the object using images to be projected onto the object, the computer model, and data for generating one or more of Sun behavior and the Moon behavior at the given geographic coordinates. The controller controls a display device to render a previsualization of the time dependent previsualization projection mapping model.

Claims

1. A device comprising:

a communication interface, and a controller configured to;

receive, using the communication interface, a computer model of an object from a publicly accessible remote mapping server, the computer model comprising a publicly available three-dimensional computer model, the computer model defining the object in geographic coordinates and elevation coordinates, the object located at given geographic coordinates;

generate a time dependent previsualization projection mapping model for the object using;

images to be projected onto the object, the computer model and data for generating one or more of Sun behavior and Moon behavior at the given geographic coordinates, wherein the time dependent previsualization projection mapping model for the object includes an indication of where to geographically locate one or more projectors, relative to the object, the one or more projectors for projecting the images onto the object; and

,

control a display device to render a previsualization of the time dependent previsualization projection mapping model.

2. The device of claim 1, wherein the controller is further configured to receive, from a weather server, weather data for the given geographic coordinates, and generate the time dependent previsualization projection mapping model for the object further using the weather data.

3. The device of claim 1, wherein the computer model of the object further includes a three-dimensional model of a geographic region adjacent the object, and the controller is further configured to generate the time dependent previsualization projection mapping model for the object further using the three-dimensional model of the geographic region adjacent the object.

4. The device of claim 1, wherein the controller is further configured to generate the time dependent previsualization projection mapping model for the object further using event data defining an event that is to occur proximal the object.

5. The device of claim 1, wherein the controller is further configured to generate the time dependent previsualization projection mapping model for the object further using a geographic viewing location.

6. The device of claim 1, wherein the controller is further configured to determine, from the time dependent previsualization projection mapping model, a geographic viewing location for viewing projection mapping of the images onto the object.

7. The device of claim 1, wherein the controller is further configured to align a second computer model of the object with the computer model of the object, the second computer model of the object comprising a higher resolution computer model than the publicly available three-dimensional computer model.

8. The device of claim 7, wherein the controller is further configured to generate an updated time dependent previsualization projection mapping model for controlling the one or more projectors to project the images onto the object using:

the second computer model;

alignment of the second computer model of the object with the computer model of the object; and

the time dependent previsualization projection mapping model.

9. The device of claim 7, wherein the controller is further configured to augment the second computer model of the object with geographic data from the computer model of the object.

10. The device of claim 1, wherein the publicly available three-dimensional computer model includes one or more of a building model, a DXF (Drawing Exchange Format) file, a GIS (geographic information system) file, a PCD (Point Cloud Data) file, an OBJ file, and a color coordinate file defining color of the object.

11. A method comprising:

receiving, at a controller, using a communication interface, a computer model of an object from a publicly accessible remote mapping server, the computer model comprising a publicly available three-dimensional computer model, the computer model defining the object in geographic coordinates and elevation coordinates, the object located at given geographic coordinates;

generating, using the controller, a time dependent previsualization projection mapping model for the object using images to be projected onto the object, the computer model, and data for generating one or more of Sun behavior and the Moon behavior at the given geographic coordinates, wherein the time dependent previsualization projection mapping model for the object includes an indication of where to geographically locate one or more projectors, relative to the object, the one or more projectors for projecting the images onto the object; and

,

controlling, using the controller, a display device to render a previsualization of the time dependent previsualization projection mapping model.

12. The method of claim 11, further comprising:

receiving, at the controller, from a weather server, weather data for the given geographic coordinates; and

generating, using the controller, the time dependent previsualization projection mapping model for the object further using the weather data.

13. The method of claim 11, wherein the computer model of the object further includes a three-dimensional model of a geographic region adjacent the object, and hone the method further comprises generating, using the controller, the time dependent previsualization projection mapping model for the object further using the three-dimensional model of the geographic region adjacent the object.

14. The method of claim 11, further comprising:

generating, using the controller, the time dependent previsualization projection mapping model for the object further using event data defining an event that is to occur proximal the object.

15. The method of claim 11, further comprising:

generating, using the controller, the time dependent previsualization projection mapping model for the object further using a geographic viewing location.

16. The method of claim 11, further comprising:

determining, using the controller, from the time dependent previsualization projection mapping model, a best geographic viewing location for viewing projection mapping of the images onto the object.

17. The method of claim 11, further comprising:

aligning, using the controller, a second computer model of the object with the computer model of the object, the second computer model of the object comprising a higher resolution computer model than the publicly available three-dimensional computer model.

18. The method of claim 17, further comprising:

generating, using the controller, an updated time dependent previsualization projection mapping model for controlling the one or more projectors to project the images onto the object using;

the second computer model;

alignment of the second computer model of the object with the computer model of the object; and

the time dependent previsualization projection mapping model.

19. The method of claim 17, further comprising:

augmenting, using the controller, the second computer model of the object with geographic data from the computer model of the object.

20. A device comprising:

a communication interface, and a controller configured to;

receive, using the communication interface, a computer model of an object from a publicly accessible remote mapping server, the computer model comprising a publicly available three-dimensional computer model, the computer model defining the object in geographic coordinates and elevation coordinates, the object located at given geographic coordinates;

generate a time dependent previsualization projection mapping model for the object using;

images to be projected onto the object, the computer model and data for generating one or more of Sun behavior and Moon behavior at the given geographic coordinates;

control a display device to render a previsualization of the time dependent previsualization projection mapping model;

align a second computer model of the object with the computer model of the object, the second computer model of the object comprising a higher resolution computer model than the publicly available three-dimensional computer model; and

generate an updated time dependent previsualization projection mapping model for controlling one or more projectors to project the images onto the object using;

the second computer model;

alignment of the second computer model of the object with the computer model of the object; and

the time dependent previsualization projection mapping model.