Apparatus, system and method for projecting images onto predefined portions of objects

• US 9,049,369 B2
• Filed: 07/10/2013
• Issued: 06/02/2015
• Est. Priority Date: 07/10/2013
• Status: Active Grant

• Current Assignee: Christie Digital Systems Canada Incorporated (Ushio Incorporated)
• Original Assignee: Christie Digital Systems USA Incorporated (Ushio Incorporated)
• Inventors: Vieth, John, Anthony, Roy, Salvini, Paul
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US13/938,747
• Publication Number:
  US 20150015732A1
• Time in Patent Office: 692 Days
• Field of Search: 348/331, 348/333.1
• US Class Current: 1/1
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Apparatus, systems and methods are provided for projecting images onto predefined portions of objects in a projection area. The system includes a computing device, a projector and a camera. The computing device stores a digital model of an object, and an image containing a reference to the digital model. The projector, or another light source, projects structured light onto the projection area, and the camera simultaneously captures an image of the projection area. The computing device receives the captured image, determines a position and orientation of the object by comparing the digital model to the captured image, and then generates a canvas image including a version of the image which has been transformed to match the determined position and orientation of the object. The projector projects the canvas image onto the projection area. The transformed image is thereby projected onto a predefined portion of the object.

Claims

1. A system for projecting images onto predefined portions of objects in a projection area, comprising:

a computing device storing;

geometry data defining a digital model of an object;

the geometry data including identifiers of parts of the digital model; and

image data defining an image and including a reference to the digital model;

the reference consisting of at least one of the identifiers in a pixel array field;

a light source connected to the computing device and configured to project structured light onto the projection area;

a camera connected to the computing device and configured to capture an image of the projection area during the projection of structured light;

the computing device configured to receive the captured image from the camera and to determine a position and orientation of the object in the projection area by comparing the geometry data to the captured image;

the computing device further configured to generate a canvas image including a version of the image transformed to match the determined position and orientation of the object;

the computing device further configured to transmit the canvas image to a projector, for projection onto the projection area, whereby the image is projected onto a portion of the object corresponding to the reference in the image data.

2. The system of claim 1, the computing device configured to determine a position of the object by detecting signatures in the captured image corresponding to the digital model, and comparing the signatures to the geometry data.

3. The system of claim 2, the computing device configured to apply transformations to the digital model such that the transformed digital model matches the signatures;

the computing device further configured to generate the version of the image by applying at least one of the transformations to the image.

4. The system of claim 2, wherein the light source is a component of the projector.

5. The system of claim 1, wherein the projection area contains at least one of a plurality of objects;

and wherein the geometry data defines a plurality of digital models corresponding to the plurality of objects;

the computing device configured to detect signatures corresponding to at least one of the plurality of digital models in the captured image.

6. The system of claim 5, wherein the image data defines a plurality of images, at least one of the images including a reference to at least one of the plurality of digital models.

7. The system of claim 1, wherein the image data includes the identifiers in a mapping metadata field.

8. A computing device for use in a system for projecting images onto predefined portions of objects in a projection area, the computing device comprising:

a memory storing;

geometry data defining a digital model of an object;

the geometry data including identifiers of parts of the digital model; and

image data defining an image and including a reference to the digital model;

the reference consisting of at least one of the identifiers in a pixel array field;

a data interface configured to communicate with a light source, a projector and a camera; and

a processor interconnected with the memory and the data interface, the processor configured to;

control the light source to project structured light onto the projection area;

control the camera to capture an image of the projection area during the projection of structured light;

receive the captured image from the camera, and determine a position and orientation of the object in the projection area by comparing the geometry data to the captured image;

generate a canvas image including a version of the image transformed to match the determined position and orientation of the object; and

transmit the canvas image to a projector, for projection onto the projection area, whereby the image is projected onto a portion of the object corresponding to the reference in the image data.

9. The computing device of claim 8, the processor configured to determine a position of the object by detecting signatures in the captured image corresponding to the digital model, and comparing the signatures to the geometry data.

10. The computing device of claim 9, the processor configured to apply transformations to the digital model such that the transformed digital model matches the signatures;

the processor further configured to generate the version of the image by applying at least one of the transformations to the image.

11. The computing device of claim 9, wherein the light source is a component of the projector.

12. The computing device of claim 8, wherein the projection area contains at least one of a plurality of objects;

and wherein the geometry data defines a plurality of digital models corresponding to the plurality of objects;

the processor configured to detect signatures corresponding to at least one of the plurality of digital models in the captured image.

13. The computing device of claim 12, wherein the image data defines a plurality of images, at least one of the images including a reference to at least one of the plurality of digital models.

14. The computing device system of claim 8, wherein the image data includes the identifiers in a mapping metadata field.

15. A method of projecting images onto predefined portions of objects in a projection area, comprising:

storing, in a memory of a computing device;

geometry data defining a digital model of an object;

the geometry data including identifiers of parts of the digital model; and

image data defining an image and including a reference to the digital model;

the reference consisting of at least one of the identifiers in a pixel array field;

controlling a light source connected to the computing device to project structured light onto the projection area;

controlling a camera connected to the computing device to capture an image of the projection area during the projection of structured light;

receiving the captured image at the computing device from the camera and determining a position and orientation of the object in the projection area by comparing the geometry data to the captured image;

generating a canvas image at the computing device, including a version of the image transformed to match the determined position and orientation of the object;

transmitting the canvas image to a projector connected to the computing device, for projection onto the projection area, whereby the image is projected onto a portion of the object corresponding to the reference in the image data.

16. A non-transitory computer readable medium storing a plurality of computer readable instructions executable by a processor of a computing device, for causing the processor to perform a method of projecting images onto predefined portions of objects in a projection area, the method comprising:

storing, in a memory of a computing device;

geometry data defining a digital model of an object;

the geometry data including identifiers of parts of the digital model; and

image data defining an image and including a reference to the digital model;

the reference consisting of at least one of the identifiers in a pixel array field;

controlling a light source connected to the computing device to project structured light onto the projection area;

controlling a camera connected to the computing device to capture an image of the projection area during the projection of structured light;

receiving the captured image at the computing device from the camera and determining a position and orientation of the object in the projection area by comparing the geometry data to the captured image;

generating a canvas image at the computing device, including a version of the image transformed to match the determined position and orientation of the object;

transmitting the canvas image to a projector connected to the computing device, for projection onto the projection area, whereby the image is projected onto a portion of the object corresponding to the reference in the image data.