METHOD AND APPARATUS FOR CREATING A COMPOSITE IMAGE

• US 20090085910A1
• Filed: 09/30/2007
• Published: 04/02/2009
• Est. Priority Date: 09/30/2007
• Status: Active Grant

• Current Assignee: RDV Systems Limited
• Original Assignee: RDV Systems Limited
• Inventors: Elsberg, Nathan, Hazanov, Alex
• Granted Patent: US 8,031,210 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/20101 Interactive definition of point of interest, landmark or seed
• CPC Class Codes: G06T 2210/62 Semi-transparency
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

A method of rendering a computer generated 3D scene integrated with a base image, the method comprising loading a base image, such as a photograph, and a computer generated 3D scene or model. The base image is displayed on a monitor, and in one embodiment the calibration of the camera which generated the base image is determined. The 3D model is rendered as an overlay of the base image responsive thereto. In another embodiment, the camera calibration of the 3D scene is made consonant with the base image by selecting corresponding points. The base image is then additionally displayed at a predetermined transparency as an overlay of the 3D model. A user then selects pixels of the base image overlay for placement in the foreground. The selected pixels are then displayed without transparency and the balance of the base image overlay removed rendering the integrated image.

Claims

1. A computer implemented method of rendering an integrated image constituted of a computer generated three dimensional scene and a base image, the method comprising:

providing the base image;

displaying said base image;

providing the computer generated three dimensional scene;

rendering said provided computer generated three dimensional scene responsive to a determined camera calibration of said displayed base image as an overlay over said displayed base image;

displaying the base image additionally in the foreground of said rendered three dimensional scene at a predetermined transparency;

identifying elements from said additionally displayed base image to appear in the foreground of the integrated image;

displaying said identified elements of said additionally displayed base image without transparency; and

removing all unidentified elements of said additionally displayed base image thereby rendering said integrated image.

2. A computer implemented method according to claim 1, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a user input coordinate of said at least one selected point.

3. A computer implemented method according to claim 1, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a corresponding respective at least one point on said rendered computer generated three dimensional scene.

4. A computer implemented method according claim 1, further comprising after said rendering said provided computer generated three dimensional scene as an overlay:

adjusting, responsive to a user input, said determined camera calibration for rendering said provided computer generated three dimensional scene.

5. A computer implemented method according to claim 1, wherein said removing all unidentified elements of said additionally displayed base image comprises displaying said unidentified elements at 100% transparency.

6. A computer implemented method according to claim 1, wherein said provided computer generated three dimensional scene comprises at least one element exhibiting matte texture.

7. A computer implemented method according to claim 1, wherein said provided base image is a photograph.

8. A computing system operative to render an integrated image constituted of a computer generated three dimensional scene and a base image the computing system comprising a computer, a memory, a monitor, and a user input device, the computer being operative to:

provide the base image;

display said base image on said monitor;

provide the computer generated three dimensional scene;

render said provided computer generated three dimensional scene on said monitor responsive to a determined camera calibration of said displayed base image as an overlay over said displayed base image;

additionally display the base image in the foreground of said rendered three dimensional scene at a predetermined transparency;

identify elements, via said user input device, from said additionally displayed base image to appear in the foreground of the integrated image;

display said identified elements of said additionally displayed base image without transparency on said monitor; and

remove all unidentified elements of said additionally displayed base image thereby rendering said integrated image on said monitor.

9. A computing system according to claim 8, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a user input coordinate of said at least one selected point.

10. A computing system according to claim 8, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a corresponding respective at least one point on said rendered computer generated three dimensional scene

11. A computing system according to claim 8, wherein said computer is further operative after said rendering of said provided computer generated three dimensional scene on said monitor responsive to said determined camera calibration as an overlay over said displayed base image to:

adjust, responsive to a user input, said determined camera calibration for rendering said provided computer generated three dimensional scene.

12. A computing system according to claim 8, wherein said removing all unidentified elements of said additionally displayed base image comprises:

display said unidentified elements at 100% transparency.

13. A computing system according to claim 8, wherein said provided computer generated three dimensional scene comprises at least one element exhibiting matte texture.

14. A computing system according to claim 8, wherein said provided base image is a photograph.

15. A computer-readable medium containing instructions for controlling a data processing system to perform a method of rendering an integrated image constituted of a computer generated three dimensional scene and a base image, the method comprising:

providing the base image;

displaying said base image;

providing the computer generated three dimensional scene;

rendering said provided computer generated three dimensional scene responsive to a determined camera calibration of said displayed base image as an overlay over said displayed base image;

displaying the base image additionally in the foreground of said rendered three dimensional scene at a predetermined transparency;

identifying elements from said additionally displayed base image to appear in the foreground of the integrated image;

displaying said identified elements of said additionally displayed base image without transparency; and

removing all unidentified elements of said additionally displayed base image thereby rendering said integrated image.

16. A computer-readable medium according to claim 15, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a user input coordinate of said at least one selected point.

17. A computer-readable medium according to claim 15, wherein said camera calibration of said displayed base image is determined responsive to at least one user selected point on said displayed base image and a corresponding respective at least one point on said rendered computer generated three dimensional scene.

18. A computer-readable medium according to claim 15, wherein the method further comprises after said rendering said provided computer generated three dimensional scene as an overlay:

adjusting, responsive to a user input, said camera calibration for rendering said provided computer generated three dimensional scene.

19. A computer-readable medium according to claim 15, wherein said removing all unidentified elements of said additionally displayed base image comprises displaying said unidentified elements at 100% transparency.

20. A computer-readable medium according to claim 15, wherein said provided computer generated three dimensional scene comprises at least one element exhibiting matte texture.