Methods and systems for producing seamless composite images without requiring overlap of source images

• US 7,619,658 B2
• Filed: 11/15/2004
• Issued: 11/17/2009
• Est. Priority Date: 11/15/2004
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Baker, Henry Harlyn, Tanguay, Donald O. Jr.
• Primary Examiner(s): Tran; Sinh
• Assistant Examiner(s): Peterson; Christopher K
• Application Number:
  US10/989,964
• Publication Number:
  US 20060104541A1
• Time in Patent Office: 1,828 Days
• Field of Search: 348/218.1, 348/208.12, 348/208.16, 348/38, 348/211.11, 382/141, 382/284
• US Class Current: 348/218.1
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026

Abstract

A method for producing seamless composite images without requiring overlap of source images is disclosed. A plurality of source images are acquired and combined to produce a seamless composite image. The combining of the plurality of source images to produce a seamless composite image is performed without requiring overlap of image regions of the plurality of source images.

Claims

1. A method for producing seamless composite images without requiring overlap of source images, comprising:

acquiring a plurality of source images;

combining said plurality of source images to produce a seamless composite image, wherein said combining said plurality of source images to produce a seamless composite image is performed using said plurality of source images without requiring overlap of image regions of said plurality of source images; and

utilizing a re-sampling mechanism to map pixels that constitute said composite images through a lens distortion correction and a homography for each of said plurality of imagers after an output size within a dataset corresponding to a constructed frame is determined.

2. The method of claim 1 wherein said combining said plurality of source images is performed using line features determined from said source images.

3. The method of claim 1 wherein said combining is performed on images that have a relationship that is determined before the capture of said images.

4. The method of claim 2 wherein said use of line features is through determination of a homography that relates one imager in a plurality of imagers to another.

5. The method of claim 4 wherein a series of homographies is used to place all of said imagers in a reference plane that is common to all of said imagers.

6. The method of claim 2 wherein said line features are lines that are visible in at least two said source images and wherein objects from which said source images are derived are positioned within a common plane.

7. The method of claim 1 wherein at least a portion of said combining is performed using a graphics processing unit (GPU).

8. The method of claim 6 wherein the focal distances of the lenses of said plurality of imagers are set independently to accommodate an orientation of the common plane that is not orthogonal to their general view direction.

9. The method of claim 1 wherein said plurality of imagers are apart of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.

10. A system for producing seamless composite images without requiring overlap of source images, comprising:

a plurality of imagers for acquiring a plurality of said source images; and

a combiner for combining said plurality of said source images to produce a seamless composite image, wherein said combining said plurality of said source images to produce a seamless composite image is performed using said plurality of source images without requiring overlap of image regions of said plurality of said source images; and

a re-sampling mechanism for mapping pixels that constitute said composite image through a lens distortion correction and a homography of each imager after an output size within a dataset corresponding to a constructed frame is determined.

11. The system of claim 10 wherein said combiner combines said plurality of said source images using line features determined from the images.

12. The system of claim 10 wherein said combiner combines said source images based on a relationship that is determined before a capture of said source images.

13. The system of claim 11 wherein each of said plurality of imagers are related to at least one other imager by using said line features to determine a homography.

14. The system of claim 10 wherein all of said imagers are placed in a reference plane that is common to all said imagers using a series of homographies.

15. The system of claim 13 wherein said line features are lines which are visible in at least two source images and wherein said source images are derived from objects that are located within a common plane.

16. The system of claim 15 wherein focal distances of lenses of said plurality of imagers are set independently to accommodate an orientation of said common plane that is not orthogonal to their general view direction.

17. The system of claim 10 wherein at least a portion of said combining is performed using a graphics processing unit (GPU).

18. The system of claim 10 wherein said system is contained in an imager housing.

19. The system of claim 10 wherein said plurality of imagers are a part of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.

20. A method for calibrating a plurality of imagers to produce a seamless composite image without requiring overlap of source images, comprising:

identifying line features that are visible in each imager frame of said plurality of imagers; and

making computations using said line features that relate each imager frame of said plurality of imagers to at least one other imager frame of said plurality of imagers; and

constructing a re-sampling mechanism for mapping pixels that constitute said composite image through said computations after an output size within a dataset corresponding to a constructed frame is determined.

21. The method of claim 20 wherein said computations constitute homographies.

22. The method of claim 21 wherein a series of said homographies is used to place each imager of said plurality of imagers into a common reference plane.

23. The method of claim 20 wherein objects from which said source images are derived are positioned within a common plane.

24. The method of claim 20 wherein said plurality of imagers are a part of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.