Method and system for producing seamless composite images having non-uniform resolution from a multi-imager system

• US 7,855,752 B2
• Filed: 07/31/2006
• Issued: 12/21/2010
• Est. Priority Date: 07/31/2006
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Tanguay, Donald O. Jr., Baker, Henry Harlyn
• Primary Examiner(s): LEE, MICHAEL
• Application Number:
  US11/496,810
• Publication Number:
  US 20080024390A1
• Time in Patent Office: 1,604 Days
• Field of Search: 348578-601, 348/239, 348/159, 348/383, 345629-641
• US Class Current: 348/588
• CPC Class Codes: G06T 3/4053 based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A method and system for producing seamless composite images having non-uniform resolution from a multi-imager system is disclosed. A plurality of lower resolution source images is acquired. In addition, a plurality of higher resolution source images is acquired. The plurality of the lower resolution images and the higher resolution images are then layered to produce a composite image, wherein the layering of the plurality of the lower resolution images and the higher resolution images to produce a composite image having a plurality of resolutions therein.

Claims

1. A computer implemented method for producing seamless composite images having non-uniform resolution from a multi-imager, comprising:

acquiring a plurality of lower resolution source images;

blending said lower resolution images to form a first resolution layer of an overall scene;

acquiring a plurality of higher resolution source images;

blending said higher resolution images to form a second resolution layer of a portion of said overall scene;

embedding digital objects within said second resolution layer, wherein said digital objects are selectable to provide additional imagery interaction options; and

layering said plurality of said lower resolution images and said higher resolution images to produce at least one composite image having non-uniform resolution.

2. The method of claim 1 further comprising:

acquiring said plurality of lower resolution source images from a plurality of short focal length imagers in said multi-imager; and

acquiring said plurality of higher resolution source images from at least one longer focal length imager in said multi-imager.

3. The method of claim 1 further comprising:

utilizing a combiner for blending said plurality of said lower resolution source images; and

utilizing said combiner for blending said plurality of higher resolution source images;

wherein said combiner combines said plurality of source images to produce a seamless composite image without requiring overlap of image regions of said plurality of source images.

4. The method of claim 1 further comprising:

blending at least one edge portion of said second resolution layer with a portion of said first resolution layer without requiring blending of other than the at least one edge portion of said second resolution layer with said portion of said first resolution layer.

5. The method of claim 1 further comprising:

acquiring said plurality of lower resolution images in color;

acquiring said plurality of higher resolution images in monochrome; and

blending said color from said first resolution layer with said monochrome of said second resolution layer to obtain higher resolution color images at a reduced bandwidth.

6. The method of claim 1 wherein said plurality of imagers are a part of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.

7. A multi-imager system for producing seamless composite images having non-uniform resolution, comprising:

a plurality of lower resolution imagers for acquiring a plurality of lower resolution source images;

a lower resolution composite image generator for generating a lower resolution composite image from said plurality of said lower resolution images;

at least one higher resolution imager for acquiring a plurality of higher resolution source images;

a higher resolution composite image generator for generating a higher resolution composite image from said plurality of said higher resolution images;

a lower resolution combiner for combining said lower resolution images to form a first resolution layer of an overall seamless composite image, wherein said combining is performed using said plurality of lower resolution images without requiring overlap of image regions of said plurality of said lower resolution images;

a higher resolution combiner for combining said higher resolution images to form a second resolution layer of a portion of said overall seamless composite image, wherein said combining is performed using said plurality of higher resolution images without requiring overlap of image regions of said plurality of said higher resolution images, wherein digital objects are embedded within said higher resolution composite image, wherein said digital objects are selectable to provide additional imagery interaction options; and

a composite image generator for layering said lower resolution composite images and said higher resolution images to produce a layered composite image having a plurality of resolutions therein.

8. The multi-imager system of claim 7 further comprising:

a plurality of short focal length imagers in said multi-imager system for acquiring said plurality of lower resolution source images; and

at least one longer focal length imager in said multi-imager system for acquiring said plurality of higher resolution source images.

9. The multi-imager system of claim 7 further comprising:

a border blender for blending at least one edge portion of said second resolution layer with a portion of said first resolution layer without requiring blending of other than the at least one edge portion of said second resolution layer with said portion of said first resolution layer.

10. The multi-imager system of claim 7 further comprises:

a lower resolution color imager for acquiring said plurality of lower resolution images in color;

a higher resolution black and white imager for acquiring said plurality of higher resolution images in monochrome; and

a color layer blender for blending said color from said first resolution layer with said monochrome of said second resolution layer to obtain higher resolution color images at a reduced bandwidth.

11. The multi-imager system of claim 7 further comprising:

wherein said plurality of imagers are a part of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.

12. A computer-useable medium having computer-readable program code stored thereon for causing a computer system to execute a method for producing seamless composite images having non-uniform resolution from a multi-camera system, comprising:

acquiring a plurality of lower resolution source images from a plurality of short focal length cameras in said multi-camera system;

blending said plurality of lower resolution source images to form a first resolution layer of an overall scene;

acquiring a plurality of higher resolution source images from at least one long focal length camera in said multi-camera system;

blending said plurality of higher resolution source images to form a second resolution layer of a portion of said overall scene;

embedding digital objects within said second resolution layer, wherein said digital objects are selectable to provide additional imagery interaction options; and

overlayering portions of said higher resolution layer and said lower resolution layer to produce a composite image with a plurality of source images having a plurality of resolutions therein.

13. The computer-useable medium having computer-readable program code stored thereon of claim 12 further comprising:

utilizing a combiner for blending said plurality of said lower resolution source images; and

utilizing said combiner for blending said plurality of higher resolution source images,

wherein said combiner combines said plurality of source images to produce a seamless composite image without requiring overlap of image regions of said plurality of source images.

14. The computer-useable medium having computer-readable program code stored thereon of claim 12 wherein after further comprising:

shaping said blending of said plurality of said lower resolution images and said plurality of said higher resolution images into a previously defined shape.

15. The computer-useable medium having computer-readable program code stored thereon of claim 12 further comprising:

blending at least one edge portion of said second resolution layer with a portion of said first resolution layer without requiring blending of other than the at least one edge portion of said second resolution layer with said portion of said first resolution layer.

16. The computer-useable medium having computer-readable program code stored thereon of claim 12 further comprising:

acquiring said plurality of lower resolution images in color;

acquiring said plurality of higher resolution images in monochrome; and

blending said color from said first resolution layer with said monochrome of said second resolution layer to obtain higher resolution color images at a reduced bandwidth.

17. The computer-useable medium having computer-readable program code stored thereon of claim 12 wherein said plurality of cameras are a part of a pan tilt zoom (PTZ) imaging system that provides frame selection within said composite image.