Shadow buffer control module method and software construct for adjusting per pixel raster images attributes to screen space and projector features for digital warp, intensity transforms, color matching, soft-edge blending, and filtering for multiple projectors and laser projectors

• US 20020180727A1
• Filed: 07/26/2002
• Published: 12/05/2002
• Est. Priority Date: 11/22/2000
• Status: Abandoned Application

• Current Assignee: SDS International, Incorporated
• Original Assignee: SDS International, Incorporated
• Inventors: Kane, Francis James Jr., Guckenberger, Ronald James
• Application Number:
  US10/207,443
• Publication Number:
  US 20020180727A1
• Time in Patent Office: Days
• US Class Current: 345/418
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Computerized method that provides user control of multiple reusable parallel buffers that have utility in mapping and processing digital transformations to improve formation of composite images for single or multiple images. Pixel and sub-pixel memory maps (i.e., Shadow Buffers) of screen space and projector attributes (e.g., gamma, contrast, intensity, color, position, stretching, warping, soft-edge blending, etc.) are used to improve the final overall composite image. Composite imagery improvements include multiple projected images digitally soft-edge blended into seamless tiled image display; single or multiple projected images digitally warped into a seamless tiled image for curved screen displays; single or multiple projected images digitally warped for geometric correction; single or multiple images digitally corrected for defects in the projector or display device; single or multiple images digitally corrected for defects in the display screen(s); and single or multiple images digitally combined or subtracted for sensor fusion, synthetic visions, and augmented reality. Digital image manipulation and control means enable the use of low cost solutions such as digital projectors and achieve tiling of multiple low-cost visual channels coupled with low-cost high lumen LCD projectors to produce high-resolution, high-brightness projected displays suitable for military simulation and commercial applications within the image generation device and does not require additional custom hardware. Further, the parallel nature of the Shadow Buffer supports combinations for a plurality of applications. A digital video combiner is leveraged to obtain ultra high-resolution.

Claims

1. A system for adjusting digitally generated images for single monitors, single projectors, and arrays of monitors and projectors of raster images to form composite blended images from multiple frame buffer inputs comprising:

a N dimensional array of Shadow Buffers, each Shadow Buffer being loaded with a pre-selected value associated with at least one of a sub-pixel, a pixel, and a region of each input memory to be blended into an entire composite image; and

means for applying the Shadow Buffer values to data corresponding to a digital image to effect modification of each of at least one of the sub-pixels, pixels, and regions to produce a non-distorted blended image.

2. The system of claim 1, wherein the applying means comprises means for blending or superimposing multiple digital images into a single blended image.

3. The system of claim 1, wherein the applying means comprises means for blending real-time video or sensor image digital data while simultaneously superimposing computer generated simulated visuals or sensor images into a single blended image, each source image of the resultant blended image being brightened or dimmed for emphasis or reduction of visible contribution.

4. The system of claim 3, wherein the applying means comprises means for surrounding the blended image with additional synthetic vision displays to increase situational awareness by increasing the apparent field-of-view (FOV).

5. A system for adjusting digitally generated images to compensate for projection artifacts and screen defects and/or blended images comprising:

at least one display device;

at least one image generation system for producing raster images;

a N dimensional array of Shadow Buffers, each Shadow Buffer being loaded with a pre-selected value associated with at least one of a sub-pixel, a pixel, and a region of each input memory to be blended into an entire composite image; and

means for applying the Shadow Buffer values to data corresponding to a digital image to effect modification of each of at least one of the sub-pixels, pixels, and regions to produce a non-distorted blended image.

6. The system of claim 5, wherein the applying means comprises means for soft edge blending of adjacent overlapping raster images.

7. The system of claim 5, wherein the applying means comprises means for matching color outputs of the raster images.

8. The system of claim 5, wherein the applying means comprises means for adjusting individual image intensity for multiple image blending.

9. The system of claim 8, wherein the applying means comprises means for correcting occurrences of horizontal, vertical, and geometric color purity shifts by adjusting the brightness of the composite image according to the Shadow Buffer values.

10. The system of claim 5, wherein the applying means comprises means for correcting occurrences of optical keystone and pin cushion effects by masking image edges and adjusting the color space contributions with spatial alterations for the remaining pixels of the raster images according to the Shadow Buffer values.

11. The system of claim 8, wherein the applying means comprises means for applying the Shadow Buffer values per sub-pixel or pixel to adjust selected portions of the composite image which are brighter to be diminished more strongly than selected portions of the composite image which are darker.

13. The system of claim 12, further comprising a gamma correction means coupled to the multiple Shadow Buffers to adjust the gamma prior to projection of the raster images.

14. The system of claim 12, further comprising an intensity correction means coupled to the array of Shadow Buffers to adjust the intensity prior to projection of the raster image.

16. The method of claim 15, where the image intensity of each image is calculated for “

n”

captured pixels is calculated using the following formula;

17. The method of claim 15, where the image color texture map is computed with the following formula:

18. The method of claim 15, that further includes edge blending of each projected image to form a seamless projected image comprised of selecting an area of overlap of adjacent images and reducing the intensity of at least one of the images at the area of overlap until at least one image at the area of overlap becomes non-discernable.

12. A system for adjusting video signals representing an array of raster images to compensate for projection defects and screen defects comprising:

a plurality of projectors for displaying an array of raster images forming a composite projected image, each raster image including image pixel values having red, green, and blue color components;

means for storing N dimensional array of Shadow Buffer values, each Shadow Buffer value being associated with at least one of a sub-pixel, a pixel, and a region projected image;

means for applying the Shadow Buffer values to data forming the raster image to remove projection and screen defects resulting from display of the array of raster images, wherein the Shadow Buffer values comprises;

an intensity Shadow Buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values by addition, subtraction, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations;

a gamma Shadow Buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values by addition, subtraction, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations;

a color space Shadow Buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values by addition, subtraction, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations; and

a geometry correction Shadow Buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values via a Shadow Buffer edge mask coupled with a redistribution of the masked pixels values across the remaining displayed pixels.

15. A method for color and intensity matching of images generated by a plurality of projectors comprising:

projecting a plurality of images from corresponding projectors in response to image data obtained from a plurality of image generation devices;

monitoring each projected image from each of a plurality of projectors to obtain color and intensity values for each image;

determining from the monitored color and intensity values from one of the corresponding projectors and its associated image generation device the lowest luminance value of color and intensity to establish a reference value; and

applying the reference value to each of the remaining image generation devices to adjust color and intensity to a uniform value for all projectors.

19. A method for obtaining improved quality of images generated by a plurality of projectors comprising processing a plurality of image data in the plurality of image generation devices at a higher resolution than the plurality images being projected from corresponding projectors.

20. A system for producing ultra high resolution of digitally generated images for single monitors, single projectors, and arrays of monitors and projectors of raster images to form composite blended images from a plurality of digital video combiner inputs comprising:

a N dimensional array of image generators, each image generator being associated with at least one portion of the entire composite image;

a means for digitally combining inputs from a plurality of image generators to form a contiguous composite image;

a means for applying the digital video combiner values to data corresponding to a digital image to effect modification of each of at least one of the sub-pixels, pixels, and regions to produce a non-distorted blended image; and

a means to display the resultant composite imagery.

21. The system of claim 20, wherein the applying means comprises means for blending or superimposing multiple high-resolution digital images into a single blended image collectively producing ultra high-resolution.