Shadow buffer control module method and software construct for adjusting per pixel raster images attributes to screen space and projector features for digital wrap, intensity transforms, color matching, soft-edge blending and filtering for multiple projectors and laser projectors

• US 20020158877A1
• Filed: 11/20/2001
• Published: 10/31/2002
• Est. Priority Date: 11/22/2000
• Status: Abandoned Application

• Current Assignee: Francis James Jr. Kane, Ronald James Guckenberger
• Original Assignee: Francis James Jr. Kane, Ronald James Guckenberger
• Inventors: Guckenberger, Ronald James, Kane, Francis James Jr.
• Application Number:
  US09/989,316
• Publication Number:
  US 20020158877A1
• Time in Patent Office: Days
• US Class Current: 345/536
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

The Shadow Buffer method can be characterized as control of multiple reusable parallel buffers that have utility in mapping digital transformations to improve formation of composite images for single displays or multiple projected images. This method can be described analogously as innovative extensions to current software and hardware solutions that use multiple allocation of pixel memory space to color, alpha and Z-depth functions. The Shadow Buffers are additional pixel and sub-pixel memory maps of screen space and projector attributes (e.g., gamma, contrast, intensity, color, position, stretching, warping, soft-edge blending) that improve the final overall composite image. The improved composite images include but are not limited to:

Multiple Projected Images digitally soft-edge blended into a seamless tiled image displays

Single or Multiple Projected Images digitally warped into a seamless tiled image for curved screen displays

Single or Multiple Projected Images digitally warped for geometric corrections for optical keystone and pin cushion effects.

Single or Multiple Images digitally corrected for defects in the projector or monitor display device

Single or Multiple Images digitally corrected for defects in the display screen(s)

Single or Multiple Images digitally combined or subtracted for sensor fusion, synthetic visions and augmented reality

Further, the parallel nature of the Shadow Buffer supports combinations for custom applications. For example up to the memory limitations of a particular device the Shadow Buffers can be utilized to soft-edge blend, digitally warp projected image tiles and simultaneously corrects for defects in the projector and screen.

Additional combinations and other extensions are obvious to others familiar with the current state of the art.

It is important to emphasize that the Shadow Buffer method is a software construct and method that digitally controls the images within the image generation device and does not require additional custom hardware. Hardware acceleration of the Software Construct and Shadow Buffer Method is possible but not required.

Claims

1. A system for adjusting digitally generated images for single monitors, single projectors and arrays of monitors, and projectors of raster images to form composite blended images from multiple frame buffer inputs comprising:

single or multiples of monitors including CRTs, flat screens, and projectors and their associated displays, to form blended composite images;

a plurality of projectors to display the array of raster images, each raster image including red, green and blue color components, to form a blended composite projected image;

a N dimensional array of shadow buffers, each shadow buffer value being associated with a sub-pixel, pixel, region of each input memory value blended into the entire composite image; and

means for applying the shadow buffer values to the digital image prior to output as video signals or digital packets to blend multiple digital inputs and frame buffer memory values into a blended composite image, wherein the shadow buffer values comprises alterations and modifications to for each image pixel displayed of the blended composite image for each of red, green, and blue color displayed frame buffer pixel value, and wherein each shadow buffer value is applied to a selected portion of the blended composite image by addition, subtracting, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations the shadow buffer values with input frame buffer values for the selected portion.

2. The system of claim 1, wherein the applying means comprises means for blending and or superimposing multiple digital inputs into a single blended image, each layer of the resultant image can be brightened or dimmed for emphases or reduction of visible contribution. This blended image methodology improves sensor fusion, synthetic vision applications and augmented reality applications.

3. The system of claim 1, wherein the applying means comprises means for blending real-time video and or sensor image digital inputs while simultaneously superimposing photo-realistic, geo-specific synthetic vision computer generated simulated visuals and or sensor images into a single blended image, each layer of the resultant image can be brightened or dimmed for emphases or reduction of visible contribution.

4. The system of claim 1, wherein the applying means comprises means for surrounding the blended sensor fusion, synthetic vision applications and augmented reality display with additional synthetic vision displays to increase situational awareness by increasing the apparent Field Of View (FOV). This methodology is particularly valuable for Unmanned Aerial Vehicle Electro-Optical Pod Controllers.

5. A system for adjusting digitally generated images for single monitors, single projectors and arrays of monitors, and projectors of raster images to compensate for projection and screen defects and or blended images comprising:

single or multiples of monitors including CRTs, flat screens, and projectors and their associated display screens, to form blended or composite images;

a plurality of projectors to display the array of raster images, each raster image including red, green and blue color components, to form a composite projected image;

a N dimensional array of shadow buffers, each shadow buffer value being associated with a sub-pixel, pixel, region or the entire composite projected image; and

means for applying the shadow buffer values to the digital image prior to output as video signals or digital packets to remove the projection and screen defects resulting from display of the array of raster images, wherein the shadow buffer values comprises alterations and modifications to for each image pixel displayed of the composite projected image for each of red, green, and blue color displayed frame buffer pixel value, and wherein each shadow buffer value is applied to a selected portion of the composite projected image by addition, subtracting, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations the shadow buffer values with displayed frame buffer values for the selected portion.

6. The system of claim 5, wherein the applying means comprises means for soft edge blending of adjacent overlapping raster images for arrays including horizontal, vertical and tiled configurations.

7. The system of claim 5, wherein the applying means comprises means for soft edge blending of adjacent overlapping raster images for arrays including horizontal, vertical and tiled configurations.

8. The system of claim 5, wherein the applying means comprises means for matching color outputs of the projectors displaying the array of raster images.

9. The system of claim 5, wherein the applying means comprises means for correcting occurrences of improper projector shading for the projectors by applying the shadow buffer values.

10. The system of claim 5, wherein the applying means comprises means for correcting occurrences of horizontal, vertical, or geometric color purity shifts for the projectors by adjusting the brightness of the composite projected image according to the shadow buffer values.

11. The system of claim 5, wherein the applying means comprises means for correcting occurrences of optical keystone and pin cushion effects for the projectors by masking the edges and adjusting the color space contributions with spatial alterations for the remaining pixels of the columns and/or rasters that have been shortened of the composite projected image according to the shadow buffer values.

12. The system of claim 5, wherein the applying means comprises means for applying the shadow buffer values per sub-pixel or pixel linearly and non-linearly to adjust selected portions of the composite projected image which are brighter to be diminished more strongly than selected portions of the composite projected image which are darker, thereby adjusting the value of the smoothing factors based on a variable intensity of the video signals for the selected portions.

13. The system of claim 5, wherein the applying means comprises means for altering edges of the composite projected image when the composite projected image is not square or rectangular in shape and for displaying the composite projected image within the determined display edges.

15. The system of claim 14, further comprising a gamma correction method coupled to the multiple shadow buffers to adjust the gamma prior to output of the video signals and digital outputs.

16. The system of claim 14, further comprising a intensity correction method coupled to the multiple shadow buffers to adjust the intensity prior to output of the video signals and digital outputs.

18. The method of claim 17, further comprising the steps of:

(r) analyzing entire area of each projector'"'"'s projected raster image;

(s) calculate per pixel changes to the shadow buffers based upon the performance profile;

(t) applying the calculated per pixel values to the shadow buffers to the composite raster image.

19. The method of claim 18, wherein the shadow buffers comprises an N dimension dimensional array of parallel buffers.

14. A system for adjusting video signals representing an array of raster images to compensate for projection defects and screen defects comprising:

a plurality of projectors to display the array of raster images, each raster image including red, green and blue color components, to form a composite projected image;

means for storing N dimensional arrays of shadow buffer values, each shadow buffer value being associated with a portion of the composite projected image; and

means for applying the shadow buffer values to the digital image prior to output as video signals or digital packets to remove the projection and screen defects resulting from display of the array of raster images, wherein the applying means comprises;

an intensity shadow buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values by addition, subtracting, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations prior to output;

a gamma shadow buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel values by addition, subtracting, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations prior to output;

a color space shadow buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel color values by addition, subtracting, shifting, masking of bits, or colors, scaling, accumulation, logical and bit-wise operations prior to output; and

a geometry correction shadow buffer array comprised of sub-pixel or pixel values that digitally adjusts the associated image pixel column or raster lengths via a shadow buffer edge mask coupled with a redistributes of the masked pixels values across the remaining displayed pixels.

17. A method of matching arrayed projectors to produce a composite raster image having consistent green, red, and blue color values, comprising the steps of:

(a) focusing at least one digital camera or light sensor on the display(s) or projection screen(s);

(b) displaying green color values by a selected one of the displays or projectors on the display(s) or projection screen(s);

(c) displaying bars or grayscale patterns, etc. of the green color values by the selected display or projector on the display(s) or projection screen(s);

(d) collecting green performance measurement data from the at least one digital camera or light sensor sensing the display by the selected display(s) or projection screen(s);

(e) displaying red color values by a selected one of the displays or projectors on the display(s) or projection screen(s);

(f) displaying bars or grayscale patterns, etc. of the red color values by the selected display or projector on the display(s) or projection screen(s);

(g) collecting red performance measurement data from the at least one digital camera or light sensor sensing the display by the selected display(s) or projection screen(s);

(h) displaying blue color values by a selected one of the displays or projectors on the display(s) or projection screen(s);

(i) displaying bars or grayscale patterns, etc. of the blue color values by the selected display or projector on the display(s) or projection screen(s);

(j) collecting blue performance measurement data from the at least one digital camera or light sensor sensing the display by the selected display(s) or projection screen(s);

(k) displaying grayscale color values by a selected one of the displays or projectors on the display(s) or projection screen(s);

(l) displaying bars or grayscale patterns, by the selected display or projector on the display(s) or projection screen(s);

(m) collecting grayscale performance measurement data for contrast and dynamic range from the at least one digital camera or light sensor sensing the display by the selected display(s) or projection screen(s);

(n) repeating steps (b)-(m) for each of the display(s) or projection screen(s);

(o) generating a performance profile for each of the display(s) or screen projection and for all projectors combined from the collected measurement data;

(p) adjusting the projectors according to the performance profiles, via digital controls from a shadow buffer control module ( * * * Separate provisional patent application) and

(q) adjusting the associated shadow buffer according to the performance profiles, via digital controls from a shadow buffer control module ( * * * Separate provisional patent application) wherein the composite rater image comprises a plurality of raster images, each of the plurality of raster images includes red, green and blue color components, and each raster image is displayed on single or multiple displays, tiled flat panels, and or projected on a projection screen by one of the arrayed projectors.

20. A system for producing a composite raster image having consistent dynamic range for the system comprising:

arrayed projectors to project the composite raster image on a projection screen;

at least one digital camera or one light sensor sensing the composite raster image on the projection screen;

means for displaying selected color values by selected projectors on the projection screen;

means for displaying patterns of selected color values by selected projectors on the projection screen;

means for collecting measurement data from the at least digital camera or one light sensor sensing the display by the selected projector of the patterns;

means for generating a dynamic range performance profile for each of the projectors and for all projectors combined from the collected measurement data; and

means for adjusting the projectors according to the dynamic range performance profiles, wherein the composite raster image comprises a plurality of raster images, each of the plurality of raster images includes various dynamic range performance, and the arrayed protectors are matched to provide the consistent dynamic range performance values to the composite raster image.

21. The system of claim 20, further comprising:

means for generating a color performance profile for each of the projectors and for all projectors combined from the collected measurement data; and

means for adjusting the projectors according to the color performance profiles.

22. The system of claim 20, further comprising:

means for generating a gamma performance profile for each of the projectors and for all projectors combined from the collected measurement data; and

means for adjusting the projectors according to the gamma performance profiles.