Computer generated synthesized imagery

• US 4,645,459 A
• Filed: 07/30/1982
• Issued: 02/24/1987
• Est. Priority Date: 07/30/1982
• Status: Expired due to Term

• Current Assignee: Theseus Research, Inc.
• Original Assignee: Honeywell Incorporated (Honeywell International Inc.)
• Inventors: Fairchild, Kim M., Rusler, George W., Fant, Karl M., Graf, Carl P., Schroeder, Michael O.
• Primary Examiner(s): Grieb, William H.
• Assistant Examiner(s): Picard, Leo P.
• Application Number:
  US06/403,386
• Time in Patent Office: 1,670 Days
• Field of Search: 434/20, 434/38, 434/43, 358/104
• US Class Current: 434/43
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G09B 9/301 by computer-processed or -generated image
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Abstract

The disclosure relates to a computer controlled imaging system involving a digital image processing and display system which has the ability to compose and construct a display scene from a library of images with sufficient processing speed to permit real-time or near real time analysis of the images by a human operator or a hardware/software equivalent thereof.

Claims

1. A computer controlled imaging system responsive to the position and orientation of a scene recognition means comprising:

a data base having a defined area with a digital three coordinate system and a library having a plurality of rectangular two dimensional image frames of electromagnetic spectrum band representation of images;

said defined area part of said data base having scene composition data which defines the location and size of each of said image frames relative to said coordinate system;

simulation means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system;

interface means for receiving said observation data;

field of view processor means associated with said interface means and said data base, said field of view processor means including a second three coordinate system and means for determining which of said image frames are included in said field of view and their respective ranges relative to said observation data and said frame data to compute four corner coordinates in said second three coordinate system which correspond to the defined area coordinates of the corners of each said included image frames;

controller means connected to said field of view processor and including means to receive data therefrom;

said data including the identity of said image frames included in said field of view, said ranges of said included image frames and said coordinates of each of said included image frames;

said controller means being further connected to said library part of said data base;

processing channel means controlled by said controller means connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said processing channel means, said channel means operating to map said included frames to the enclosed space defined by the corresponding ones of said corner coordinates; and

scene construction means connected to said processing channels for assembling an output scene based on said ranges of said included frames on a digital basis such that the included frame nearest said scene recognition means includes more distant ones of said included frames.

2. A computer-controlled imaging system according to claim 1 wherein said image frames are image representations selected from a group of electromagnetic wavelength bands consisting of IR, visual, millimeter wave or SAR domain.

3. The imaging system according to claim 1 further comprising a human-recognizable display device for displaying said scene.

4. The imaging system according to claim 3 wherein said display device is a video output device.

5. The imaging system according to any of claims 1, 2, 3, or 4 wherein said output scenes are produced in a continual sequential stream and correspond to any movement of said scene recognition means in said defined area.

6. The imaging system according to claim 5 wherein said sequential stream of output scenes are produced at a rate sufficient to appear as a continuous display to a human observer.

7. The imaging system according to claim 5 wherein said output scenes are produced in real-time response to the position and orientation, including changes therein, of said scene recognition means in said defined area.

8. The imaging system according to claim 6 wherein said output scenes are produced in real-time response to the position and orientation, including changes therein of said scene recognition means in said defined area.

9. The imaging system according to claim 5 wherein said movement of said scene recognition means in said defined area represents the simulated movement of a vehicle and wherein said output scenes comprise a continuous video display of the field of view of the vehicle operator.

10. The imaging system according to claim 9 wherein said display is produced in real-time response to the movement of said vehicle in said defined area.

11. A computer-controlled imaging system responsive to the position data and orientation data of a scene recognition means for providing raster display data to a raster type display device defining a two dimensional perspective view of a portion of a three dimensional system within the field of view of the scene recognition means, comprising:

a data base having a defined area part with a digital three coordinate system and a library part having a plurality of two dimensional rectangular image frames of electromagnetic spectrum band representations of images;

said defined area part of said data base having frame data which defines the location and size of each of said image frames relative to said coordinate system, and the scale thereof;

means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system,

interface means for receiving said observation data,

field of view processor means connected to said interface means to access said observation data and connected to said defined area part of said data base, said processor means including means for determining which of said image frames are included in said field of view of said scene recognition means and their respective ranges relative to said observation data and said frame data to compute four screen corner coordinates in said three coordinates which correspond to the defined area coordinates of the corners of each said included image frames;

controller means connected to said field of view processor means and including means to receive computed data therefrom including the identity of said image frames included in said field of view, said ranges of said included frames and said screen coordinates of each of said included image frames;

said controller means being connected to said library part of said data base,

at least one processing channel means controlled by said controller means and connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said at least one processing channel, each of said at least one processing channels operating to map at least one of said included frames to the enclosed space defined by the corresponding ones of said screen corner coordinates;

scene construction means connected to said processing channels for assembling a scene based on said ranges of said included frames on a digital basis with the included frame nearest said observer occluding more distant ones of said included frames.

12. A computer-controlled imaging system according to claim 11 wherein said image frames are image representations selected from a group consisting of IR, visual, millimeter wave or radar images.

13. A computer-controlled imaging system according to claim 11 wherein at least one of said image frames is a pictorial representation of a two dimensional object photographed from a predetermined average aspect angle.

14. A computer-controlled imaging system according to claim 13 wherein said aspect angle is about minus 15 degrees.

15. A computer-controlled imaging system according to claim 11 wherein some of said image frames are a series of pictorial representations of a particular object photographed at different height intervals relative to the vertical axis thereof.

16. A computer-controlled imaging system according to claim 11 wherein at least one of said image frames is a pictorial representation of a group of objects to thereby increase detail simulation thereof.

17. A computer-controlled imaging system according to claim 11 wherein some of said frames are pictorial representations of terrain surfaces.

18. A computer-controlled imaging system according to claim 17 wherein said some of said image frames for a particular terrain surface are in a group in which variations of said particular terrain surface from frame to frame provide motion simulation effects including blowing wind and running water.

19. A computer-controlled imaging system according to claim 17 wherein at least some of said frames are pictorial representations of textured surfaces such as water and grass.

20. A computer-controlled imaging system according to claim 19 wherein said defined area part of said data base includes defined elongated surface areas for natural and man-made terrain features, said frames of pictorial representations of textured surfaces being appropriately provided to represent said terrain features.

21. A computer-controlled imaging system according to claim 11 directed to portraying a large three dimensional, two axis object, storing a series of pictures in increments of small angles in both azimuth and elevation.

22. A computer-controlled imaging data system according to claim 21 wherein said small angles are on the order of one degree.

23. A computer-controlled imaging system according to claim 21 wherein said small angles are precisely obtained by taking pictures in connection with rotating a model of said large object on rotatable tables having vertical and horizontal axes.

24. A computer-controlled imaging system according to claim 21 wherein said large object is broken down into separate 2D subsurfaces which are assembled by at least two of said one or more processing channels.

25. A computer-controlled imaging system according to claim 21 wherein a series of photographs are taken of said large objects at angular azimuth intervals at a fixed elevation.

26. A computer-controlled imaging system according to claim 11 wherein said angular azimuth intervals are on the order of 30 degrees.

27. A computer-controlled imaging system according to claim 11 wherein at least one of said image frames contains one or more light sources.

28. A computer-controlled imaging system according to claim 11 wherein at least one of said frames has a translucent characteristic for adding a special effect to a scene.

29. A computer-controlled imaging system according to claim 28 wherein said special effects comprise fog, dust, smoke shadow or haze.

30. A computer-controlled imaging system according to either of claims 28 or 29 wherein said translucent characteristic is stored as a mask which defines the outline, shape and transmissivity factor thereof.

31. A computer-controlled imaging system according to claim 30 wherein a series of said frames have varying mask shapes to generate a motion effect.

32. The computer-controlled imaging system according to claim 11 further comprising means for producing occlusion of the contents of distant frames by those in closer frames in said scene.

33. An image data system according to claim 32 wherein at least one of said frames portrays an elongated object, said defined area part of said data base having multiple range points for different sections of said elongated object with the particular multiple range point closest to said observer having priority relative to occlusion comparison with other ones of said included frames.

34. A computer-controlled imaging system according to claim 33 wherein two of said multiple range points are provided for opposite ends of said elongated object.

35. A computer-controlled imaging system according to claim 11 wherein said image frames of electromagnetic spectrum band representations are in analog form, one of said at least one processing channels further comprises:

A/D converter means for converting said representations to digital data form;

buffer means accepting said digital data in either the X or Y axis; and

means for mapping the image of said digital data to the corner coordinates of a video screen.

36. A computer-controlled imaging system according to claim 35 including means for modifying the intensity values of said data in said buffer means.

37. A computer-controlled imaging system according to claim 11 wherein said image frames of electromagnetic spectrum band representations are in digital data form;

and wherein one of said at least one processing channel includes buffer means for accepting said digital data in either the X or Y axis, and means for mapping the image of said digital data to the corner coordinates of said display means.

38. A computer-controlled imaging system according to claim 37 including means for modifying the intensity values of said data in said buffer means.

39. A computer-controlled imaging system according to claim 11 wherein said scene construction means comprises channel combiner means for multiplexing signals from a plurality of processing channels and corresponding range information from said controller means, said channel combiner further comprising switch means for selecting data from said plurality of processing channels outputting scene data relative to range in the field of view of said scene recognition means.

40. One of any of claims 35, 36, 37, 38, or 39 wherein said raster display means is a video screen.

41. A computer-controlled imaging system according to any of claims 11, 32, 35 or 39 wherein said output scenes are produced in a continual sequential stream and correspond to any movement of said scene recognition means in said defined area;

and wherein said sequential stream of output scenes are produced at a rate sufficient to appear as a continuous display to a human observer.

42. A computer-controlled imaging system according to claim 41 wherein said output scenes are produced in real-time response to the position and orientation of said scene recognition means in said defined area including changes in said position and orientation.

43. A computer-controlled imaging system according to claim 41 wherein said movement of said scene recognition means in said defined area represents the simulated movement of a vehicle and wherein said output scenes comprise a continuous video display of the field of view of the operator of said vehicle.

44. A computer-generated imaging system according to claim 11 including means for warping said images in said image frames requisite to said scene representation.

45. A computer-controlled imaging system according to claim 44 including means for accomplishing both linear and perspective image warping as desired.

46. A computer-controlled imaging system according to claim 11 including special effect means associated with said scene construction means for adding translucent images including smoke, haze or dust into the scene as desired.