Image texturing system having theme cells

• US 5,748,867 A
• Filed: 07/06/1993
• Issued: 05/05/1998
• Est. Priority Date: 02/18/1992
• Status: Expired due to Term

• Current Assignee: Rockwell Collins Simulation and Training Solutions, LLC
• Original Assignee: Evans & Sutherland Computer Corp. (Elevate Entertainment, Inc.)
• Inventors: Brown, Thomas C., Cosman, Michael
• Primary Examiner(s): Zimmerman, Mark K.
• Application Number:
  US08/088,447
• Time in Patent Office: 1,764 Days
• Field of Search: 395/129, 395/125, 395/127, 395/120, 395/119, 395/128, 395/134, 395/130
• US Class Current: 715/811
• CPC Class Codes: G06T 15/50 Lighting effects
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G09B 9/301 by computer-processed or -generated image

Abstract

An image texturing system utilizes theme cells to generate terrain image data area-by-area for a dynamic terrain display. The system is effective in flight simulation apparatus, as for training pilots. A memory stores theme maps representing areas of specific terrains, e.g. terrains lying below a flight path. The theme maps are indexed on a square grid pattern and include a feature identification code (FIC) for each grid point to indicate terrain, e.g. forest, water, etc. A selection device controlled by an image generator selects a current theme map and dissects it cell-by-cell as defined by grid points to provide corner-referenced representations for each theme cell. A terrain storage device stores a library of terrain treatment pattern arrays that are derived, for example, from photo data of forest, ocean, or the like. A terrain treatment pager controlled by the image generator provides representations of select terrain treatments indicated for a current theme cell and selects the terrain treatment required for texturing the current theme cell. A theme element assembler receives the representations for the current theme cell and the select terrain treatments. The cell is specified according to rules for representing one or more terrain treatments. When the range closes to a distance where features would be discernable, representative three-dimensional data for specific objects, e.g. houses, is provided for displays on specific locations. At some point in a flight path, geo-specific data may replace the semi-specific data of simulated terrain.

Claims

1. An image texturing system for generating simulated terrains or external scenes as for applications such as flight training, said image texturing system including an image generator for generating visual real-time images for display on a display device, said texturing system further comprising:

means for storing a theme map having index identifiers defining a plurality of theme cells disposed in a grid pattern, wherein said theme cells have edges and corners, and wherein said index identifiers indicate geographic terrain characteristic themes and define said corners of said theme cells;

means for storing terrain treatment arrays of said geographic terrain characteristic themes for application to said theme cells; and

means for applying at least part of at least one of said terrain treatment arrays to texture said theme cells whereby a single terrain treatment array is applied when said index identifiers for a theme cell represent similar geographic terrain characteristic themes, and a plurality of terrain treatment arrays are applied when said index identifiers for said theme cell represent different geographic terrain characteristic themes, said plurality of terrain treatment arrays applied in accordance with a sinuous merging rule for natural terrains and an inorganic merging rule for unnatural terrains, such that boundaries terminate at an edge of said theme cell substantially on a midpoint between corners.

2. An image texturing system as defined in claim 1 additionally comprising means for generating a selected high resolution portion in said real-time visual image from photographic data stored in a photo data source.

3. An image texturing system as defined in claim 1 wherein said terrain treatment arrays are larger than intervals between said index identifiers in said grid pattern.

4. An image texturing system as defined in claim 1 wherein said terrain treatment arrays representing each of said geographic terrain characteristic themes have a plurality of subportions arranged in an array, each subportion selected sequentially when applied to texture theme cells defined by neighboring groups of index identifiers.

5. An image texturing system as defined in claim 1 additionally comprising:

means for storing object coordinate data;

means for storing three-dimensional object data representative of objects and identified with said object coordinate data; and

structure for selectively processing said three-dimensional object data to generate objects on said theme cells at locations in accordance with said object coordinate data, including means for selectively processing in accordance with a range to a simulated scene.

6. A computer graphics system for use with an image generator to generate terrain image data for a display, comprising:

memory means for storing theme maps of specific geographic terrains;

selection means controlled by said image generator for selecting a current theme map and dissecting said current theme map to generate index identifier representations of geographic terrain types present within a current theme cell;

means for storing a plurality of geographic terrain treatment arrays;

means controlled by said image generator for fetching representations of select geographic terrain treatment arrays as indicated for said geographic terrain types; and

theme element assembler means for receiving said index identifier representations of said geographic terrain types and said select geographic terrain treatment arrays to provide representations of a combined theme cell to said image generator, wherein said representations of said combined theme cell include a plurality of geographic terrain treatment arrays, whereby boundaries between such geographic terrain treatment arrays terminate at predetermined junction locations for continuity.

7. A computer graphics system as defined in claim 6 additionally comprising means for generating a selected high resolution portion in said real-time visual image from photographic data stored in a photo data source.

8. A computer graphics system as defined in claim 6 wherein:

said index identifiers are separated by intervals; and

said geographic terrain treatment arrays are larger than said intervals.

9. A computer graphics system as defined in claim 6 wherein said terrain treatment arrays representing each of said geographic terrain types has a plurality of subportions arranged in an array, each subportion selected sequentially when applied to texture theme cells defined by neighboring groups of index identifiers.

10. A computer graphics system as defined in claim 6 additionally comprising:

means for storing object coordinate data;

means for storing three-dimensional object data representative of objects and identified with said object coordinate data; and

structure for selectively processing said three-dimensional object data to generate objects on said theme cell at locations in accordance with said object coordinate data.

11. A computer graphics system as defined in claim 10 wherein said structure for selectively processing said three-dimensional object data includes means for selectively processing in accordance with a range to a simulated scene.

12. An image generating system for generating simulated terrains or external scenes as for applications such as flight training, said image generating system including an image generator for generating visual real-time images for display on a display device, said image generating system further comprising:

memory for storing a theme map having index identifiers defining a plurality of theme cells disposed in a grid pattern, said index identifiers indicating geographic terrain characteristic themes;

memory for storing two-dimensional terrain treatment arrays of said geographic terrain characteristic themes for application to texture said theme cells, said memory further storing object coordinate data;

means for texturing at least part of at least one of said terrain treatment arrays on said theme cells;

memory for storing three-dimensional object data representative of objects and identified with said object coordinate data;

structure for selectively processing said three-dimensional object data to generate objects on said theme cells at locations in accordance with said object coordinate data;

memory for geo-specific three-dimensional data; and

means for selectively processing said geo-specific three-dimensional data for a simulated terrain, when such data is available, instead of said terrain treatment arrays and said object data.

13. An image generating system according to claim 12 wherein said structure for selectively processing said three-dimensional object data includes means for selectively processing in accordance with a range to a simulated scene.

14. An image generating system according to claim 12 wherein said structure for selectively processing said three-dimensional objects into a simulated scene is activated when a range to said scene closes to a predetermined distance.

15. An image generating system as defined in claim 12 wherein said terrain treatment arrays representing each of said geographic terrain characteristic themes have a plurality of subportions arranged in an array, each subportion selected sequentially when applied to texture theme cells defined by neighboring groups of index identifiers.

16. A method for providing simulated terrains or external scenes, as for applications such as flight training, said method for use with an image texturing system including an image generator for generating visual real-time images and a display device for displaying such images, said method comprising the steps of:

storing a theme map having index identifiers defining a plurality of theme cells disposed in a grid pattern, wherein said theme cells have edges, and said index identifiers indicate geographic terrain characteristic themes and define corners of said theme cells;

storing terrain treatment arrays of said geographic terrain characteristic themes for application to texture said theme cells; and

applying at least part of at least one of said terrain treatment arrays to texture said theme cells such that a single terrain treatment array is applied when said index identifiers for a select theme cell represent the same geographic terrain characteristic theme, and a plurality of terrain treatments are applied when said index identifiers for said select theme cell represent different geographic terrain characteristic themes, said plurality of terrain treatment arrays applied in accordance with a sinuous merging rule for natural terrains and an inorganic merging rule for unnatural terrains, such that boundaries terminate at the edge of said select theme cell substantially on a midpoint between corners.

17. The method of claim 16 further including the step of generating a selected high resolution portion in said visual real-time image from photographic data stored in a photo data source.

18. The method of claim 16 wherein said terrain treatment arrays are larger than intervals between said index identifiers in said grid pattern.

19. The method of claim 16 wherein said terrain treatment arrays representing each of said geographic terrain characteristic themes have a plurality of subportions arranged in an array, further including the step of sequentially selecting each subportion when applied to texture theme cells defined by neighboring groups of index identifiers.

20. The method of claim 16 further including the steps of:

storing object coordinate data;

storing three-dimensional object data representative of objects and identified with said object coordinate data; and

selectively processing said three-dimensional object data, in accordance with a range to a simulated scene, to generate objects on said theme cells at locations in accordance with said object coordinate data.

21. A method for providing simulated terrains or external scenes as for applications such as flight training, said method for use with an image generator for generating visual real-time images and a display device for displaying said images, said method comprising the steps of:

storing a theme map having index identifiers defining a plurality of theme cells in a grid pattern, said index identifiers indicating geographic terrain characteristic themes;

storing two-dimensional terrain treatment arrays of said geographic terrain characteristic themes for application to said theme cells and further storing object coordinate data;

texturing at least part of at least one of said terrain treatment arrays on said theme cells;

storing three-dimensional object data representative of objects identified with said object coordinate data;

selectively processing said three-dimensional object data to generate objects on said theme cells at locations in accordance with said object coordinate data for said display device;

storing geo-specific three dimensional data; and

selectively processing said geo-specific three-dimensional data for a simulated terrain, when such data is available, instead of said terrain treatment arrays and said object data.

22. The method of claim 21 wherein said step of selectively processing said three-dimensional object data is active during operating periods when a range to a simulated terrain is less than a predetermined distance.

23. The method of claim 21 wherein said terrain treatment arrays representing each of said geographic terrain characteristic themes have a plurality of subportions arranged in an array, further including the step of sequentially selecting each subportion when applied to texture theme cells defined by neighboring groups of index identifiers.

24. An image generating system for generating simulated terrains or external scenes as for applications such as flight training, said image generating system including an image generator for generating visual real-time images for display on a display device, said image generating system further comprising:

memory for storing a theme map having index identifiers defining a plurality of theme cells disposed in a grid pattern, said index identifiers indicating geographic terrain characteristic themes;

memory for storing two-dimensional terrain treatment arrays of said geographic terrain characteristic themes for application to texture said theme cells, said memory further storing object coordinate data;

means for texturing at least part of at least one of said terrain treatment arrays on said theme cells;

memory for storing three-dimensional object data representative of objects and identified with said object coordinate data;

structure for selectively processing said three-dimensional object data to generate objects on said theme cells at locations in accordance with said object coordinate data, wherein certain of said theme cells include internal boundaries, defined by a set of combination rules which utilize the geographic terrain characteristic themes indicated by said index identifiers to produce said real-time visual images on said display device.

25. An image generating system as defined in claim 24 wherein said structure for selectively processing said three-dimensional object data includes means for selectively processing in accordance with a range to a simulated scene.

26. An image generating system as defined in claim 24 further comprising:

memory for storing geo-specific three-dimensional data; and

means for selectively processing said geo-specific three-dimensional data for a simulated terrain, when such data is available, instead of said terrain treatment arrays and said object data.

27. A method for use with an image generator for generating terrain image data to generate images on a display device, comprising the steps of:

storing theme maps of specific geographic terrains;

selecting a current theme map and dissecting said current theme map to generate index identifier representations of geographic terrain types present within a current theme cell;

storing a plurality of geographic terrain treatment arrays;

fetching representations of select geographic terrain treatment arrays as indicated for said geographic terrain types;

receiving said index identifier representations of said geographic terrain types and said select geographic terrain treatment arrays; and

providing representations of a combined theme cell to said image generator, wherein said representations of said combined theme cell include a plurality of geographic terrain treatment arrays, whereby boundaries between such geographic terrain treatment arrays terminate at predetermined junction locations for continuity.

28. The method of claim 27 further including the step of generating a selected high resolution portion in said images from photographic data stored in a photo data source.

29. The method of claim 27 wherein:

said index identifier representations define intervals; and

said geographic terrain treatment arrays are larger than said intervals.

30. The method of claim 27 wherein each of said terrain treatment arrays has a plurality of subportions arranged in an array, further including the step of sequentially selecting each subportion when applied to texture theme cells defined by neighboring groups of index identifier representations.

31. The method of claim 27 further including the steps of:

storing object coordinate data;

storing three-dimensional object data representative of objects and identified with said object coordinate data; and

selectively processing said three-dimensional object data to generate objects on said theme cell at locations in accordance with said object coordinate data.

32. The method of claim 31 wherein said step of selectively processing said three-dimensional object data is active during operating periods when a range to a simulated terrain is less than a predetermined distance.

33. A method for providing simulated terrains or external scenes as for applications such as flight training, said method for use with an image generator for generating visual real-time images and a display device for displaying said images, said method comprising the steps of:

storing a theme map having index identifiers defining a plurality of theme cells disposed in a grid pattern, said index identifiers indicating geographic terrain characteristic themes;

storing two-dimensional terrain treatment arrays of said geographic terrain characteristic themes for application to texture said theme cells, said memory further storing object coordinate data;

texturing at least part of at least one of said terrain treatment arrays on said theme cells;

storing three-dimensional object data representative of objects and identified with said object coordinate data;

selectively processing said three-dimensional object data to generate objects on said theme cells at locations in accordance with said object coordinate data, wherein certain of said theme cells include internal boundaries, defined by a set of combination rules which utilize the geographic terrain characteristic themes indicated by said index identifiers to produce said real-time visual images on said display device.

34. The method of claim 33 wherein said step of selectively processing said three-dimensional object data includes the step of selectively processing in accordance with a range to a simulated scene.

35. The method of claim 33 further including the steps of:

storing geo-specific three-dimensional data; and

selectively processing said geo-specific three-dimensional data for a simulated terrain, when such data is available, instead of said terrain treatment arrays and said object data.