Image processing system

• US 4,463,380 A
• Filed: 09/25/1981
• Issued: 07/31/1984
• Est. Priority Date: 09/25/1981
• Status: Expired due to Term

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Vought Corp.
• Inventors: Hooks, John T. Jr.
• Primary Examiner(s): BRITTON, HOWARD W
• Application Number:
  US06/305,741
• Time in Patent Office: 1,040 Days
• Field of Search: 358/104, 358/93, 358/160, 358/209, 358/903, 364/522, 382/44, 354/110
• US Class Current: 348/580
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: H04N 9/79 Processing of colour television signals in connection with recording

Abstract

An image processing system is disclosed wherein information corresponding to a selected geographical region or geometric system is stored and selectively retrieved and processed to reproduce images corresponding to selected portions of the geographical or geometric system. In a preferred embodiment, the information is initially recorded photographically and subsequently stored in a digital recording system. Processing, memory, and control systems are employed for producing video signals to be provided to video display units, for producing simulated real time images corresponding to the selected portion of the geographical or geometric system.

Claims

1. An image processing apparatus, comprising:

first means, for recording information corresponding to at least two views of a geometric system;

second means, for integrating the information corresponding to at least two views and producing a data segment corresponding to a single view of the geometric system containing the information corresponding to the at least two views; and

third means, for processing the data segment produced by the second means to provide information for simulating a third view of the geometric system.

2. The apparatus of claim 1, wherein the data segment produced by the second means corresponds to a single, integrated image devoid of mapping discontinuities between information derived from disparate views.

3. The apparatus of claim 1, wherein the first means comprises means for recording information corresponding to at least two views taken along first and second, mutually divergent axes, respectively, and wherein the third means comprises means for providing information corresponding to a third view of the geometric system, taken as on a third axis.

4. The apparatus of claim 3, wherein the third axis diverges from the first and second axes.

5. The apparatus of claim 1, wherein the second means comprises means for integrating information corresponding to a plurality of views of a geometric system into information corresponding to a single, continuous equivalent image corresponding to substantially semi-spherical field of view.

6. The apparatus of claim 1, wherein the geometric system comprises a geographical area, and wherein the first means comprises means for recording information corresponding to a plurality of scenes from mutually spaced eyepoints of the geographical area, each scene comprising at least two views taken along mutually diverging axes.

7. The apparatus of claim 5, wherein the second means comprises means for storing, in data format, information corresponding to substantially semi-spherical images in which the information corresponding to the respective, at least two views of each scene is integrated, and in which the third means comprises means for reproducing at least two views corresponding to respective, mutually adjacent image portions.

8. A data processing system, comprising:

first means for recording optical images, each image comprising a plurality of views of a portion of a geographical area taken on mutually diverging axes;

second means for converting the optical images into a reproducible data format in which the views of each optical image are integrated into a data format segment corresponding to a single, integrated, substantially semi-spherical image;

third means for retrieving and processing the data segments and for displaying at least two views corresponding to segments of the substantially semi-spherical images, derived from respective data format segments, but not necessarily corresponding to respective ones of the views of the geographical area to which the respective data segments correspond.

9. The apparatus of claim 8, wherein the first means comprises means for recording a plurality of optical images viewed from mutually spaced locations in the geographical area,

and wherein the third means comprises means for successively retrieving respective data segments corresponding to optical images viewed successively along an unprogrammed path through the geographical area.

10. The apparatus of claim 9, the third means further comprising means for processing the data segments for providing output signals for generating a simulated real time display corresponding to images which would be viewed along a path through the geographical area at locations intermediate those corresponding to the stored optical images.

11. The apparatus of claim 10, further comprising means for reproducing visual displays corresponding to segments of the images processed by the third means.

12. The apparatus of claim 11, wherein the optical display reproducing means comprises means reproducing images corresponding to views of the geographical area which would be seen from respective viewing angles intersecting the respective images from a vehicle moving on a path through the geographical area.

13. The apparatus of claim 9, further comprising control means actuated by an operator for providing command signals to the third means for causing the third means to retrieve and process data segments corresponding to images viewed sequentially along an unprogrammed, simulated trajectory, selected by the operator, through the geographical area.

14. The apparatus of claim 11, wherein the image reproducing means comprises means for reproducing images corresponding to views of the geographical area which would be seen from respective viewing locations differing from those from which the views were recorded.

15. Image processing means comprising:

a first means, for providing photographic representations of a geometric system from mutually spaced positions relative to the geometric system, each photographic representation having multiple, discrete segments corresponding to respective views of a portion of the geometric system taken as on respective, mutually diverging axes;

second means, including means for scanning the photographic representations, for converting the photographic views of each recorded scene into sequential electrical signals corresponding to respective portions of a substantially semi-spherical field of view;

third, processing means, for converting the electrical signals corresponding to each respective photographic representation into a data segment corresponding to a single, integrated image of the portion of the geometric system from which the photographic representation was derived.

16. The apparatus of claim 15, the integrated image having a portion of a substantially spherical field of view.

17. The apparatus of claim 15, the second means including a scanning spot generator and film transport means for positioning the photographic representations adjacent the scanning spot generator and for sequentially aligning each view of each respective photographic representation with the scanning spot generator.

18. The apparatus of claim 17, the second means further comprising light responsive sensor means and optical means for directioning trichromatic light transmitted by the scanning spot generator through respective view segments toward the first, second, and third light responsive sensor means, respectively.

19. The apparatus of claim 15, the third processing means comprising means for storing the data segments in digitally encoded form, the apparatus further comprising fourth means for sequentially retrieving the data segments, and converting the data segments into analog encoded form adapted for television playback.

20. The apparatus of claim 19, further comprising means for recording sequential data segments derived from the fourth means in a storage medium in a predetermined storage pattern.

21. The apparatus of claim 20, the recording means including multiple recording apparatus, and comprising means for storing information corresponding to respective portions of each integrated image on addressable locations of respective storage mediums in respective ones of the recording apparatus.

22. An image generation system comprising:

first means storing data segments corresponding to respective images of a geometric system, each image comprising an integration of data corresponding to multiple views, taken as on mutually diverging axes, of a respective portion of the geometric system;

second means for processing data segments stored in the first means into at least one data segment corresponding to another view of the respective potion of the geometric system.

23. The apparatus of claim 22, the second means comprising means for processing the data segments, stored in the first means, into at least two data segments corresponding to respective image segments.

24. The apparatus of claim 22, the first means comprising means for storing data segments corresponding to respective views of a geometric system taken as from a first location relative to the geometric system, the second means comprising means for processing the data segments stored in the first means into at least one data segment corresponding to a view of the respective portion of the geometric system taken as from a second location relative to the geometric system.

25. The apparatus of claim 24, the data segments recorded by the first means corresponding to respective pluralities of views taken as from mutually spaced locations within the geometric system.

26. The apparatus of claim 25, the second means comprising means for successively processing data segments corresponding to views taken as from mutually spaced locations for providing successive data segments in a format suitable for reproducing a display simulating movement through the geometric system.

27. The apparatus of claim 26, including control input means generating command signals to the second means for causing derivation of selected data segments corresponding to an unprogrammed path within the geometric system.

28. The apparatus of claim 27, wherein the control input means includes controls adapted to be actuated by an operator, the control means comprising means for generating command signals for derivation of sequential data segments corresponding to a path selected by the operator.

29. The apparatus of claim 28, wherein the geometric system comprises a geographical area, and wherein the control input means comprises a portion of a flight simulator system and includes control means corresponding to controls of a simulated vehicle.

30. An image generation system comprising:

first means for storing data segments corresponding to respective images of a geometric system, each image comprising an integration of data corresponding to a respective portion of the geometric system; and

second means for processing the data segments stored in the first means into at least two data segments corresponding to respective views of the geometric system taken as on diverging axes.

31. The apparatus of claim 30, further comprising means for displaying visual images corresponding to the respective data segments processed by the second means.

32. The apparatus of claim 31, wherein the visual images correspond to contiguous views of the geometric system.

33. The apparatus of claim 30, the second means including first scene storage means for storing data segments corresponding to respective images of the geometric system.

34. The apparatus of claim 33, the first storage means having first and second memory sections, the apparatus further comprising means for retrieving information from one of the memory sections for generating a data segment corresponding to an image of a first portion of the geometric system, and for simultaneously storing in the other memory section information corresponding to a second portion of the geometric system contiguous the first portion.

35. The apparatus of claim 34, further comprising a second scene storage means having respective memory sections corresponding to each display means, further comprising addressing means for withdrawing information from the memory sections of the second scene storage means at intervals shorter than the intervals of storage in the first storage means and in a format simulating movement within the respective portion of the geometric system to which the information stored in the first storage means corresponds.

36. A high speed video generator system for selectively generating subsegments of a scene for display on a video display device, said system comprising:

(a) first memory means for storing said scene.

(b) second and third memory means coupled to said first memory means for selectively receiving data corresponding to selected segments of said scene, said first and second memory means each comprising

(i) a plurality of random access memory devices interconnected to provide a memory array having a plurality of rows and columns of word positions in which digital information is stored relating to a corresponding point of the scene segment stored in the respective memory,

(ii) address generator means for sequentially addressing word positions of said memory array along any selected substantially straight line across said memory array corresponding to a substantially straight line path across the scene said address generator addressing selected ones of said memory means cyclically by memory means; and

(c) control means coupled to said first, second and third memory means, said control means including;

(i) means for selectively addressing subsegments of the scene segment stored in a selected one of said second or third memory means along a selected path across said scene segment for display by the video display system;

(ii) means for loading the other of said second or third memory means with a next scene segment from the first memory means when the selected subsegment of the scene segment comes within a first predetermined boundary of an extremity of the scene segment stored in the selected one of the second or third memory means; and

(iii) means for switching from the selected of the second or third memory means to the other of said second and third memory means when the selected subsegment comes within a second predetermined boundary of an extremity of the scene segment stored in the selected one of the second or third memory means.

37. The video generation system according to claim 36 including a viewer control device coupled to said control means for controlling the subscene displayed on said video display system.

38. The video generation system according to claim 36 wherein said control device includes an airplane control and whereas the subsegment of the scene being displayed is a simulation of the image viewed by a pilot flying an airplane.

39. The video generation system according to claim 36 including fourth memory means for storing bulk scene data related to relatively large scenes coupled to said first memory means for loading portions of said large scenes into said first memory means under control of said control means.

40. The video generation system according to claim 39 wherein said first memory means includes fifth and sixth memory means coupled to said fourth memory means for selectively receiving data corresponding to portions of a relatively large scene and wherein said control means includes

(i) means for selectively addressing segments of the scene stored in a selected one of said fifth or sixth memory as required to be loaded into a selected one of said second or third memory means,

(ii) means for switching from the selected of the fifth or sixth memory means when the selected segment of the scene being loaded into the second or third memory means comes within a fourth predetermined boundary of an extremity of the scene stored in the selected one of the fifth or sixth memory means;

and

(iii) means for switching from the selected of the fifth or sixth memory means when the selected segment of the scene being loaded into the second or third memory means comes within a fourth predetermined boundary of an extremity of the scene stored in the selected one of the fifth or sixth memory means.

41. The video generation system according to claim 40 wherein at least a portion of the scenes stored in said means are overlapping to provide smooth transitions between scenes.

42. The video generation system according to claim 36 wherein at least a portion of the scene segments stored in said second and third memory means are overlapping to provide smooth transition between scene segments.

43. A video generation system for selectively displaying subsegments of a scene on a video display device comprising:

(a) first memory means for storing data corresponding to relatively large scenes,

(b) second and third memory means coupled to said first memory means for selectively receiving data corresponding to selected portions and large scenes,

(c) fourth and fifth memory means coupled to said second and third memory means for selectively receiving segments of the portions of the scene stored inside third and fourth memory; and

(d) control means coupled to said first, second, third, fourth, and fifth memory means said control means including;

(i) means for selectively addressing subsegments of the scene segment stored in a selected one of said fourth and fifth memory means for display by the video displays,

(ii) means for loading the other of said fourth and fifth memory means with a next overlapping scene segment when the selected subsegment comes within a second predetermined boundary of an extremity of the scene segment stored in the selected one of the fifth and sixth memory means,

(iii) means for switching from the select of the fifth and sixth memory means to the other of said fifth and sixth memory means when the selected subsegment comes within a second predetermined boundary of an extremity of the scene segment stored in the selected one of the fifth and sixth memory means,

(iv) means for selectively addressing segments of the scene portion stored in a selected one of said second and third memory means as required for loading into the other of said fifth and sixth memory means.

(v) means for loading the other of said second and third memory means with a next scene portion from said first memory means when the selected segment of the scene comes within a third predetermined boundary of an extremity of the second and third memory means and,

(vi) means for switching from the selected of the second and third memory means when the selected segment of the scene being loaded into the other of the fourth and fifth memory means comes within a fourth predetermined boundary of an extremity of the scene segment stored in the selected one of the fourth and fifth memory means.

44. The video generating system according to claim 43 wherein said first memory means is a relatively slow bulk storage device, said second and third memory means comprise intermediate speed random access memories and said fourth and fifth memory means comprise relatively high speed random access memory means.

45. The video generation system according to claim 44 wherein said fourth and fifth memory means are line random unreleased digital memories.

46. The video display system according to claim 44 wherein said first memory means is comprised of:

(a) at least one laser disc player device and, (b) an analog to digital converter means.