Topographic measurement using stereoscopic picture frames

• US 7,508,972 B2
• Filed: 10/15/2007
• Issued: 03/24/2009
• Est. Priority Date: 06/20/2002
• Status: Expired due to Term

• Current Assignee: NEC Corporation
• Original Assignee: Nec Toshiba Space Systems, Ltd. (NEC Corporation)
• Inventors: Maruya, Makoto
• Primary Examiner(s): Chawan; Sheela C
• Application Number:
  US11/872,311
• Publication Number:
  US 20080050009A1
• Time in Patent Office: 526 Days
• Field of Search: 382/144, 382/154, 382/107, 382/100, 348/144, 348/42, 348/169, 348/143, 348/145, 370/465, 370/538, 370/385, 351/57, 351/158, 124/87, 345/440, 345/427, 345/428
• US Class Current: 382/144
• CPC Class Codes: G06T 7/55 from multiple images

Abstract

Disclosed is a topographic measurement system wherein at least one satellite is used to scan the earth surface and send picture frames of a target area captured at different positions to an earth station. The picture frames are combined to produce a number of pairs of frames which constitute a stereoscopic image of the target area. Each frame pair is analyzed according to a number of visual characteristics and evaluated with a set of fitness values representative of the degrees of fitness of the frame pair to topographic measurement of the target area. A total of the fitness values is obtained from each frame pair and compared with the total values of other frame pairs. A frame pair having the highest total value is selected as a best pair. A parallax between the best pair frames is determined to produce first and second sets of line-of-sight vectors for conversion to topographic data.

Claims

1. A topographic data processor comprising:

frame selecting means for selecting a pair of frames from a plurality of candidate picture frames of a target area captured from high-altitude positions, said selected pair of frames constituting a stereoscopic image of said target area;

scheduling means for selecting at least one airborne image sensor if an appropriate frame is not available in said plurality of candidate frames, sensing picture frames from the selected image sensor, whereby said frame selecting means uses the sensed frames to select a pair of frames;

means for determining a parallax between the frames selected by the frame selecting means and producing therefrom a first plurality of line-of-sight vectors and a second plurality of line-of-sight vectors; and

means for converting said first and second pluralities of line-of-sight vectors to topographic data,

a plurality of received picture frames being combined to form a plurality of pairs of sensed frames, each of said plurality of pairs of sensed frames constituting a stereoscopic image of said target area, each of said plurality of pairs of sensed frames being evaluated with a fitness value indicative of fitness of each of said pairs of sensed frames for topographic measurement of said target area, said selected pair of frames having a highest fitness value of said plurality of pairs of sensed frames.

2. A topographic data processor as claimed in claim 1, wherein said frame selecting means comprises:

means for combining the received picture frames to form said plurality of pairs of sensed frames;

evaluating means for evaluating each pair of sensed frames with said fitness value; and

scheduling means for producing a schedule for sensing picture frames from one or more airborne image sensor based on fitness values obtained from all said pairs of sensed frames.

3. A topographic data processor as claimed in claim 2, wherein said evaluating means comprises a geometric condition analyzer for analyzing said pairs of sensed frames in terms of their geometric condition and evaluating said pairs of frames with said fitness value which is inversely proportional to quantum errors between the frames of each said pair.

4. A topographic data processor as claimed in claim 3, wherein said evaluating means further comprises filtering condition analyzing means for analyzing each of said pairs of sensed frames in terms of filtering condition and evaluating each said pair of sensed frames with said fitness value which is representative of filtering characteristics of image sensors.

5. A topographic data processor as claimed in claim 3, wherein said evaluating means further comprises sunlight condition analyzing means for analyzing each of said pairs of sensed frames in terms of sunlight condition and evaluating each said pair of sensed frames with said fitness value which is representative of degree of similarity in shadow and shading effects between the frames of each said pair.

6. A topographic data processor as claimed in claim 3, wherein said evaluating means further comprises time difference analyzing means for analyzing each of said pairs of sensed frames in terms of time difference and evaluating each said pair of sensed frames with said fitness value which is inversely proportional to a time difference between the instant one of the frames of said each pair is captured and the instant the other frame is captured.

7. A topographic measurement system comprising:

at least one image sensor mounted on a vehicle flying over a target area;

means for sensing a plurality of picture frames at different positions by using said image sensor;

means for selecting a pair of frames from said plurality of picture frames, said pair of frames constituting a stereoscopic image of said target area;

means for determining a parallax between the selected pair of frames and producing therefrom a first plurality of line-of-sight vectors and a second plurality of line-of-sight vectors; and

means for converting said first and second pluralities of line-of-sight vectors to topographic data,

said plurality of picture frames being combined to form a plurality of pairs of frames, each of said plurality of pairs of frames constituting a stereoscopic image of said target area, each of said plurality of pairs of frames being evaluated with a fitness value indicative of fitness of each of said plurality of pairs of frames for topographic measurement of said target area, said selected pair of frames having a highest fitness value of said plurality of pairs of frames.

8. A topographic measurement system as claimed in claim 7, wherein said frame selecting means comprises:

frame combining means for combining said plurality of picture frames into said plurality of pairs of frames;

evaluating means for evaluating each of said plurality of pairs of frames with said fitness value; and

decision means for selecting one of said plurality of pairs of frames based on fitness values obtained from said plurality of pairs of frames.

9. A topographic measurement system as claimed in claim 8, wherein said evaluating means comprises:

a geometric condition analyzer for analyzing said plurality of pairs of frames in terms of their geometric condition and evaluating each of said plurality of pairs of frames with said fitness value proportional to their image resolution; and

decision making means for making a decision on the fitness values obtained from all of said plurality of pairs of frames and selecting one of said plurality of pairs of frames having said highest fitness value.

10. A topographic measurement system as claimed in claim 9, wherein said parallax determining means determines a parallax between the frames of said selected pair of frames, and

wherein said evaluating means further comprises frame matching analyzing means for analyzing said plurality of pairs of frames in terms of degree of match between each frame of each of the paired frames and evaluating each of said plurality of pairs of frames with said fitness value proportional to an average value of point-to-point correlations between each frame of said paired frames,

wherein said decision making means produces a total value of the fitness values of each of said plurality of pairs of frames and selects one of said plurality of pairs of frames having the highest total value.

11. A topographic measurement system as claimed in claim 8, wherein said parallax determining means comprises:

frame aligning means for aligning the frames of said selected pair of frames in orientation; and

correlation calculating means for calculating point-to-point correlations between the aligned frames.

12. A topographic measurement system as claimed in claim 10, wherein said parallax determining means comprises:

frame aligning means for aligning the frames of said selected pair of frames in orientation; and

correlation calculating means for calculating point-to-point correlation values between the aligned frames and supplying the calculated correlation values to said frame matching analyzing means, and

wherein the frame matching analyzing means calculates said average value of point-to-point correlations from the correlation values supplied from the correlation calculating means.

13. A topographic measurement system as claimed in claim 10, wherein said parallax determining means further comprises an interpolator for interpolating one of the selected pair of frames before said frames are aligned in orientation so that said frames of said selected pair have equal value of resolution.

14. A topographic measurement system as claimed in claim 8, wherein said evaluating means further comprises filtering condition analyzing means for analyzing each of said plurality of pairs of frames in terms of filtering condition and evaluating each of said plurality of pairs of frames with said fitness value which is representative of filtering characteristics of image sensors.

15. A topographic measurement system as claimed in claim 8, wherein said evaluating means further comprises sunlight condition analyzing means for analyzing each of said plurality of pairs of frames in terms of sunlight condition and evaluating each of said plurality of pairs of frames with said fitness value which is representative of degree of similarity in shadow and shading effects between the frames of each of said plurality of pairs of frames.

16. A topographic measurement system as claimed in claim 8, wherein said evaluating means further comprises time difference analyzing means for analyzing each of said plurality of pairs of frames in terms of time difference and evaluating each of said plurality of pairs of frames with said fitness value which is inversely proportional to a time difference between the instant one of the frames of each respective one of said plurality of pairs of frames is captured and the instant the other frame of said each respective one of said plurality of pairs of frames is captured.

17. A topographic measurement system as claimed in claim 8, further comprising a storage medium for storing a plurality of picture frames captured by airborne image sensors, wherein said selecting means selects said selected pair of frames from said storage medium.

18. A topographic measurement system as claimed in claim 17, wherein said frame combining means includes area selecting means for selecting frames covering said target area from all frames stored in said storage medium.

19. A topographic measurement system as claimed in claim 7, further comprising an image sensing scheduler comprising:

sensor selecting means for selecting at least one airborne image sensor if an appropriate pair of frames is not available to constitute said stereoscopic image of said target area from the image sensor;

frame combining means for combining the plurality of picture frames to form said plurality of pairs of frames;

evaluating means for evaluating each of said plurality of pairs of frames with said fitness value; and

scheduling means for producing a schedule for selecting one or more airborne sensors based on said fitness values obtained from all of said plurality of pairs of frames.

20. A topographic measurement system as claimed in claim 19, wherein said evaluating means of said scheduler comprises a geometric condition analyzer for analyzing said plurality of pairs of frames in terms of their geometric condition and evaluating each of said plurality of pairs of frames with said fitness value which is inversely proportional to quantum errors between the frames of each respective one of said plurality of pairs of frames.

21. A topographic measurement system as claimed in claim 20, wherein said evaluating means of the scheduler further comprises filtering condition analyzing means for analyzing each of said plurality of pairs of frames in terms of a filtering condition and evaluating each of said plurality of pairs of frames with said fitness value which is representative of filtering characteristics of image sensors.

22. A topographic measurement system as claimed in claim 20, wherein said evaluating means of the scheduler further comprises sunlight condition analyzing means for analyzing each of said plurality of pairs of frames in terms of sunlight condition and evaluating each of said plurality of pairs of frames with said fitness value which is representative of degree of similarity in shadow and shading effects between the frames of each respective one of said plurality of pairs of frames.

23. A topographic measurement system as claimed in claim 20, wherein said evaluating means of the scheduler further comprises time difference analyzing means for analyzing each of said plurality of pairs of frames in terms of time difference and evaluating each of said plurality of pairs of frames with said fitness value which is inversely proportional to a time difference between the instant one of the frames of each respective one of said plurality of pairs of frames is captured and the instant the other frame of said each respective one of said plurality of pairs of frames is captured.

24. A topographic measurement system comprising:

at least one image sensor mounted on a vehicle flying over a target area;

means for sensing a plurality of picture frames of said target area at different positions by using said image sensor;

frame selecting means for selecting a pair of frames from said plurality of picture frames of said target area, said selected pair of frames constituting a stereoscopic image of said target area;

scheduling means for selecting at least one image sensor if an appropriate pair of frames is not available in said plurality of picture frames, sensing picture frames from the selected image sensor, whereby said frame selecting means uses the sensed picture frames to select a pair of frames;

means for determining a parallax between the pair of frames selected by the frame selecting means and producing therefrom a first plurality of line-of-sight vectors and a second plurality of line-of-sight vectors; and

means for converting said first and second pluralities of line-of-sight vectors to topographic data,

said plurality of picture frames being combined to form a plurality of pairs of frames, each of said plurality of pairs of frames constituting a stereoscopic image of said target area, each of said plurality of pairs of frames being evaluated with a fitness value indicative of fitness of each of said plurality of pairs of frames for topographic measurement of said target area, said selected pair of frames having a highest fitness value of said plurality of pairs of frames.

25. A topographic measurement system as claimed in claim 24, wherein said scheduling means comprises:

frame combining means for combining said plurality of picture frames to form said plurality of pairs of frames;

evaluating means for evaluating each of said plurality of pairs of frames with said fitness value; and

decision means for producing a schedule for sensing picture frames from one or more airborne image sensors based on fitness values obtained from all of said plurality of pairs of frames.

26. A topographic measurement system as claimed in claim 25, wherein said evaluating means comprises a geometric condition analyzer for analyzing said plurality of pairs of frames in terms of their geometric condition and evaluating said plurality of pairs of frames with said fitness value which is inversely proportional to quantum errors between the frames of each respective one of said plurality of pairs of frames.

27. A topographic measurement system as claimed in claim 26, wherein said evaluating means further comprises filtering condition analyzing means for analyzing each of said plurality of pairs of frames in terms of filtering condition and evaluating each of said plurality of pairs of frames with a fitness value which is representative of filtering characteristics of image sensors.

28. A topographic measurement system as claimed in claim 26, wherein said evaluating means further comprises sunlight condition analyzing means for analyzing each of said plurality of pairs of frames in terms of sunlight condition and evaluating each of said plurality of pairs of frames with a fitness value which is representative of degree of similarity in shadow and shading effects between the frames of each respective one of said plurality of pairs of frames.

29. A topographic measurement system as claimed in claim 26, wherein said evaluating means further comprises time difference analyzing means for analyzing each of said plurality of pairs of frames in terms of time difference and evaluating each of said plurality of pairs of frames with a fitness value which is inversely proportional to a time difference between the instant one of the frames of each respective one of said plurality of pairs of frames is captured and the instant the other frame of said each respective one of said plurality of pairs of frames is captured.