System and method of presenting altitude visibility information provision system utilizing satellite image, and system and method of recognizing flight obstacle

• US 7,046,824 B2
• Filed: 09/23/2002
• Issued: 05/16/2006
• Est. Priority Date: 10/26/2001
• Status: Expired due to Fees

• Current Assignee: Japan Aerospace Exploration Agency, Mitsubishi Space Software Company Limited (Mitsubishi Electric Corporation)
• Original Assignee: Japan Aerospace Exploration Agency, Mitsubishi Space Software Company Limited (Mitsubishi Electric Corporation)
• Inventors: Yamamoto, Hiromichi, Homma, Kohzo, Kitagata, Satoru
• Primary Examiner(s): Wu, Jingge
• Assistant Examiner(s): MACKOWEY, ANTHONY M
• Application Number:
  US10/251,806
• Publication Number:
  US 20030081812A1
• Time in Patent Office: 1,331 Days
• Field of Search: 382/103, 382/104, 382/108, 382/203, 340/945, 340/963, 348/113, 348/143, 348/144, 701/2, 701/3, 701/10, 701/14
• US Class Current: 382/103
• CPC Class Codes: G01C 23/00 Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
• CPC Class Codes: G01C 5/005 altimeters for aircraft G01C5/02, G01C5/06 take precedence

Abstract

A satellite image analysis and processing apparatus includes a DEM extraction unit for extracting digital elevation model information having topography data and steeple-shaped building data; a topography situation recognition unit for discriminating a kind of topography and recognizing a topographic situation from the topography data of the digital elevation model information; a steeple-shaped building recognition unit for recognizing shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information; a time series recognition unit for recognizing a change with time; and an altitude visibility information preservation unit for preserving altitude visibility information obtained by combining information acquired by the topography situation recognition unit, information acquired by the steeple-shaped building recognition unit, and information acquired by the time series recognition unit in an altitude visibility information database provided in the altitude visibility information preservation apparatus.

Claims

1. An altitude visibility information provision system comprising a satellite image analysis and processing apparatus and an altitude visibility information preservation apparatus, said satellite image analysis and processing apparatus comprising:

a DEM (digital elevation model) extraction unit operable to extract digital elevation model information having topography data and steeple-shaped building data from satellite image information of stereopairs differing in resolution obtained by picking up an image of ground surface and received from an observation satellite on an orbit around the earth via a communication line and high resolution satellite image information processed based on the satellite image information;

a topography situation recognition unit operable to discriminate a kind of topography and to recognize a topographic situation from the topography data of the digital elevation model information;

a steeple-shaped building recognition unit operable to recognize shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information;

a time series recognition unit operable to recognize a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of a same location currently received; and

an altitude visibility information preservation unit operable to preserve altitude visibility information obtained by combining information acquired by said topography situation recognition unit, information acquired by said steeple-shaped building recognition unit, and information acquired by said time series recognition unit in an altitude visibility information database provided in said altitude visibility information preservation apparatus,

wherein said steeple-shaped recognition unit includes a transmission line recognition unit, a steel tower structure recognition unit, and a tall building recognition unit,

wherein said transmission line recognition unit is operable to analyze the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a transmission line image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a transmission line image, a line shape of the transmission line is recognized and location information regarding the transmission line is extracted,

wherein said steel tower structure recognition unit is operable to analyze the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a steel tower structure image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a steel tower structure image, a shape of the steel tower structure is recognized and location information regarding the steel tower structure is extracted,

wherein said tall building recognition unit is operable to analyze the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a tall building image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a tall building image, a shape of the tall building is recognized and location information regarding the tall building is extracted,

wherein said time series recognition unit includes a change-with-time extraction unit, a topography chance recognition unit, a building recognition unit, a snow surface and desert recognition unit, and a volcanic smoke recognition unit,

wherein said change-with-time extraction unit is operable to extract differing altitude visibility information by comparing the altitude visibility information currently received and processed by said topography situation recognition unit and said steeple-shaped building recognition unit with altitude visibility information of the same location previously received and preserved by said altitude visibility information preservation unit,

wherein said change-with-time extraction unit is operable to deliver the extracted altitude visibility information to said topography change recognition unit, said building recognition unit. said snow surface and desertion recognition unit, and said volcanic smoke recognition unit,

wherein said topography change recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the topography is determined to be different as a result of the analysis by said topography change recognition unit, an undulation change recognition altitude map is extracted from the altitude visibility information by an undulation change recognition altitude map extraction unit,

wherein said building recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the buildings are determined to be different as a result of the analysis by said building recognition unit, a shape change recognition altitude map is extracted from the altitude visibility information by a shape change recognition altitude map extraction unit,

wherein said snow surface and desert recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the snow surface and desert are determined to be different as a result of the analysis by said snow surface and desert recognition unit, an undulation shape recognition altitude map is extracted from the altitude visibility information by an undulation shape recognition altitude map extraction unit, and

wherein said volcanic smoke recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the smoke is determined to be different as a result of the analysis by said volcanic smoke recognition unit, a smoke recognition altitude map is extracted from the altitude visibility information by a smoke recognition altitude map extraction unit.

3. A flight obstacle presentation apparatus mounted on an aircraft apparatus comprising:

a display operable to combine the altitude visibility information of said altitude visibility information provision system according to claim 1 with location information and altitude information of the aircraft, and to display altitude visibility information for flight obstacle recognition including an image taken from a viewpoint of a pilot and a location of the aircraft; and

a warning sound emission unit operable to emit a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on said display.

4. A flight obstacle recognition system comprising an altitude visibility information downloading apparatus for downloading, via a communication line, the altitude visibility information of said altitude visibility information provision system according to claim 1 to a flight obstacle presentation apparatus mounted on an aircraft apparatus, said flight obstacle presentation apparatus comprising:

a display operable to combine the altitude visibility information of said altitude visibility information provision system with location information and altitude information of the aircraft, and to display altitude visibility information for flight obstacle recognition such as a topographic map including an image taken from a viewpoint of a pilot and a location of the aircraft; and

a warning sound emission unit operable to emit a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on said display.

2. An altitude visibility information provision system comprising a satellite image analysis and processing apparatus and an altitude visibility information preservation apparatus, said satellite image analysis and processing apparatus comprising:

a DEM (digital elevation model) extraction unit operable to extract digital elevation model information having topography data and steeple-shaped building data from satellite image information of stereopairs differing in resolution obtained by picking up an image of ground surface and received from an observation satellite on an orbit around the earth via a communication line and high resolution satellite image information processed based on the satellite image information;

a topography situation recognition unit operable to discriminate a kind of topography and to recognize a topographic situation from the topography data of the digital elevation model information;

a steeple-shaped building recognition unit operable to recognize shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information;

a time series recognition unit operable to recognize a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of a same location currently received; and

an altitude visibility information preservation unit operable to preserve altitude visibility information obtained by combining information acquired by said topography situation recognition unit, information acquired by said steeple-shaped building recognition unit, and information acquired by said time series recognition unit in an altitude visibility information database provided in said altitude visibility information preservation apparatus,

wherein said time series recognition unit includes a change-with-time extraction unit, a topography change recognition unit, a building recognition unit, a snow surface and desert recognition unit, and a volcanic smoke recognition unit,

wherein said change-with-time extraction unit is operable to extract differing altitude visibility information by comparing the altitude visibility information currently received and processed by said topography situation recognition unit and said steeple-shaped building recognition unit with altitude visibility information of the same location previously received and preserved by said altitude visibility information preservation unit,

wherein said change-with-time extraction unit is operable to deliver the extracted altitude visibility information to said topography change recognition unit, said building recognition unit, said snow surface and desertion recognition unit, and said volcanic smoke recognition unit,

wherein said topography change recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the topography is determined to be different as a result of the analysis by said topography change recognition unit, an undulation change recognition altitude map is extracted from the altitude visibility information by an undulation change recognition altitude map extraction unit,

wherein said building recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the buildings are determined to be different as a result of the analysis by said building recognition unit, a shape change recognition altitude map is extracted from the altitude visibility information by a shape change recognition altitude map extraction unit,

wherein said snow surface and desert recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the snow surface and desert are determined to be different as a result of the analysis by said snow surface and desert recognition unit, an undulation shape recognition altitude map is extracted from the altitude visibility information by an undulation shape recognition altitude map extraction unit, and

wherein said volcanic smoke recognition unit is operable to analyze the altitude visibility information delivered by said change-with-time extraction unit, and wherein, if the smoke is determined to be different as a result of the analysis by said volcanic smoke recoanition unit, a smoke recognition altitude map is extracted from the altitude visibility information by a smoke recognition altitude map extraction unit.

9. A flight obstacle presentation apparatus mounted on an aircraft apparatus comprising:

a display operable to combine the altitude visibility information of said altitude visibility information provision system according to claim 2 with location information and altitude information of the aircraft, and to display altitude visibility information for flight obstacle recognition including an image taken from a viewpoint of a pilot and a location of the aircraft; and

a warning sound emission unit operable to emit a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on said display.

10. A flight obstacle recognition system comprising an altitude visibility information downloading apparatus for downloading, via a communication line, the altitude visibility information of said altitude visibility information provision system according to claim 2 to a flight obstacle presentation apparatus mounted on an aircraft apparatus, said flight obstacle presentation apparatus comprising:

a display unit operable to combine the altitude visibility information of said altitude visibility information provision system with location information and altitude information of the aircraft, and to display altitude visibility information for flight obstacle recognition including an image taken from a viewpoint of a pilot and a location of the aircraft; and

a warning sound emission unit operable to emit a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on said display.

5. A method for providing altitude visibility information comprising:

extracting digital elevation model information having topography data and steeple-shaped building data from satellite image information of stereopairs differing in resolution obtained by picking up an image of ground surface and received from an observation satellite on an orbit around the earth via a communication line and high resolution satellite image information processed based on the satellite image information;

discriminating a kind of topography and recognizing a topographic situation from the topography data of the digital elevation model information;

recognizing shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information;

recognizing a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of a same location currently received; and

preserving altitude visibility information obtained by combining information acquired at said topography situation recognizing step and information acquired at said steeple-shaped building recognizing step in an altitude visibility information database,

wherein said recognizing shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information comprises;

analyzing the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a transmission line image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a transmission line image, recognizing a line shape of the transmission line and extracting location information regarding the transmission line;

analyzing the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a steel tower structure image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a steel tower structure image, recognizing a shape of the steel tower structure and extracting location information regarding the steel tower structure;

analyzing the steeple-shaped building data in order to determine whether the steeple-shaped building data is information pertaining to a tall building image, and wherein, if it is determined that the steeple-shaped building data is information pertaining to a tall building image, recognizing a shape of the tall building and extracting location information regarding the tall building; and

wherein said recognizing a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of the same location currently received comprises;

extracting differing altitude visibility information by comparing the altitude visibility information currently received and processed with altitude visibility information of the same location previously received and preserved;

delivering the extracted altitude visibility information to a topography change recognition unit, a building recognition unit, a snow surface and desertion recognition unit, and a volcanic smoke recognition unit;

analyzing, by the topography change recognition unit, the delivered altitude visibility information, wherein, if the topography is determined to be different as a result of the analysis, extracting an undulation change recognition altitude map from the altitude visibility information;

analyzing, by the building recognition unit, the delivered altitude visibility information, wherein, if buildings are determined to be different as a result of the analysis, extracting a shape change recognition altitude map from the altitude visibility information;

analyzing, by the snow surface and desert recognition unit, the delivered altitude visibility information, wherein, if the snow surface and desert are determined to be different as a result of the analysis, extracting an undulation shape recognition altitude map from the altitude visibility information; and

analyzing, by the volcanic smoke recognition unit, the delivered altitude visibility information, wherein, if smoke is determined to be different as a result of the analysis, extracting a smoke recognition altitude map from the altitude visibility information.

7. A method for presenting flight obstacles in a flight obstacle presentation apparatus of an aircraft comprising:

combining the altitude visibility information of said altitude visibility information provision method according to claim 5 with location information and altitude information of the aircraft, and displaying altitude visibility information for flight obstacle recognition including an image taken from a viewpoint of a pilot and a location of the aircraft on a display of the flight obstacle presentation apparatus; and

emitting a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on the display of the flight obstacle presentation apparatus.

8. A flight obstacle recognition method comprising:

downloading, via a communication line, the altitude visibility information of said altitude visibility information provision method according to claim 5 to a flight obstacle presentation apparatus.

6. A method for providing altitude visibility information comprising:

extracting digital elevation model information having topography data and steeple-shaped building data from satellite image information of stereopairs differing in resolution obtained by picking up an image of ground surface and received from an observation satellite on an orbit around the earth via a communication line and high resolution satellite image information processed based on the satellite image information;

discriminating a kind of topography and recognizing a topographic situation from the topography data of the digital elevation model information;

recognizing shape and location information of steeple-shaped buildings from the steeple-shaped building data of the digital elevation model information;

recognizing a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of a same location currently received; and

preserving altitude visibility information obtained by combining information acquired at said topography situation recognizing step, information acquired at said steeple-shaped building recognizing step, and information acquired at said change with time recognizing step in an altitude visibility information database,

wherein said recognizing a change with time by comparing the high resolution satellite image information previously received with the high resolution satellite image information of the same location currently received comprises;

extracting differing altitude visibility information by comparing the altitude visibility information currently received and processed with altitude visibility information of the same location previously received and preserved;

delivering the extracted altitude visibility information to a topography change recognition unit, a building recognition unit, a snow surface and desertion recognition unit, and a volcanic smoke recognition unit;

analyzing, by the topography change recognition unit, the delivered altitude visibility information, wherein, if the topography is determined to be different as a result of the analysis, extracting an undulation change recognition altitude map from the altitude visibility information;

analyzing, by the building recognition unit, the delivered altitude visibility information, wherein, if buildings are determined to be different as a result of the analysis, extracting a shape change recognition altitude map from the altitude visibility information;

analyzing, by the snow surface and desert recognition unit, the delivered altitude visibility information, wherein, if the snow surface and desert are determined to be different as a result of the analysis, extracting an undulation shape recognition altitude map from the altitude visibility information; and

analyzing, by the volcanic smoke recognition unit, the delivered altitude visibility information, wherein, if smoke is determined to be different as a result of the analysis, extracting a smoke recognition altitude map from the altitude visibility information.

11. A method for presenting flight obstacles in a flight obstacle presentation apparatus of an aircraft comprising:

combining the altitude visibility information of said altitude visibility information provision method according to claim 6 with location information and altitude information of the aircraft, and displaying altitude visibility information for flight obstacle recognition such as a topographic map including an image taken from a viewpoint of a pilot and a location of the aircraft on a display of the flight obstacle presentation apparatus; and

emitting a warning sound when a flight obstacle is sensed and the flight obstacle is displayed on the display of the flight obstacle presentation apparatus.

12. A flight obstacle recognition method comprising:

downloading, via a communication line, the altitude visibility information of said altitude visibility information provision method according to claim 6 to a flight obstacle presentation apparatus.