Systems and methods for detecting potential surface collisions and providing warnings onboard an aircraft or airport vehicle

• US 10,410,530 B1
• Filed: 02/27/2018
• Issued: 09/10/2019
• Est. Priority Date: 02/27/2018
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Kant, Laxmi, Chandrashekarappa, Mohan Gowda, Sykam, Umasurya
• Primary Examiner(s): Zimmerman, Brian A
• Assistant Examiner(s): Samson, Sara B
• Application Number:
  US15/906,026
• Publication Number:
  US 20190266904A1
• Time in Patent Office: 560 Days
• Field of Search: None
• CPC Class Codes: G08G 5/0013 with a ground station
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/0026 located on the ground
• CPC Class Codes: G08G 5/04 Anti-collision systems
• CPC Class Codes: G08G 5/045 Navigation or guidance aids, e.g. determination of anti-collision manoeuvers radar or analogous systems specially adapted for anti-collision between aircraft G01S13/933
• CPC Class Codes: G08G 5/065 Navigation or guidance aids, e.g. for taxiing or rolling

Abstract

A method for providing surface collision warning data onboard a first airport vehicle comprising an aircraft or other airport vehicle configured for ground-based travel, by a processor communicatively coupled to a system memory element, is provided. The method aggregates, by the processor, three-dimensional (3D) spatial data associated with the first airport vehicle, an airport, and external airport vehicles located at the airport, to generate a set of aggregate data for the airport; determines a trajectory intent for each of the external airport vehicles; identifies potential surface collisions between the first airport vehicle and the external airport vehicles and between the first airport vehicle and the airport structures, based on the set of aggregate data for the airport, the trajectory intent for each of the external airport vehicles, and a trajectory associated with the first airport vehicle; and presents alerts associated with the potential surface collisions, via a display device communicatively coupled to the processor.

Claims

1. A method for providing surface collision warning data onboard a first airport vehicle comprising an aircraft or other airport vehicle configured for ground-based travel, by a processor communicatively coupled to a system memory element, the method comprising:

aggregating, by the processor, three-dimensional (3D) spatial data associated with the first airport vehicle, an airport, and external airport vehicles located at the airport, to generate a set of aggregate data for the airport;

determining a trajectory intent for each of the external airport vehicles;

identifying potential surface collisions between the first airport vehicle and the external airport vehicles and between the first airport vehicle and the airport structures, based on the set of aggregate data for the airport, the trajectory intent for each of the external airport vehicles, and a trajectory associated with the first airport vehicle; and

presenting alerts associated with the potential surface collisions, via a display device communicatively coupled to the processor.

2. The method of claim 1, further comprising:

pre-loading a standard aircraft mapping database (AMDB) and an aggregated loadable aircraft mapping database into the system memory element, by the processor, wherein the aggregated loadable aircraft mapping database comprises the 3D spatial data associated with the first airport vehicle, an airport, and external airport vehicles located at the airport; and

accessing the system memory element to obtain the 3D spatial data for aggregation.

3. The method of claim 1, further comprising:

establishing communication connections to one or more remote servers, via a communication device communicatively coupled to the processor; and

accessing the 3D spatial data associated with the first airport vehicle, the airport, and the external airport vehicles, via the communication connections, wherein the method aggregates the 3D spatial data stored by the one or more remote servers.

4. The method of claim 1, wherein the alerts comprise at least one of a visual cue, an auditory alert, or a text-based message.

5. The method of claim 1, wherein aggregating the 3D spatial data further comprises:

obtaining vehicle manufacturer specifications and equipment specifications for the first airport vehicle and the external airport vehicles;

deriving a first set of 3D volumetric models of the first airport vehicle and the external airport vehicles from the vehicle manufacturer specifications;

aggregating imagery from aircraft external sensors and airport sensors, to create a set of aggregate sensor data;

creating a second set of 3D volumetric models of airport vehicles and airport structures, based on the set of aggregate sensor data; and

creating an airport mapping database (AMDB) comprising the first set of 3D volumetric models and the second set of 3D volumetric models.

6. The method of claim 1, further comprising:

executing an Electronic Flight Bag (EFB) application, by the processor, wherein the processor is implemented as a personal computing device; and

performing operations to identify the surface collision warning data, via the EFB application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.

7. The method of claim 1, further comprising:

executing an airport moving map (AMM) application, by the processor, wherein the processor is implemented as an aircraft onboard avionics device; and

performing operations to identify the surface collision warning data, via the AMM application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.

8. A system for providing surface collision warning data onboard a first airport vehicle comprising an aircraft or other airport vehicle configured for ground-based travel, the system comprising:

a system memory element;

a display device, configured to present alerts onboard the first airport vehicle; and

at least one processor, communicatively coupled to the system memory element and the display device, the at least one processor configured to;

aggregate three-dimensional (3D) spatial data associated with the first airport vehicle, an airport, and external airport vehicles located at the airport, to generate a set of aggregate data for the airport;

determine a trajectory intent for each of the external airport vehicles;

identifying potential surface collisions between the first airport vehicle and the external airport vehicles and between the first airport vehicle and the airport structures, based on the set of aggregate data for the airport, the trajectory intent for each of the external airport vehicles, and a trajectory associated with the first airport vehicle; and

presenting alerts associated with the potential surface collisions, via the display device.

9. The system of claim 8, further comprising a communication device communicatively coupled to the at least one processor, the communication device configured to establish communication connections to one or more remote servers;

wherein the at least one processor is further configured to;

obtain the 3D spatial data associated with the first airport vehicle, the airport, and the external airport vehicles, via the communication device;

load the 3D spatial data into the system memory element onboard the first airport vehicle; and

aggregate the 3D spatial data stored by the system memory element.

10. The system of claim 8, further comprising a communication device communicatively coupled to the at least one processor, the communication device configured to establish communication connections to one or more remote servers;

wherein the at least one processor is further configured to;

establish communication connections to one or more remote servers, via the communication device;

access the 3D spatial data associated with the first airport vehicle, the airport, and the external airport vehicles, via the communication device; and

aggregate the 3D spatial data stored by the one or more remote servers.

11. The system of claim 8, wherein the alerts comprise at least one of a visual cue, an auditory alert, or a text-based message.

12. The system of claim 8, wherein the at least one processor is further configured to aggregate the 3D spatial data, by:

obtaining vehicle manufacturer specifications and equipment specifications for the first airport vehicle and the external airport vehicles;

deriving a first set of 3D volumetric models of the first airport vehicle and the external airport vehicles from the vehicle manufacturer specifications;

aggregating imagery from aircraft external sensors and airport sensors, to create a set of aggregate sensor data;

creating a second set of 3D volumetric models of airport vehicles and airport structures, based on the set of aggregate sensor data; and

creating an airport mapping database (AMDB) comprising the first set of 3D volumetric models and the second set of 3D volumetric models.

13. The system of claim 8, wherein the at least one processor is further configured to:

execute an Electronic Flight Bag (EFB) application, wherein the processor is implemented as a personal computing device; and

perform operations to identify the surface collision warning data, via the EFB application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.

14. The system of claim 8, wherein the at least one processor is further configured to:

execute an airport moving map (AMM) application, wherein the processor is implemented as an aircraft onboard avionics device;

perform operations to identify the surface collision warning data, via the AMM application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.

15. A non-transitory, computer-readable medium containing instructions thereon, which, when executed by a processor, perform a method for providing surface collision warning data onboard a first airport vehicle comprising an aircraft or other airport vehicle configured for ground-based travel, the method comprising:

aggregating, by the processor, three-dimensional (3D) spatial data associated with the first airport vehicle, an airport, and external airport vehicles located at the airport, to generate a set of aggregate data for the airport, wherein the 3D spatial data comprises at least vehicle 3D model specification data, surface movement radar (SMR) image and pattern processing data, camera thermal imaging data, and an airport mapping database, wherein the airport mapping database comprises a 3D spatial mapping of the airport including surface markings and airport structures comprising at least gates, terminals, aprons, hangars, and docking stations;

determining a trajectory intent for each of the external airport vehicles, wherein the external airport vehicles comprise at least a set of external aircraft, ground vehicles, stationary traffic, and moving traffic located at the airport;

identifying potential surface collisions between the first airport vehicle and the external airport vehicles and between the first airport vehicle and the airport structures, based on the set of aggregate data for the airport, the trajectory intent for each of the external airport vehicles, and a trajectory associated with the first airport vehicle; and

presenting alerts associated with the potential surface collisions, via a display device communicatively coupled to the processor.

16. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

establishing communication connections to one or more remote servers, via a communication device communicatively coupled to the processor;

obtaining the 3D spatial data associated with the first airport vehicle, the airport, and the external airport vehicles, via the communication connections; and

loading the 3D spatial data into the system memory element onboard the first airport vehicle, wherein the method aggregates the 3D spatial data stored by the system memory element.

17. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

establishing communication connections to one or more remote servers, via a communication device communicatively coupled to the processor; and

accessing the 3D spatial data associated with the first airport vehicle, the airport, and the external airport vehicles, via the communication connections, wherein the method aggregates the 3D spatial data stored by the one or more remote servers.

18. The non-transitory, computer-readable medium of claim 15, wherein the alerts comprise at least one of a visual cue, an auditory alert, or a text-based message.

19. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

executing an Electronic Flight Bag (EFB) application, by the processor, wherein the processor is implemented as a personal computing device; and

performing operations to identify the surface collision warning data, via the EFB application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.

20. The non-transitory, computer-readable medium of claim 15, wherein the method further comprises:

executing an airport moving map (AMM) application, by the processor, wherein the processor is implemented as an aircraft onboard avionics device; and

performing operations to identify the surface collision warning data, via the AMM application, wherein the operations comprise aggregating the 3D spatial data, determining the trajectory intent, identifying the trajectory conflicts, and presenting the alerts.