METHODS AND SYSTEMS FOR CORRELATING DATA SOURCES FOR VEHICLE DISPLAYS

• US 20100231418A1
• Filed: 03/10/2009
• Published: 09/16/2010
• Est. Priority Date: 03/10/2009
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: He, Gang, Feyereisen, Thea L., Whitlow, Stephen
• Granted Patent: US 8,264,379 B2
• Time in Patent Office: Days
• US Class Current: 340/945
• CPC Class Codes: G01C 23/00 Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
• CPC Class Codes: G01S 13/86 Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 2013/466 by Trilateration, i.e. two antennas or two sensors determine separately the distance to a target, whereby with the knowledge of the baseline length, i.e. the distance between the antennas or sensors, the position data of the target is determined
• CPC Class Codes: G01S 2013/468 by Triangulation, i.e. two antennas or two sensors determine separately the bearing, direction or angle to a target, whereby with the knowledge of the baseline length, the position data of the target is determined
• CPC Class Codes: G01S 5/0009 Transmission of position information to remote stations involving assistance data G01S5/0236
• CPC Class Codes: G01S 7/20 Stereoscopic displays; Three-dimensional displays; Pseudo-three-dimensional displays
• CPC Class Codes: G01S 7/411 Identification of targets based on measurements of radar reflectivity G01S7/415 takes precedence

Abstract

Systems and methods are provided for displaying information on a display device associated with an aircraft. A method comprises rendering a perspective view of terrain on a display device and obtaining sensor data for a sensing region overlapping at least a portion of the viewing region. The method further comprises obtaining tracking data associated with a first object located within the sensing region and correlating a first portion of the sensor data that corresponds to the first object with the tracking data. The method further comprises rendering a graphical representation of the first object on the display device, wherein positioning of the graphical representation of the first object with respect to the terrain is influenced by the correlation with first portion of the sensor data

Claims

1. A method for displaying information on a display device associated with a vehicle, the method comprising:

rendering a perspective view of terrain on the display device, the perspective view of terrain being based on a set of terrain data corresponding to a viewing region proximate the vehicle;

obtaining sensor data for a sensing region, the sensing region overlapping at least a portion of the viewing region;

obtaining tracking data associated with a first object located within the sensing region, the tracking data being based on a tracking signal associated with the first object;

correlating a first portion of the sensor data and the tracking data, the first portion of the sensor data corresponding to the first object; and

rendering a graphical representation of the first object on the display device, the graphical representation of the first object overlying the perspective view of terrain, wherein positioning of the graphical representation of the first object with respect to the terrain is influenced by the correlation with the first portion of the sensor data.

2. The method of claim 1, further comprising rendering a graphical representation of the sensor data for the sensing region on the display device, the graphical representation of the sensor data being rendered in conjunction with the perspective view of terrain.

3. The method of claim 2, wherein rendering the graphical representation of the first object comprises rendering the graphical representation of the first object overlying the graphical representation of the first portion of the sensor data.

4. The method of claim 2, wherein rendering the graphical representation of the first object comprises rendering the graphical representation of the first object using a symbology that accurately reflects physical characteristics of the first object.

5. The method of claim 2, wherein rendering the graphical representation of the first object comprises rendering the graphical representation of the first object such that it overlaps at least a portion of a graphical representation of the first portion of the sensor data.

6. The method of claim 2, wherein correlating the first portion of the sensor data and the tracking data further comprises:

determining positional data for the first object;

determining the first portion of the sensor data corresponds to the first object based on the positional data; and

associating the tracking data with the first portion of the sensor data.

7. The method of claim 6, further comprising:

obtaining updated sensor data for at least a portion of the viewing region;

determining a second portion of the updated sensor data corresponds to the first portion of the sensor data;

rendering a graphical representation of the updated sensor data on the display device, the graphical representation of the updated sensor data overlying the perspective view of terrain; and

rendering the graphical representation of the first object such that the graphical representation of the first object overlaps at least a portion of a graphical representation of the second portion of the updated sensor data.

8. The method of claim 6, further comprising:

receiving updated tracking data for the first object; and

determining updated positional data for the first object in response to the updated tracking data;

rendering the graphical representation of the first object at a position based on the updated positional data; and

rendering the graphical representation of the first portion of the sensor data such that the graphical representation of the first object overlaps at least a portion of the graphical representation of the first portion of the sensor data.

9. The method of claim 1, wherein rendering the graphical representation of the first object comprises rendering a three-dimensional perspective view of the first object in a conformal manner with respect to the terrain, such that the graphical representation of the first object accurately reflects physical characteristics of the first object.

10. A method for displaying information on a display device associated with an aircraft, the method comprising:

rendering a primary flight display on the display device, wherein the primary flight display comprises a synthetic perspective view of terrain for a viewing region proximate a current location of the aircraft, and wherein the synthetic perspective view of terrain corresponds to a flight deck viewpoint;

obtaining sensor data for a sensing region, the sensing region overlapping at least a portion of the viewing region;

rendering, in a portion of the primary flight display, a graphical representation of the sensing region in conjunction with the synthetic perspective view of terrain;

obtaining tracking data for a first object based on a tracking signal associated with the first object; and

in response to the tracking data;

identifying an object region within the sensing region based at least in part on the tracking data, the object region comprising sensor data indicative of the first object;

associating the tracking data and the object region; and

rendering, in a portion of the primary flight display, a first symbology representative of the first object, wherein the first symbology is positioned relative to the synthetic perspective view of the terrain based on the association with the object region, such that the first symbology overlaps at least a portion of the object region.

11. The method of claim 10, further comprising determining positional data for the first object, the positional data being based on the tracking signal, wherein identifying the object region comprises identifying the object region based on the positional data.

12. The method of claim 10, wherein associating the tracking data and the object region comprises fusing the first symbology with a graphical representation of the object region.

13. The method of claim 12, further comprising:

obtaining updated sensor data for the sensing region, wherein obtaining updated sensor data results in an updated sensing region;

rendering, in a portion of the primary flight display, a graphical representation of the updated sensing region overlying the synthetic perspective view of terrain; and

identifying a first region within the updated sensing region that corresponds to the object region, wherein fusing the first symbology and the graphical representation of the object region comprises;

rendering the first symbology such that the first symbology overlaps at least a portion of the first region of the updated sensing region.

14. The method of claim 12, further comprising obtaining updated tracking data for the first object, wherein fusing the first symbology and the graphical representation of the object region comprises:

rendering the graphical representation of the first symbology based on the updated tracking data; and

rendering the graphical representation of the object region such that the first symbology overlaps at least a portion of the object region.

15. The method of claim 10, wherein rendering the first symbology comprises rendering the first symbology in a conformal manner with respect to the terrain, the first symbology comprising a three-dimensional perspective view of the first object such that the first symbology accurately reflects physical characteristics of the first object.

16. The method of claim 10, wherein rendering the first symbology comprises rendering the first symbology using a visually distinguishable characteristic.

17. A display system for an aircraft, the display system comprising:

a display device;

an onboard sensor system configured to obtain sensor data for a first object located within a viewing region proximate the aircraft;

a communications system configured to obtain tracking data for the first object, the tracking data being based on a tracking signal associated with the first object;

a processing architecture coupled to the communications system and the onboard sensor system; and

a graphics system coupled to the processing architecture and the display device, wherein the graphics system and the processing architecture are cooperatively configured to;

render a primary flight display on the display device, wherein the primary flight display comprises a synthetic perspective view of terrain for the viewing region, and wherein the synthetic perspective view of terrain corresponds to a flight deck viewpoint;

render, in a portion of the primary flight display, a graphical representation of the sensor data for the first object; and

render, in a portion of the primary flight display, a first symbology overlying the synthetic perspective view of terrain, the first symbology being based on the tracking data such that the first symbology is representative of the first object, wherein the first symbology is positioned overlying the terrain in a manner that is influenced by the sensor data for the first object.

18. The display system of claim 17, wherein the processing architecture is configured to maintain an association between the tracking data and the sensor data for the first object.

19. The display system of claim 17, wherein:

the onboard sensor system is configured to obtain updated sensor data for at least a portion of the viewing region; and

in response to the updated sensor data, the processing architecture and the graphics system are cooperatively configured to;

render a graphical representation of the updated sensor data overlying the synthetic perspective view of terrain

determine a subset of the updated sensor data corresponds to the sensor data for the first object; and

render the first symbology such that it overlaps at least a portion of a graphical representation of the subset of the updated sensor data.

20. The display system of claim 17, wherein:

the communications system is configured to obtain updated tracking data for the first object; and

in response to the updated tracking data, the processing architecture and the graphics system are cooperatively configured to;

render the first symbology overlying the synthetic perspective view of terrain based on the updated tracking data; and

render a graphical representation of the sensor data for the first object overlying the synthetic perspective view of terrain such that the first symbology overlaps at least a portion of the graphical representation of the sensor data for the first object.