Method and system for integration of portable devices with flight deck displays

• US 9,980,298 B2
• Filed: 02/26/2016
• Issued: 05/22/2018
• Est. Priority Date: 02/26/2016
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Batsakes, Peter James, Stulken, David E., Burkhead, Paul
• Primary Examiner(s): Khatib, Rami
• Application Number:
  US15/054,788
• Publication Number:
  US 20170251501A1
• Time in Patent Office: 816 Days
• Field of Search: None
• CPC Class Codes: B64D 2045/0075 Adaptations for use of electronic flight bags in aircraft; Supports therefor in the cockpit
• CPC Class Codes: B64D 43/00 Arrangements or adaptations of instruments arrangements of cameras B64D47/08; aeronautical measuring instruments per se G01C
• CPC Class Codes: B64D 45/00 Aircraft indicators or protectors not otherwise provided for camouflage F41H3/00
• CPC Class Codes: G01C 23/00 Combined instruments indicating more than one navigational value, e.g. for aircraft; Combined measuring devices for measuring two or more variables of movement, e.g. distance, speed or acceleration
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/12 Avionics applications
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
• CPC Class Codes: H04W 76/40 for selective distribution or broadcast
• CPC Class Codes: H04W 76/50 for emergency connections

Abstract

A method for integration of a portable electronic device (PED) with a flight deck display in some embodiments includes providing an onboard network coupled to a flight-deck-installed, multi-function display and coupling the PED to the onboard network. The method may also include receiving information from a PED hosted application in the PED, routing information through a gateway and/or a plurality of firewalls, and displaying information on the flight-deck-installed, multi-function display. In some embodiments, a pilot control interface is coupled to the PED through the onboard network, and a plurality of functions on the PED is controlled via the pilot control interface. An airplane in some embodiments includes a fuselage portion, a wing portion, and a system that carries out the method, possibly through use of computer readable storage medium with stored instructions.

Claims

1. A method of accessing a portable electronic device (PED) on board an aircraft, the method comprising:

providing an onboard network coupled to a flight-deck-installed, multi-function display, wherein the flight-deck-installed, multi-function display is mounted in a flight deck panel of the aircraft;

coupling the PED to the onboard network;

receiving information from a PED hosted application in the PED;

performing a handshake between the PED and a gateway to establish a secure connection between the PED and onboard systems of the aircraft;

routing the information through the gateway;

displaying the information on the flight-deck-installed, multi-function display; and

coupling a pilot control interface to the PED through the onboard network, wherein the coupling of the pilot control interface to the PED comprises coupling a plurality of input and control devices to the PED, the plurality of input and control devices and the flight-deck-installed, multi-function display are usable by a plurality of users where each user can provide input and control their own PED and flight-deck-installed, multi-function display, where each user can provide input and exclusively control an application on another user'"'"'s PED on their flight-deck-installed, multi-function display, where each user can control separate PEDs independently, and where users can cooperatively control a single PED.

2. The method of claim 1 further comprising:

controlling a plurality of functions on the PED via the pilot control interface.

3. The method of claim 2 wherein the plurality of input and control devices includes:

a touchpad, a trackball, a rotary selection control or tabber, a single-touch touchscreen, a multi-touch touchscreen, a pressure sensitive touchscreen, a multi-function keypad, an MCDU scratchpad, a user eye tracking device, a voice activation/voice control device, a system automation input device, a remote control device, a control from a separate PED, or a combination thereof.

4. The method of claim 1 wherein the gateway is operable to provide a function comprising:

device authentication, bandwidth monitoring, device and network control, content analysis, enforcement of regulatory policies, enforcement of and configurability to airline policies, warning/alerting, operational status monitoring, failure handling, management of connected devices, application selection, intermediate formatting, compositing of application information, application authentication, filtering of devices and applications which can or cannot communicate with the onboard network, interfacing and data translation between disparate system components, relaying of aircraft information data and pilot interaction control data, enforcement of and compliance with flight deck human interface standards and guidelines, enforcement of airplane manufacturer policies and acceptability as per an established application governance process, integration of applications hosted on operationally approved PEDs with certified or operationally approved applications hosted within the onboard network, preparation of information from the PED for integration or layering within functional layered applications on a certified display application, or a combination thereof.

5. The method of claim 1, wherein for a function of video display, the PED utilizes the flight-deck-installed, multi-function display as a passive display terminal without any requirement for display or graphics generation/output hardware on the PED, or any native forms of input or interactivity on the PED and wherein the function of video display provides a service to directly connect an abstract application to the multi-function displays via the gateway for display and interaction on the flight-deck regardless of specifics, services, capabilities or operating system of the PED.

6. The method of claim 1, wherein applications hosted with flight-deck-installed, multi-function display comprise:

a window on the flight-deck-installed, multi-function display, a window managed across multiple flight-deck-installed, multi-function displays, multiple application on multiple devices, a diversity of pilot control interfaces including an ability to operate without the pilot control interfaces, an abstract nature of hosted applications including a non-video application, a compositing of certified and operationally approved information, a multiple user and shared/exclusive application environment application, device-based status information sent to a gateway including additional application categories, or a combination thereof.

7. An airplane comprising:

a fuselage portion;

a wing portion; and

a flight-deck-installed, multi-function display, wherein the flight-deck-installed, multi-function display is mounted in a flight deck panel of the airplane;

an onboard network comprising an aircraft data network and a flight deck crew network;

a gateway connected to the onboard network;

an aircraft interface device connected to the onboard network to couple a portable electronic device (PED) to the flight-deck-installed, multi-function display, the aircraft interface device operable to receive information from a PED hosted application in the PED and route the information through the gateway, wherein a handshake is performed between the PED and the gateway to establish a secure connection between the PED and onboard systems of the airplane, and wherein the aircraft data network is used by certified avionics for communication between certified components and the flight deck crew network is accessible by operationally approved, un-certified applications hosted on the PED wherein the gateway routes information between the aircraft data network and the flight deck crew network;

a plurality of firewalls to isolate the aircraft data network and the flight deck crew network; and

avionics to display the information on the flight-deck-installed, multi-function display.

8. The airplane of claim 7 wherein the flight deck crew network comprises a wired Ethernet interface.

9. The airplane of claim 7 wherein the flight deck crew network comprises a wireless interface.

10. The airplane of claim 7 further comprising a pilot control interface wherein the aircraft interface device is further operable to couple a pilot control interface to the PED through the onboard network to enable controlling a plurality of functions on the PED via the pilot control interface.

11. The airplane of claim 7 wherein the pilot control interface comprises a plurality of input and control devices including:

a touchpad, a trackball, a rotary selection control (“

tabber,”

) a single-touch touchscreen, a multi-touch touchscreen, a pressure sensitive touchscreen, a multi-function keypad, an MCDU scratchpad, a user eye tracking device, a voice activation/voice control device, a system automation input device, a remote control device, a control from a separate PED, or a combination thereof.

12. The airplane of claim 11 wherein the plurality of input and control devices and the flight-deck-installed, multi-function display are usable by a plurality of users where each user can provide input and control their own PED and flight-deck-installed, multi-function display,

where each user can provide input and exclusively control an application on another user'"'"'s PED on their flight-deck-installed, multi-function display, where each user can control separate PEDs independently, and where users can cooperatively control a single PED.

13. The airplane of claim 7 wherein the gateway is operable to provide a function comprising:

device authentication, bandwidth monitoring, device and network control, content analysis, enforcement of regulatory policies, enforcement of and configurability to airline policies, warning/alerting, operational status monitoring, failure handling, management of connected devices, application selection, intermediate formatting, compositing of application information, application authentication, filtering of devices and applications which can or cannot communicate with the onboard network, interfacing and data translation between disparate system components, relaying of aircraft information data and pilot interaction control data, enforcement of and compliance with flight deck human interface standards and guidelines, enforcement of airplane manufacturer policies and acceptability as per an established application governance process, integration of applications hosted on operationally approved PEDs with certified or operationally approved applications hosted within the onboard network, preparation of information from the PED for integration or layering within functional layered applications on a certified display application, or a combination thereof.

14. The airplane of claim 7, wherein for a function of video display, the PED utilizes the flight-deck-installed, multi-function display as a passive display terminal without any requirement for display or graphics generation/output hardware on the PED, or any native forms of input or interactivity on the PED and wherein the function of video display provides a service to directly connect an abstract application to the multi-function displays for display and interaction on the flight-deck, regardless of specifics, services, capabilities or operating system of the PED.

15. The airplane of claim 7, wherein applications displayed on flight-deck-installed, multi-function display comprise:

a window on the flight-deck-installed, multi-function display, a window managed across multiple flight-deck-installed, multi-function displays, multiple application on multiple devices, a diversity of pilot control interfaces including an ability to operate without the pilot control interfaces, an abstract nature of hosted applications including a non-video application, a compositing of certified and operationally approved information, a multiple user and shared/exclusive application environment application, device-based status information sent to the gateway including additional application categories, or a combination thereof.

16. A system comprising:

a flight-deck-installed, multi-function display mounted in a flight deck panel of an aircraft;

a flight deck crew network;

a gateway;

an aircraft interface device connected to the flight deck crew network to couple a portable electronic device (PED) to the flight-deck-installed, multi-function display, the aircraft interface device operable to receive information from a PED hosted application in the PED and route the information through the gateway, wherein a handshake is performed between the PED and the gateway to establish a secure connection between the PED and onboard systems of the aircraft;

an aircraft data network connected to the aircraft interface device; and

avionics connected to the aircraft data network and the flight-deck-installed, multi-function display to display the information on the flight-deck-installed, multi-function display; and

a pilot control interface wherein the pilot control interface and the flight-deck-installed, multi-function display are usable by a plurality of users where each user can provide input and control their own PED and flight-deck-installed, multi-function display, where each user can provide input and exclusively control an application on another user'"'"'s PED on their flight-deck-installed, multi-function display, where each user can control separate PEDs independently, and where users can cooperatively control a single PED.

17. The system of claim 16 wherein the aircraft interface device is further operable to couple the pilot control interface to the PED through the flight deck crew network and/or the aircraft data network to enable controlling a plurality of functions on the PED via the pilot control interface.

18. The airplane of claim 16 wherein the gateway is operable to provide a function comprising:

device authentication, bandwidth monitoring, device and network control, content analysis, enforcement of regulatory policies, enforcement of and configurability to airline policies, warning/alerting, operational status monitoring, failure handling, management of connected devices, application selection, intermediate formatting, compositing of application information, application authentication, filtering of devices and applications which can or cannot communicate with the system, interfacing and data translation between disparate system components, relaying of aircraft information data and pilot interaction control data, enforcement of and compliance with flight deck human interface standards and guidelines, enforcement of airplane manufacturer policies and acceptability as per an established application governance process, integration of applications hosted on operationally approved PEDs with certified or operationally approved applications hosted within the flight deck crew network, preparation of information from the PED for integration or layering within functional layered applications on a certified display application, or a combination thereof.

19. The system of claim 16, wherein for a function of video display, the PED utilizes the flight-deck-installed, multi-function display as a passive display terminal without any requirement for display or graphics generation/output hardware on the PED, or any native forms of input or interactivity on the PED and wherein the function of video display provides a service to directly connect an abstract application to the multi-function displays for display and interaction on the flight-deck, regardless of specifics, services, capabilities or operating system of the PED.

20. The system of claim 16, wherein the gateway comprises:

an application gateway connecting the aircraft interface device to the flight deck crew network; and

a security gateway connecting the avionics to the aircraft data network.

21. A non-transitory computer readable storage medium for accessing a portable electronic device (PED) comprising instructions stored thereon, that when executed on a processor, perform a method further comprising:

establishing an onboard network coupled to a flight-deck-installed, multi-function display, wherein the flight-deck-installed, multi-function display is mounted in a flight deck panel of the aircraft;

coupling the PED to the onboard network;

receiving information from a PED hosted application in the PED;

performing a handshake between the PED and a gateway to establish a secure connection between the PED and onboard systems of the aircraft;

routing the information through the gateway;

displaying the information on the flight-deck-installed, multi-function display; and

coupling a pilot control interface to the PED through the onboard network, wherein the coupling of the pilot control interface to the PED comprises coupling a plurality of input and control devices to the PED, the plurality of input and control devices and the flight-deck-installed, multi-function display are usable by a plurality of users where each user can provide input and control their own PED and flight-deck-installed, multi-function display, where each user can provide input and exclusively control an application on another user'"'"'s PED on their flight-deck-installed, multi-function display, where each user can control separate PEDs independently, and where users can cooperatively control a single PED.

22. The computer readable storage medium of claim 21 wherein the method further comprises:

controlling a plurality of functions on the PED via the pilot control interface.

23. The computer readable storage medium of claim 22 wherein the routing of the information through the gateway further comprises providing a function comprising:

device authentication, bandwidth monitoring, device and network control, content analysis, enforcement of regulatory policies, enforcement of and configurability to airline policies, warning/alerting, operational status monitoring, failure handling, management of connected devices, application selection, intermediate formatting, compositing of application information, application authentication, filtering of devices and applications which can or cannot communicate with the onboard network, interfacing and data translation between disparate system components, relaying of aircraft information data and pilot interaction control data, enforcement of and compliance with flight deck human interface standards and guidelines, enforcement of airplane manufacturer policies and acceptability as per an established application governance process, integration of applications hosted on operationally approved PEDs with certified or operationally approved applications hosted within the onboard network, preparation of information from the PED for integration or layering within functional layered applications on a certified display application, or a combination thereof.