Aircraft interior monitoring

• US 9,623,983 B2
• Filed: 05/12/2014
• Issued: 04/18/2017
• Est. Priority Date: 05/12/2014
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Kumar, Anil, Lui-Kwan, Gerald D.
• Primary Examiner(s): Backer, Firmin
• Assistant Examiner(s): MURPHY, JEROLD B
• Application Number:
  US14/275,356
• Publication Number:
  US 20150321768A1
• Time in Patent Office: 1,072 Days
• CPC Class Codes: B64D 45/00 Aircraft indicators or protectors not otherwise provided for camouflage F41H3/00
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19665 Details related to the storage of video surveillance data television signal recording H04N5/76
• CPC Class Codes: G08B 13/19673 Addition of time stamp, i.e. time metadata, to video stream
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

A system for monitoring an aircraft interior may include a multiplicity of sensors each placed at a selected location of a plurality of locations within the aircraft interior. Each sensor is configured to monitor a condition in an associated area of the aircraft interior. The system may also include a server onboard the aircraft. The onboard server is configured to receive data from each of the multiplicity of sensors and to control operation of each of the multiplicity of sensors. The system may also include a router onboard the aircraft. The onboard router is configured to communicate with a router off-board the aircraft and to transfer data from the onboard server to the off-board router. The off-board router is associated with a ground monitoring facility that is configured to analyze data from each of the multiplicity of sensors, check or compare the data to reference data and depending upon any levels being exceeded an appropriate alert may be generated.

Claims

1. A system for monitoring an aircraft interior, comprising:

a multiplicity of sensors each placed at a selected location of a plurality of locations within the aircraft interior, each sensor being configured to monitor a condition in an associated area of the aircraft interior;

a server onboard the aircraft, the onboard server being connected to the multiplicity of sensors and being configured to receive data from each of the multiplicity of sensors and to control operation of each of the multiplicity of sensors; and

a router onboard the aircraft, the onboard router being connected to the onboard server and the onboard router being configured to communicate with a router off-board the aircraft and to transfer data from the onboard server to the off-board router, wherein the off-board router is associated with a ground monitoring facility that is configured to analyze data from each of the multiplicity of sensors; and

an off-board database associated with the ground monitoring facility, wherein the data from the multiplicity of sensors is stored in the off-board database, the off-board database comprising a reference table configured to store the data from each of the multiplicity of sensors that is within limits and an exceedance table to store data from the multiplicity of sensors that exceeds a predetermined threshold, wherein the ground monitoring facility is configured to perform a method comprising;

comparing new data from each sensor to previously stored data for the sensor in the reference table;

storing the new data in the reference table in response to the data not exceeding the predetermined threshold;

storing the new data in the exceedance table in response to the new data exceeding the predetermined threshold;

acquiring additional samples of new data from a particular sensor in response to the new data from the particular sensor exceeding the predetermined threshold;

comparing each additional sample of new data from the particular sensor to previously stored data in the reference table;

comparing each additional sample of new data from the particular sensor to previously stored data in the exceedance table to confirm that an anomaly persists in response to a dissimilarity between each additional sample of new data and the previously stored data in the reference table; and

generating an alarm in response to the anomaly persisting and the additional samples of new data from the particular sensor exceeding the predetermined threshold for a preset number of samples of the additional samples of new data from the particular sensor or expiration of a preset time period.

2. The system of claim 1, wherein the multiplicity of sensors comprises a set of video cameras each placed to monitor a particular portion of a cargo area of the aircraft.

3. The system of claim 1, wherein the multiplicity of sensors comprises a set of video cameras, a set of audio sensors and set of temperature sensors, wherein data from the multiplicity of sensors is gathered in a compressed file that is divided into different areas of the aircraft interior by predefined sampling intervals.

4. The system of claim 1, further comprising an onboard database associated with the onboard server for storing data received from each of the multiplicity of sensors.

5. The system of claim 1, further comprising a data over power line interface associated with the onboard router for communication with the off-board router, wherein the onboard router is connectable to the off-board router by a power line that supplies power to the aircraft when the aircraft is parked at a gate at an airport.

6. The system of claim 1, further comprising a data over power line communications interface and a wireless communications interface associated with each of the onboard router and the off-board router for communications between the routers, wherein the onboard router is connectable to the off-board router by either a wired communications link via the data over power line communications interfaces or a wireless communications link via the wireless communications interfaces.

7. The system of claim 1, wherein the onboard server is configured to activate each sensor to monitor the condition in the associated area of the aircraft interior in response to a set of signals comprising a first signal indicating a weight on wheels configuration of the aircraft and a second signal indicating a parked configuration or zero velocity condition of the aircraft.

8. The system of claim 7, wherein the onboard server is configured to activate each sensor in a cargo area of the aircraft in response to the set of signals comprising the first signal, the second signal and a third signal indicating an opening of a door to the cargo area, the onboard server being configured to deactivate each sensor in the cargo area in response to a fourth signal indicating each door to the cargo area being closed.

9. The system of claim 1, wherein the off-board database stores the data from each sensor in association with an identification of the aircraft, the location of the sensor and a time stamp when the data was received by the onboard server.

10. The system of claim 1, further comprising an onboard database associated with the onboard server, wherein the onboard database is configured to store the data from the sensors in response to the onboard server being unable to establish a secure communications link with the ground monitoring facility, the data stored in the onboard database is transferred to the ground monitoring facility when the onboard server is able to establish the secure communication link with the ground monitoring facility and the data is deleted from the onboard database after being transferred to the ground monitoring facility.

11. The system claim 10, wherein the multiplicity of sensors comprises a set of video cameras, a set of audio sensors and a set of temperature sensors, the data from each sensor is stored with at least an associated time stamp when the data was received by the onboard server and a location of the sensor, and wherein an identification of the aircraft is associated with the data when transferred to the ground monitoring facility.

12. The system of claim 1, wherein the onboard server is further configured to establish network connectivity to the ground monitoring facility by performing a method comprising:

receiving, by the onboard server, an internet protocol (IP) address from an off-board server;

establishing the onboard server as an endpoint with an off-board communications network;

transmitting a request by the onboard server to establish a connection with the ground monitoring facility;

authenticating the onboard server with the ground monitoring facility; and

establishing a secure communications link for secure transfer of data between the onboard server and the ground monitoring facility.

13. The system of claim 1, further comprising:

an off-board server associated with the off-board database; and

an anomaly detection module operating on the off-board server, the anomaly detection module being configured to detect an anomaly in the data from the multiplicity of sensors and to generate a notification in response to the anomaly being detected.

14. The system of claim 1, further comprising a communications link coupled to the ground monitoring facility for receiving gate situational awareness data.

15. A system for monitoring an aircraft interior, comprising:

a ground monitoring facility configured to analyze data from a multiplicity of sensors each placed at a selected location of a plurality of locations within the aircraft interior, each sensor being configured to monitor a condition in an associated area of the aircraft interior; and

an off-board router associated with the ground monitoring facility, the off-board router being configured to communicate with a router onboard the aircraft, the onboard router being connected to an onboard server and the onboard router being configured to transfer data from the onboard server to the off-board router and the ground monitoring facility, wherein the onboard server is connected to the multiplicity of sensors and the onboard server is configured to receive data from each of the multiplicity of sensors and to control operation of each of the multiplicity of sensors; and

an off-board database associated with the ground monitoring facility, wherein the data from the multiplicity of sensors is stored in the off-board database, the off-board database comprising a reference table configured to store the data from each of the multiplicity of sensors that is within limits and an exceedance table to store data from the multiplicity of sensors that exceeds a predetermined threshold, wherein the ground monitoring facility is configured to perform a method comprising;

comparing new data from each sensor to previously stored data for the sensor in the reference table;

storing the new data in the reference table in response to the data not exceeding the predetermined threshold;

storing the new data in the exceedance table in response to the new data exceeding the predetermined threshold;

acquiring additional samples of new data from a particular sensor in response to the new data from the particular sensor exceeding the predetermined threshold;

comparing each additional sample of new data from the particular sensor to previously stored data in the reference table;

comparing each additional sample of new data from the particular sensor to previously stored data in the exceedance table to confirm that an anomaly persists in response to a dissimilarity between each additional sample of new data and the previously stored data in the reference table; and

generating an alarm in response to the anomaly persisting and the additional samples of new data from the particular sensor exceeding the predetermined threshold for a preset number of samples of the additional samples of new data from the particular sensor or expiration of a preset time period.

16. The system of claim 15, further comprising a data over power line communications interface and a wireless interface associated with each of the off-board router and the onboard router for communications between the routers, wherein the off-board router is connectable to the onboard router by either a wired communications link via the data over power line communications interfaces or a wireless communications link via the wireless interfaces.

17. The system of claim 15, further comprising an off-board database associated with the ground monitoring facility for storing the data from the multiplicity of sensors, the multiplicity of sensors comprising a set of video cameras.

18. The system of claim 17, wherein the off-board database stores the data from each sensor in association with an identification of the aircraft, the location of the sensor and a time stamp when the data was received by the onboard server.

19. The system of claim 18, wherein the ground monitoring facility comprises an anomaly detection module configured to detect anomalies in the data from the multiplicity of sensors and to generate an alarm in response an anomaly being detected, and wherein the off-board database comprises a reference table configured to store the data from each of the multiplicity of sensors that is within limits and an exceedance table to store data from the multiplicity of sensors that exceeds a predetermined threshold, the alarm being generated in response to the data from a particular sensor exceeding the predetermined threshold for a preset number of samples of the data from the particular sensor or expiration of a preset time period.

20. A method for monitoring an aircraft interior, comprising:

establishing, by an onboard server, communications with each of a multiplicity of sensors, each sensor being placed at a selected location of a plurality of locations within the aircraft interior and each sensor being configured to monitor a condition in an associated area of the aircraft interior;

establishing, by the onboard server, communications with a ground monitoring facility configured to analyze the data from each of the multiplicity of sensors to detect anomalies, wherein the onboard server is connected to an onboard router and the onboard router establishes direct communications with an off-board router, the off-board router being communicatively coupled to the ground monitoring facility;

storing the data from the multiplicity of sensors in an off-board database associated with the ground monitoring facility, wherein the off-board database comprises a reference table configured to store the data from each of the multiplicity of sensors that is within limits and an exceedance table to store data from the multiplicity of sensors that exceeds a predetermined threshold, wherein the ground monitoring facility is configured to perform a method comprising;

comparing new data from each sensor to previously stored data for the sensor in the reference table;

storing the new data in the reference table in response to the data not exceeding the predetermined threshold;

storing the new data in the exceedance table in response to the new data exceeding the predetermined threshold;

acquiring additional samples of new data from a particular sensor in response to the new data from the particular sensor exceeding the predetermined threshold;

first checking each additional sample of new data from the particular sensor to previously stored data in the reference table;

next checking each additional sample of new data from the particular sensor to previously stored data in the exceedance table in response to a dissimilarity between the additional sample of new data and the previously stored data in the reference table; and

generating an alarm in response to the additional samples of new data from the particular sensor exceeding the predetermined threshold for a preset number of samples of the additional samples of new data from the particular sensor.