Aircraft having gesture-based control for an onboard passenger service unit

• US 10,146,320 B2
• Filed: 11/16/2016
• Issued: 12/04/2018
• Est. Priority Date: 10/29/2007
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Schalla, James P., Robb, Calsee N., Harkness, William A., Sharpe, Buddy L., Kneller, Heidi J.
• Primary Examiner(s): Marc, McDieunel
• Application Number:
  US15/353,374
• Publication Number:
  US 20180136733A1
• Time in Patent Office: 748 Days
• Field of Search: 701 36
• CPC Class Codes: B64C 1/1476 Canopies; Windscreens or similar transparent elements
• CPC Class Codes: B64D 11/0015 Arrangements for entertainment or communications, e.g. radio, television
• CPC Class Codes: B64D 11/00151 Permanently mounted seat back monitors
• CPC Class Codes: B64D 11/00155 Individual entertainment or communication system remote controls therefor, located in or connected to seat components, e.g. to seat back or arm rest
• CPC Class Codes: B64D 13/00 Arrangements or adaptations of air-treatment apparatus for aircraft crew or passengers, or freight space , or structural parts of the aircraft treatment rooms with artificial climate for medical purposes A61G10/02; respiratory apparatus in general A62B; for vehicles in general B60H
• CPC Class Codes: B64D 2011/0053 Cabin passenger reading lights
• CPC Class Codes: B64D 2013/003 Cabin ventilation nozzles
• CPC Class Codes: B64D 47/02 Arrangements or adaptations of signal or lighting devices
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

An aircraft is provided that includes a passenger service unit for a passenger seated in a seat in its cabin. The aircraft includes a camera configured to acquire an image of the passenger, and a control module configured to at least receive the image of the passenger. The control module is configured to receive non-tactile gesture preference data and dominant hand data, and access a non-tactile gesture data store that includes a plurality of images of non-tactile hand signals or non-tactile hand gestures. Based on the foregoing, the control module is configured to generate non-tactile gesture data in accordance with and indicative of a non-tactile hand signal or a non-tactile gesture made by the passenger. And the control module is configured to control one or more cabin systems including in at least one instance the passenger service unit based on the non-tactile gesture data.

Claims

1. An aircraft comprising a fuselage including a cabin with a plurality of seats, and for a seat of the plurality of seats:

a passenger service unit including a reading light, an attendant call button, and an air vent for a passenger seated in the seat;

a camera configured to acquire an image of the passenger; and

a control module coupled to the passenger serviced unit and camera, and configured to at least;

receive the image of the passenger from the camera;

receive non-tactile gesture preference data and dominant hand data, input by the passenger or from an associated user profile of the passenger, the non-tactile gesture preference data representing a desired non-tactile hand signal or a desired non-tactile hand gesture, and the dominant hand data specifying a dominant hand of the passenger to monitor for the desired non-tactile hand signal or the desired non-tactile hand gesture, the dominant hand of the passenger being chosen by the passenger;

correlate the image of the passenger to the dominant hand of the passenger specified by the dominant hand data;

access a non-tactile gesture data store that includes a plurality of images of non-tactile hand signals or non-tactile hand gestures;

generate non-tactile gesture data in accordance with and indicative of the desired non-tactile hand signal or the desired non-tactile gesture made by the passenger, the non-tactile gesture data being generated based on the image of the passenger correlated to the dominant hand of the passenger specified by the dominant hand data, the non-tactile gesture preference data, and the plurality of images of non-tactile hand signals or non-tactile hand gestures; and

control one or more cabin systems including in at least one instance the reading light, attendant call button or air vent of the passenger service unit based on the non-tactile gesture data.

2. The aircraft of claim 1, wherein the control module being configured to generate the non-tactile gesture data includes being configured to generate the non-tactile gesture data based on a comparison between the image of the passenger and the plurality of images of non-tactile hand signals or non-tactile hand gestures.

3. The aircraft of claim 1, wherein the control module being configured to control the one or more cabin systems includes being configured to at least:

access a function data store that indicates functions associated with respective ones of the non-tactile hand signals or non-tactile hand gestures;

generate function data that identifies a function of the one or more cabin systems based on a comparison between the non-tactile gesture data and the functions indicated in the function data store, the reading light; and

control the one or more cabin systems including in the at least one instance the reading light, attendant call button or air vent based on the function data.

4. The aircraft of claim 3, wherein the control module being configured to access the function data store includes being configured to access the function data store that indicates functions including activation and deactivation of each of the reading light, the attendant call button and the air vent, each of which is associated with a respective one of the non-tactile hand signals or non-tactile hand gestures.

5. The aircraft of claim 1, wherein the fuselage further includes a plurality of windows, and the plurality of windows includes a window proximate the seat, and

wherein the control module being configured to control the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

6. The aircraft of claim 1 further comprising an in-flight entertainment system for passenger seated in the seat, and

wherein the control module being configured to control the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

7. The aircraft of claim 1, wherein the control module is further configured to input the associated user profile of the passenger from a portable device, and

wherein the control module being configured to receive the non-tactile gesture preference data and dominant hand data includes being configured to receive the non-tactile gesture preference data and dominant hand data from the associated user profile of the passenger.

8. An apparatus for control of one or more cabin systems onboard an aircraft with a fuselage including a cabin with a plurality of seats, and for a seat of the plurality of seats, a passenger service unit including a reading light, an attendant call button, and an air vent for a passenger seated in the seat, the apparatus comprising:

a processor and a memory storing one or more software or firmware programs that, in response to execution by the processor, cause the apparatus to at least;

receive an image of the passenger from a camera;

receive non-tactile gesture preference data and dominant hand data, input by the passenger or from an associated user profile of the passenger, the non-tactile gesture preference data representing a desired non-tactile hand signal or a desired non-tactile hand gesture, and the dominant hand data specifying a dominant hand of the passenger to monitor for the desired non-tactile hand signal or the desired non-tactile hand gesture, the dominant hand of the passenger being chosen by the passenger;

correlate the image of the passenger to the dominant hand of the passenger specified by the dominant hand data;

access a non-tactile gesture data store that includes a plurality of images of non-tactile hand signals or non-tactile hand gestures;

generate non-tactile gesture data in accordance with and indicative of the desired non-tactile hand signal or the desired non-tactile gesture made by the passenger, the non-tactile gesture data being generated based on the image of the passenger correlated to the dominant hand of the passenger specified by the dominant hand data, the non-tactile gesture preference data, and the plurality of images of non-tactile hand signals or non-tactile hand gestures; and

control one or more cabin systems including in at least one instance the reading light, attendant call button or air vent of the passenger service unit based on the non-tactile gesture data.

9. The apparatus of claim 8, wherein the apparatus being caused to generate the non-tactile gesture data includes being caused to generate the non-tactile gesture data based on a comparison between the image of the passenger and the plurality of images of non-tactile hand signals or non-tactile hand gestures.

10. The apparatus of claim 8, wherein the apparatus being caused to control the one or more cabin systems includes being caused to at least:

access a function data store that indicates functions associated with respective ones of the non-tactile hand signals or non-tactile hand gestures;

generate function data that identifies a function of the one or more cabin systems based on a comparison between the non-tactile gesture data and the functions indicated in the function data store, the reading light; and

control the one or more cabin systems including in the at least one instance the reading light, attendant call button or air vent based on the function data.

11. The apparatus of claim 10, wherein the apparatus being caused to access the function data store includes being caused to access the function data store that indicates functions including activation and deactivation of each of the reading light, the attendant call button and the air vent, each of which is associated with a respective one of the non-tactile hand signals or non-tactile hand gestures.

12. The apparatus of claim 8, wherein the fuselage further includes a plurality of windows, and the plurality of windows includes a window proximate the seat, and

wherein the apparatus being caused to control the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

13. The apparatus of claim 8, wherein the aircraft further includes an in-flight entertainment system for the passenger seated in the seat, and

wherein the apparatus being caused to control the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

14. The apparatus of claim 8, wherein the memory stores the one or more software or firmware programs that, in response to execution by the processor, cause the apparatus to further input the associated user profile of the passenger from a portable device, and

wherein the apparatus being caused to receive the non-tactile gesture preference data and dominant hand data includes being caused to receive the non-tactile gesture preference data and dominant hand data from the associated user profile of the passenger.

15. A method for control of one or more cabin systems onboard an aircraft with a fuselage including a cabin with a plurality of seats, and for a seat of the plurality of seats, a passenger service unit including a reading light, an attendant call button, and an air vent for a passenger seated in the seat, the method comprising:

acquiring an image of the passenger;

receiving non-tactile gesture preference data and dominant hand data, input by the passenger or from an associated user profile of the passenger, the non-tactile gesture preference data representing a desired non-tactile hand signal or a desired non-tactile hand gesture, and the dominant hand data specifying a dominant hand of the passenger to monitor for the desired non-tactile hand signal or the desired non-tactile hand gesture, the dominant hand of the passenger being chosen by the passenger;

correlating the image of the passenger to the dominant hand of the passenger specified by the dominant hand data;

accessing a non-tactile gesture data store that includes a plurality of images of non-tactile hand signals or non-tactile hand gestures;

generating non-tactile gesture data in accordance with and indicative of the desired non-tactile hand signal or the desired non-tactile gesture made by the passenger, the non-tactile gesture data being generated based on the image of the passenger correlated to the dominant hand of the passenger specified by the dominant hand data, the non-tactile gesture preference data, and the plurality of images of non-tactile hand signals or non-tactile hand gestures; and

controlling one or more cabin systems including in at least one instance the reading light, attendant call button or air vent of the passenger service unit based on the non-tactile gesture data.

16. The method of claim 15, wherein generating the non-tactile gesture data includes generating the non-tactile gesture data based on a comparison between the image of the passenger and the plurality of images of non-tactile hand signals or non-tactile hand gestures.

17. The method of claim 15, wherein controlling the one or more cabin systems includes at least:

accessing a function data store that indicates functions associated with respective ones of the non-tactile hand signals or non-tactile hand gestures;

generating function data that identifies a function of the one or more cabin systems based on a comparison between the non-tactile gesture data and the functions indicated in the function data store, the reading light; and

controlling the one or more cabin systems including in the at least one instance the reading light, attendant call button or air vent based on the function data.

18. The method of claim 17, wherein accessing the function data store includes accessing the function data store that indicates functions including activation and deactivation of each of the reading light, the attendant call button and the air vent, each of which is associated with a respective one of the non-tactile hand signals or non-tactile hand gestures.

19. The method of claim 15, wherein the fuselage further includes a plurality of windows, and the plurality of windows includes a window proximate the seat, and

wherein controlling the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

20. The method of claim 15, wherein the aircraft further includes an in-flight entertainment system for the passenger seated in the seat, and

wherein controlling the one or more cabin systems includes in at least one other instance a window shade of the window proximate the seat.

21. The method of claim 15 further comprising inputting the associated user profile of the passenger from a portable device,

wherein receiving the non-tactile gesture preference data and dominant hand data includes receiving the non-tactile gesture preference data and dominant hand data from the associated user profile of the passenger.