Spatial systems including eye tracking capabilities and related methods

• US 9,788,118 B2
• Filed: 03/27/2015
• Issued: 10/10/2017
• Est. Priority Date: 03/27/2015
• Status: Active Grant

• Current Assignee: Thales Avionics Incorporated (Thales SA)
• Original Assignee: Thales Avionics Incorporated (Thales SA)
• Inventors: Bleacher, Brett, Mondragon, Christopher K.
• Primary Examiner(s): Jerez Lora, William A
• Application Number:
  US14/670,480
• Publication Number:
  US 20160286316A1
• Time in Patent Office: 928 Days
• Field of Search: 381300, 381301, 381302, 381304, 381305
• CPC Class Codes: B60R 11/0217 for loud-speakers
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04R 2499/13 Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 5/023 in a chair, pillow
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

Entertainment systems are provided including a plurality of spatial sound speakers embedded in a headrest of a passenger seat and associated with a media player of the entertainment system. A spatial sound controller associated with the plurality of spatial sound speakers of the media player is also provided. The spatial sound controller is configured to provide simulated surround sound associated with the media player to a defined target region. The plurality of spatial sound speakers are adjusted to a position of a passenger seated in the passenger seat based on external input associated with the passenger.

Claims

1. An entertainment system comprising:

a plurality of spatial sound speakers embedded in a headrest of a passenger seat and associated with a media player of the entertainment system; and

a spatial sound controller connected to receive signals from a media player of the entertainment system and configured to provide signals to the spatial sound speakers to direct simulated surround sound beams to a defined target region, the spatial sound controller is configured to control physical movement of the headrest containing the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to eye tracking input from an eye tracking system that tracks location of the passenger'"'"'s eyes.

2. The entertainment system of claim 1:

wherein the headrest including the plurality of spatial sound speakers comprises three portions, a center portion and two wing portions, wherein the spatial sound speakers are located in the two wing portions;

wherein each of the center portion and two wing portions are configured to move separately; and

wherein the spatial sound controller is configured to move a location of the defined target region by moving the two wing portions relative to the center portion of the headrest responsive to the eye tracking input from the eye tracking system.

3. The entertainment system of claim 2, wherein the headrest is configured to move at least one of up and down;

side to side; and

forward and backward to adjust to a position of a passenger seated in the passenger seat, and the spatial sound controller is configured to move the headrest responsive to the eye tracking input from the eye tracking system.

4. The entertainment system of claim 2, wherein the spatial sound controller is configured to move the two wing portions between a first position, remote from ears of the passenger, to a second position, closer to ears of the passenger responsive to the eye tracking input from the eye tracking system.

5. The entertainment system of claim 4, wherein the two wings are configured to adjust to a plurality of positions between the first position and the second position.

6. The entertainment system of claim 1, wherein the spatial sound controller is further configured to move the headrest including the plurality of spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to receiving an external voice input of the passenger.

7. The entertainment system of claim 1, wherein the headrest including the plurality of spatial sound speakers is configured to adjust responsive to an external manual input of the passenger.

8. The entertainment system of claim 1,

wherein the eye tracking system comprises at least one eye tracking camera,

wherein the eye tracking system is configured to obtain a location of a passenger'"'"'s eyes such that a position of the passenger'"'"'s ear is determined;

and

wherein a location of the defined target region is adjusted by the spatial sound controller responsive to the determination of the position of the passenger'"'"'s eyes so the ears are located within the defined target region.

9. The entertainment system of claim 8, wherein the entertainment system is further configured to fine tune the position of the headrest using one of audio input, manual input or a combination thereof.

10. The entertainment system of claim 1:

wherein the entertainment system further comprises a directional microphone;

wherein the entertainment system is further configured to obtain a location of a passenger'"'"'s ears by determining a direction of a voice using signals from the directional microphone;

wherein the entertainment system is further configured to calculate the location of the passenger'"'"'s ears based on the direction of the voice; and

wherein the spatial sound controller is further configured to control physical movement of the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to the calculated location of the passenger'"'"'s ears.

11. The entertainment system of claim 1:

wherein the entertainment system further comprises pressure sensors associated with the passenger seat; and

wherein the spatial sound controller is further configured to control physical movement of the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to information obtained from the pressure sensors.

12. The entertainment system of claim 1, wherein the entertainment system comprises an in-flight entertainment (IFE) system on an aircraft.

13. The entertainment system of claim 12, wherein the IFE system is designed to comply with all relevant government and airlines standards.

14. The entertainment system of claim 1, wherein the entertainment system is integrated with a vehicle.

15. The entertainment system of claim 14, wherein the vehicle comprises a train, a bus, a cruise ship and/or a military aircraft.

16. An in-flight entertainment (IFE) system for use on an aircraft, the IFE system comprising:

a media player integrated into the aircraft;

a plurality of spatial sound speakers embedded in a headrest of a passenger seat associated with the media player of the IFE system; and

a spatial sound controller connected to receive signals from the media player of the IFE system and configured to provide signals to the spatial sound speakers to direct simulated surround sound beams to a defined target region, the spatial sound controller is configured to control physical movement of the headrest containing the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to eye tracking input from an eye tracking system that tracks location of the passenger'"'"'s eyes.

17. The IFE system of claim 16:

wherein the headrest including the plurality of spatial sound speakers comprises three portions, a center portion and two wing portions, wherein the spatial sound speakers are located in the two wing portions;

wherein each of the center portion and two wing portions are configured to move separately; and

wherein the spatial sound controller is configured to move a location of the defined target region by moving the two wing portions relative to the center portion of the headrest responsive to the eye tracking input from the eye tracking system.

18. The IFE system of claim 17, wherein the headrest is configured to move at least one of up and down;

side to side; and

forward and backward to adjust to a position of a passenger seated in the passenger seat, and the spatial sound controller is configured to move the headrest responsive to the eye tracking input from the eye tracking system.

19. The IFE system of claim 17, wherein the spatial sound controller is configured to move the two wing portions between a first position, remote from ears of the passenger, to a second position, closer to ears of the passenger responsive to the eye tracking input from the eye tracking system.

20. The IFE system of claim 19, wherein the two wings are configured to adjust to a plurality of positions between the first position and the second position.

21. The IFE system of claim 16,

wherein the eye tracking system comprises at least one eye tracking camera,

wherein the eye tracking system is configured to obtain a location of a passenger'"'"'s eyes such that a position of the passenger'"'"'s ear is determined;

and

wherein a location of the defined target region is adjusted by the spatial sound controller responsive to the determination of the position of the passenger'"'"'s eyes so the ears are located within the defined target region.

22. The IFE system of claim 21, wherein the system is further configured to fine tune the position of the headrest using one of audio input, manual input or a combination thereof.

28. The method of claim 22,

wherein the eye tracking system comprises at least one eye tracking camera,

wherein the eye tracking system is configured to obtain a location of a passenger'"'"'s eyes such that a position of the passenger'"'"'s ear is determined;

and

wherein operating the spatial sound controller comprises operating the spatial sound controller to adjust a location of the defined target region responsive to the determination of the location of the passenger'"'"'s eyes so the ears are located within the defined target region.

29. The method of claim 28, further comprising fine tuning the position of the headrest using one of audio input, manual input or a combination thereof.

23. A method of providing sound from a media system, the method comprising:

operating a spatial sound controller connected to receive signals from a media player of the media system, to

provide signals to a plurality of spatial sound speakers embedded in a headrest of a passenger seat to direct simulated surround sound beams to a defined target region, and

control physical movement of the headrest containing the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to eye tracking input from an eye tracking system that tracks location of the passenger'"'"'s eyes.

24. The method of claim 23:

wherein the headrest including the at least spatial sound speakers comprises three portions, a center portion and two wing portions, wherein the spatial sound speakers are located in the two wing portions; and

wherein operating the spatial sound controller comprises operating the spatial sound controller to move a location of the defined target region by moving the two wing portions relative to the center portion of the headrest responsive to the eye tracking input from the eye tracking system.

25. The method of claim 24,

wherein the headrest is configured to move at least one of up and down;

side to side, and

wherein operating the spatial sound controller comprises operating the spatial sound controller to move the headrest responsive to the eye tracking input from the eye tracking system.

26. The method of claim 24, wherein operating the spatial sound controller comprises operating the spatial sound controller to move the two wing portions between a first position, remote from ears of the passenger, to a second position, closer to ears of the passenger responsive to the eye tracking input from the eye tracking system.

27. The method of claim 26, further comprising moving the two wings to one of a plurality of positions between the first position and the second position.

30. The method of claim 23, further comprising:

obtaining a location of a passenger'"'"'s ears by determining a direction of a voice using signals from a directional microphone; and

calculating the location of the passenger'"'"'s ears based on the direction of the voice; and

wherein operating the spatial sound controller comprises operating the spatial sound controller to control physical movement of the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to the calculated location of the passenger'"'"'s ears.

31. The method of claim 23,

wherein the media system further comprises pressure sensors associated with the passenger seat;

and

wherein operating the spatial sound controller comprises operating the spatial sound controller to control physical movement of the spatial sound speakers to move the defined target region relative to a passenger'"'"'s ears responsive to information obtained from the pressure sensors.