Facial analysis for vehicle entertainment system metrics

• US 9,852,355 B2
• Filed: 04/21/2015
• Issued: 12/26/2017
• Est. Priority Date: 04/21/2015
• Status: Active Grant

• Current Assignee: Thales Avionics Incorporated (Thales SA)
• Original Assignee: Thales Avionics Incorporated (Thales SA)
• Inventors: Couleaud, Jean-Yves, DeCuir, Tracy
• Primary Examiner(s): Chae, Kyu
• Application Number:
  US14/691,854
• Publication Number:
  US 20160316237A1
• Time in Patent Office: 980 Days
• Field of Search: 725 75- 77
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06V 10/141 Control of illumination
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/178 estimating age from face image; using age information for improving recognition
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 21/2146 located in mass transportation means, e.g. aircraft, train or bus flight-deck installations for entertainment or communications B64D11/0015; arrangements specially adapted for transportation systems in broadcast systems H04H20/62; moving wireless networks H04W84/005
• CPC Class Codes: H04N 21/25883 being end-user demographical data, e.g. age, family status or address arrangements for identifying locations of users in broadcast systems H04H60/52
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections

Abstract

A vehicle entertainment system includes a video display unit, a camera, a communication interface, and a processor. The video display unit provides content to a user. The camera outputs a camera signal containing data representing the user'"'"'s face. The communication interface communicate with a central content usage analysis computer. The processor processes the camera signal to identify facial features, compares the facial features to defined demographics rules, identifies user demographics based on the comparison of the facial features to the defined demographics rules, correlates the user demographics to a timeline of content consumed by the user through the video display unit to generate enhanced content usage metrics, and communicates the enhanced content usage metrics through the communication interface for delivery to the central content usage analysis computer.

Claims

1. A vehicle entertainment system comprising:

a plurality of video display units configured to be mounted to fixed surfaces within a vehicle, wherein each of the video display units comprises;

a display device configured to provide content to a user;

a camera configured to output a camera signal containing data representing the user'"'"'s face; and

a processor configured to process the camera signal to identify facial features, to compare the facial features to defined demographics rules, to identify user demographics based on the comparison of the facial features to the defined demographics rules, to correlate the user demographics to a timeline of content consumed by the user through the video display unit to generate enhanced content usage metrics, to process the camera signal to determine an eye viewing location on a display device of the video display unit, and to correlate the eye viewing location to the timeline of content consumed by the user through the video display unit to further generate the enhanced content usage metrics;

a communication interface configured to communicate with a central content usage analysis computer; and

a metrics computer within the vehicle, the metrics computer is communicatively connected to determine the departure city and/or flight duration, to receive the enhanced content usage metrics from the video display units, to combine the enhanced content usage metrics with the departure city and/or the flight duration to generate anonymized enhanced content usage metrics through numerical statistics that hide individual values of the received enhanced content usage metrics, and to communicate the anonymized enhanced content usage metrics from the vehicle through the communication interface for delivery to the central content usage analysis computer separately located from the vehicle.

2. The vehicle entertainment system of claim 1, wherein:

the processor is further configured to compare the facial features to defined attentiveness rules, to generate an attentiveness score based on the comparison of the facial features to the defined attentiveness rules, and to correlate the attentiveness score to the timeline of content consumed by the user through the video display unit to generate the enhanced content usage metrics.

3. The vehicle entertainment system of claim 1, wherein:

the processor is within a metrics computer connected to the content server, the processor is communicatively connected to the video display units to receive the camera signals, and for each of the video display units the processor processes the camera signal from the video display unit to identify facial features of the user, compares the facial features to defined demographics rules, identifies user demographics based on the comparison of the facial features to the defined demographics rules, correlates the user demographics to a timeline of content consumed by the user through the video display unit to generate the enhanced content usage metrics for the video display unit, combines the enhanced content usage metrics generated for the video display units to generate combined enhanced content usage metrics, and communicates the combined enhanced content usage metrics as the enhanced content usage metrics through the communication interface for delivery to the central content usage analysis computer.

4. The vehicle entertainment system of claim 1, wherein:

the processor is further configured to determine from the eye viewing location on the display device of the video display unit an elapsed time for how long the user looked at an advertisement displayed in a border area to a movie that is displayed through the video display unit and to further generate the enhanced content usage metrics to indicate the elapsed time correlated to the timeline of the movie.

5. The vehicle entertainment system of claim 1, wherein:

the processor is further configured to determine from the eye viewing location on the display device of the video display unit an elapsed time for how long the user looked away from a movie consumed through the video display unit and to further generate the enhanced content usage metrics to indicate the elapsed time correlated to the timeline of the movie.

6. The vehicle entertainment system of claim 1, wherein:

the processor is further configured to determine from the eye viewing location on the display device of the video display unit an elapsed time for how long the user looked at a defined item contained within a movie consumed through the video display unit and to further generate the enhanced content usage metrics to indicate the elapsed time correlated to the timeline of the movie.

7. The vehicle entertainment system of claim 1, wherein:

the processor is further configured to process the camera signal to determine the eye viewing location on the display device of the video display unit based on determining an angle of infrared light incident to the camera that is reflected from the user'"'"'s eyes which are illuminated by one or more infrared light emitters connected to the video display unit.

8. The vehicle entertainment system of claim 7, wherein:

the processor is further configured to control brightness of infrared light emitted by the one or more infrared light emitters responsive to sensing a level of ambient light.

9. The vehicle entertainment system of claim 8, wherein:

the processor is further configured to increase brightness of the infrared light emitted by the one or more infrared light emitters responsive to sensing a higher level of ambient light, and to decrease brightness of the infrared light emitted by the one or more infrared light emitters responsive to sensing a lower level of ambient light.

10. The vehicle entertainment system of claim 9, wherein:

the processor is further configured to increase brightness of the infrared light emitted by the one or more infrared light emitters responsive to sensing through the camera signal that the user'"'"'s face is brightly lit by sunlight.

11. The vehicle entertainment system of claim 1, wherein:

the processor is configured to estimate the user'"'"'s age based on the user demographics, and to control a size or layout of information that is displayed by the video display unit based on the user'"'"'s age that is estimated.

12. The vehicle entertainment system of claim 11, wherein:

the processor is configured to increase a minimum size of text or user selectable indicia that is displayed by the video display unit responsive to the user'"'"'s age that is estimated being greater than a defined threshold value.

13. The vehicle entertainment system of claim 1, wherein:

the processor is configured to identify when the user is exhibiting tiredness or inattentiveness toward content displayed by the video display unit based on the facial features that are identified, and respond to the identification of tiredness or inattentiveness by increasing a minimum size of text or indicia that is displayed by the video display unit.

14. The vehicle entertainment system of claim 1, wherein:

the processor is configured to identify when the user is exhibiting tiredness toward content displayed by the video display unit based on the facial features that are identified, and to control the video display unit to display more user selectable menu options for more advanced functionality of the video display unit responsive to when the processor does not identify tiredness, and to control the video display unit to display less of the user selectable menu options responsive to when the processor does identify tiredness.

15. The vehicle entertainment system of claim 1, wherein:

The processor is configured to determine from the camera signal a level of attentiveness being exhibited by the user, to compare the level of attentiveness to a threshold level of attentiveness, and to selectively include an expanded variety of the available content in the filtered list of available content depending upon an output of the comparison.