Safe driving support via automotive hub

• US 10,358,142 B2
• Filed: 03/16/2017
• Issued: 07/23/2019
• Est. Priority Date: 03/16/2017
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Joe, Gregory Hobert, James, Arthur, Miocinovic, Srdjan, Kundu, Sandipan
• Primary Examiner(s): Odeh, Nadeem
• Application Number:
  US15/461,468
• Publication Number:
  US 20180265095A1
• Time in Patent Office: 859 Days
• Field of Search: 701 36, 701 70
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/4845 Toxicology, e.g. by detection of alcohol, drug or toxic products A61B5/4848 takes precedence
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60K 28/06 responsive to incapacity of driver
• CPC Class Codes: B60K 28/063 preventing starting of vehicles
• CPC Class Codes: B60K 28/066 actuating a signalling device B60K28/063 takes precedence
• CPC Class Codes: B60W 10/04 including control of propulsion units
• CPC Class Codes: B60W 10/30 including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps
• CPC Class Codes: B60W 2040/0809 Driver authorisation; Driver identity check
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2040/0872 Driver physiology
• CPC Class Codes: B60W 2040/0881 Seat occupation; Driver or passenger presence
• CPC Class Codes: B60W 2040/089 Driver voice
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/01 Occupants other than the driver
• CPC Class Codes: B60W 2540/043 Identity of occupants
• CPC Class Codes: B60W 2540/21 Voice
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 2540/221 : Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2540/225 : Direction of gaze
• CPC Class Codes: B60W 2540/229 : Attention level, e.g. attentive to driving, reading or sleeping
• CPC Class Codes: B60W 2540/24 : Drug level, e.g. alcohol
• CPC Class Codes: B60W 2540/26 : Incapacity
• CPC Class Codes: B60W 2540/30 : Driving style
• CPC Class Codes: B60W 2555/20 : Ambient conditions, e.g. wind or rain
• CPC Class Codes: B60W 2556/10 : Historical data
• CPC Class Codes: B60W 2556/45 : External transmission of data to or from the vehicle
• CPC Class Codes: B60W 2556/55 : using telemetry
• CPC Class Codes: B60W 2556/65 : Data transmitted between vehicles
• CPC Class Codes: B60W 2710/06 : Combustion engines, Gas turbines
• CPC Class Codes: B60W 2710/30 : Auxiliary equipments
• CPC Class Codes: B60W 2720/10 : Longitudinal speed
• CPC Class Codes: B60W 40/04 : Traffic conditions
• CPC Class Codes: B60W 40/06 : Road conditions
• CPC Class Codes: B60W 40/08 : related to drivers or passengers
• CPC Class Codes: B60W 40/09 : Driving style or behaviour
• CPC Class Codes: B60W 50/0098 : Details of control systems ensuring comfort, safety or stability not otherwise provided for
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G01S 19/13 : Receivers
• CPC Class Codes: G06N 20/00 : Machine learning
• CPC Class Codes: H04L 67/12 : specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

A method for providing safe-driving support of a vehicle includes obtaining occupant data and vehicle data received at a vehicle hub. The occupant data is related to an identity and health status of an occupant and the vehicle data is related to a status of the vehicle. The method also includes obtaining action data based on an application of the occupant data and vehicle data to a machine learning safe-driving model. The machine learning safe-driving model is associated with a user profile of the occupant that is identified from among a plurality of user profiles based on the occupant data. A server maintains a plurality of user profiles, each having a respective machine learning safe-driving model. The action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle.

Claims

1. A method of providing safe-driving support of a vehicle, the method comprising:

transmitting to a safe-driving server occupant data and vehicle data received at a vehicle hub of the vehicle, where the occupant data is related to an identity and health status of an occupant of the vehicle, and wherein the vehicle data is related to a status of the vehicle;

receiving from the safe-driving server a machine learning safe-driving model associated with a user profile of the occupant, wherein the user profile is identified from among a plurality of user profiles based on the occupant data, and wherein the machine learning safe-driving model is one of a plurality of machine learning safe-driving models, each of the plurality of machine learning safe-driving models associated with a respective one of the plurality of user profiles maintained at the safe-driving server;

applying the occupant data and the vehicle data to]the machine learning safe-driving model associated with the user profile of the occupant to generate action data, wherein the action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle; and

performing the action based on the action data at the vehicle, wherein performing the action at the vehicle comprises at least one of;

implementing a parental control related to the occupant of the vehicle, limiting cellular data access of a mobile device located within the vehicle, disabling of text messaging by the mobile device, limiting multimedia content available by an infotainment system of the vehicle, deactivating an engine of the vehicle, limiting a speed of the vehicle, providing a route via a navigation system of the vehicle, or providing a safe-driving recommendation to a driver of the vehicle.

2. The method of claim 1, further comprising:

receiving the occupant data at the vehicle hub of the vehicle from at least one of an in-vehicle sensor or the mobile device located within the vehicle.

3. The method of claim 2, wherein the occupant data related to the identity of the occupant comprises at least one of:

an image of the occupant, a finger print of the occupant, data identifying the mobile device located within the vehicle, data indicating a position of a vehicle seat of the vehicle, data indicating a position of a steering wheel of the vehicle, or data indicating a current multimedia activity of the occupant.

4. The method of claim 2, wherein the occupant data related to the health status of the occupant comprises at least one of:

data related to the health status of the occupant received at the vehicle hub from the mobile device located within the vehicle, an image of the occupant, data received at the vehicle hub from a bio-sensor located within the vehicle, data indicating a blood alcohol content of the occupant, data indicating a blood pressure of the occupant, or data indicating a heart rate of the occupant.

5. The method of claim 1, further comprising receiving the vehicle data at the vehicle hub of the vehicle from one or more of:

an in-vehicle sensor, the mobile device located within the vehicle, a stationary monitor exterior to the vehicle, or another vehicle proximate to the vehicle.

6. The method of claim 5, wherein the vehicle data comprises at least one of:

data indicating a current location of the vehicle, data indicating a current time, data indicating a current date, data indicating a speed of the vehicle, or data indicating a current diagnostics of one or more vehicle domains of the vehicle, wherein the one or more vehicle domains comprises at least one of;

a chassis domain, a powertrain domain, a dashboard domain, or an interior domain.

7. The method of claim 1, wherein the occupant is a current driver of the vehicle.

8. The method of claim 1, wherein the occupant is a current passenger of the vehicle.

9. The method of claim 1, further comprising:

wirelessly transmitting the occupant data and the vehicle data from the vehicle hub to the safe-driving server; and

wirelessly receiving the machine learning safe-driving model associated with the user profile of the occupant at the vehicle hub from the safe-driving server.

10. The method of claim 1, further comprising:

updating the machine learning safe-driving model associated with the user profile of the occupant based on the occupant data and the vehicle data received at the vehicle hub of the vehicle.

11. The method of claim 1, further comprising:

updating the machine learning safe-driving model associated with the user profile of the occupant based on one or more of;

past occupant data of the occupant of the vehicle, past occupant data of other previous occupants of the vehicle, past occupant data of the occupant obtained when the occupant was located in another vehicle, or occupant data of other occupants of other vehicles.

12. A vehicle hub for providing safe-driving support of a vehicle, the vehicle comprising:

a processor; and

a memory coupled to the processor, wherein the processor and memory are configured to direct the vehicle hub to;

transmit to a safe-driving server occupant data and vehicle data received at the vehicle hub, where the occupant data is related to an identity and health status of an occupant of the vehicle, and wherein the vehicle data is related to a status of the vehicle;

receive from the safe-driving server a machine learning safe-driving model associated with a user profile of the occupant, wherein the user profile is identified from among a plurality of user profiles based on the occupant data, and wherein the machine learning safe-driving model is one of a plurality of machine learning safe-driving models, each of the plurality of machine learning safe-driving models associated with a respective one of the plurality of user profiles maintained at the safe-driving server;

apply the occupant data and the vehicle data to the machine learning safe-driving model associated with the user profile of the occupant to generate action data, wherein the action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle; and

perform the action at the vehicle in response to the action data, wherein performing the action at the vehicle comprises at least one of;

implementing a parental control related to the occupant of the vehicle, limiting cellular data access of a mobile device located within the vehicle, disabling of text messaging by the mobile device, limiting multimedia content available by an infotainment system of the vehicle, deactivating an engine of the vehicle, limiting a speed of the vehicle, providing a route via a navigation system of the vehicle, or providing a safe-driving recommendation to a driver of the vehicle.

13. The vehicle hub of claim 12, wherein the vehicle hub is configured to receive occupant data from at least one of an in-vehicle sensor or the mobile device located within the vehicle.

14. The vehicle hub of claim 12, wherein the processor and memory are further configured to direct the vehicle hub to:

wirelessly transmit the occupant data and the vehicle data from the vehicle hub to the safe-driving server; and

wirelessly receive the machine learning safe-driving model associated with the user profile of the occupant at the vehicle hub from the safe-driving server.

15. A server for providing safe-driving support of a vehicle, the server comprising:

a processor; and

a memory coupled to the processor, wherein the processor and memory are configured to direct the server to;

receive occupant data and vehicle data received at a vehicle hub of the vehicle, where the occupant data is related to an identity and health status of an occupant of the vehicle, and wherein the vehicle data is related to a status of the vehicle;

identify a user profile of the occupant from among a plurality of user profiles based on the occupant data;

apply the occupant data and the vehicle data to a machine learning safe-driving model to generate action data, wherein the machine learning safe-driving model is associated with the user profile of the occupant, wherein the machine learning safe-driving model is one of a plurality of machine learning safe-driving models, each of the plurality of machine learning safe-driving models associated with a respective one of the plurality of user profiles maintained at the server, and wherein the action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle; and

wirelessly transmit the action data to the vehicle hub to perform the action at the vehicle, wherein performing the action at the vehicle comprises at least one of;

implementing a parental control related to the occupant of the vehicle, limiting cellular data access of a mobile device located within the vehicle, disabling of text messaging by the mobile device, limiting multimedia content available by an infotainment system of the vehicle, deactivating an engine of the vehicle, limiting a speed of the vehicle, providing a route via a navigation system of the vehicle, or providing a safe-driving recommendation to a driver of the vehicle.

16. The server of claim 15, wherein the processor and memory are further configured to direct the server to:

update the machine learning safe-driving model associated with the user profile of the occupant based on the occupant data and the vehicle data.

17. The server of claim 15, wherein the processor and memory are further configured to direct the server to:

update the machine learning safe-driving model associated with the user profile of the occupant based on one or more of;

past occupant data of the occupant of the vehicle, past occupant data of other previous occupants of the vehicle, past occupant data of the occupant obtained when the occupant was located in another vehicle, or occupant data of other occupants of other vehicles.

18. The server of claim 15, wherein the processor and memory are further configured to direct the server to:

wirelessly transmit an updated machine learning safe-driving model associated with the user profile of the occupant to the vehicle hub.

19. An apparatus for providing safe-driving support of a vehicle, the apparatus comprising:

means for transmitting to a safe-driving server occupant data and vehicle data received at a vehicle hub of the vehicle, where the occupant data is related to an identity and health status of an occupant of the vehicle, and wherein the vehicle data is related to a status of the vehicle;

means for receiving from the safe-driving server a machine learning safe-driving model associated with a user profile of the occupant, wherein the user profile is identified from among a plurality of user profiles based on the occupant data, and wherein the machine learning safe-driving model is one of a plurality of machine learning safe-driving models, each of the plurality of machine learning safe-driving models associated with a respective one of the plurality of user profiles maintained at the safe-driving server;

means for applying of the occupant data and the vehicle data to the machine learning safe-driving model associated with the user profile of the occupant to generate action data, wherein the action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle; and

means for performing the action based on the action data at the vehicle, wherein performing the action at the vehicle comprises at least one of;

implementing a parental control related to the occupant of the vehicle, limiting cellular data access of a mobile device located within the vehicle, disabling of text messaging by the mobile device, limiting multimedia content available by an infotainment system of the vehicle, deactivating an engine of the vehicle, limiting a speed of the vehicle, providing a route via a navigation system of the vehicle, or providing a safe-driving recommendation to a driver of the vehicle.

20. The apparatus of claim 19, further comprising:

means for updating the machine learning safe-driving model associated with the user profile of the occupant based on the occupant data and the vehicle data received at the vehicle hub of the vehicle.

21. The apparatus of claim 19, further comprising:

means for updating the machine learning safe-driving model associated with the user profile of the occupant based on one or more of;

past occupant data of the occupant of the vehicle, past occupant data of other previous occupants of the vehicle, past occupant data of the occupant obtained when the occupant was located in another vehicle, or past occupant data of other occupants of other vehicles.

22. A non-transitory computer-readable storage medium including program code stored thereon for providing safe-driving support of a vehicle, the program code comprising instructions to:

transmit to a safe-driving server occupant data and vehicle data received at a vehicle hub of the vehicle, where the occupant data is related to an identity and health status of an occupant of the vehicle, and wherein the vehicle data is related to a status of the vehicle;

receive from the safe-driving server a machine learning safe-driving model associated with a user profile of the occupant, wherein the user profile is identified from among a plurality of user profiles based on the occupant data, and wherein the machine learning safe-driving model is one of a plurality of machine learning safe-driving models, each of the plurality of machine learning safe-driving models associated with a respective one of the plurality of user profiles maintained at the safe-driving server;

apply the occupant data and the vehicle data to the machine learning safe-driving model associated with the user profile of the occupant to generate action data, wherein the action data relates to an action to be performed by the vehicle while the occupant is located in the vehicle; and

perform the action based on the action data at the vehicle, wherein performing the action at the vehicle comprises at least one of;

implementing a parental control related to the occupant of the vehicle, limiting cellular data access of a mobile device located within the vehicle, disabling of text messaging by the mobile device, limiting multimedia content available by an infotainment system of the vehicle, deactivating an engine of the vehicle, limiting a speed of the vehicle, providing a route via a navigation system of the vehicle, or providing a safe-driving recommendation to a driver of the vehicle.

23. The non-transitory computer-readable storage medium of claim 22, wherein the program code further comprises instructions to:

update the machine learning safe-driving model associated with the user profile of the occupant based on the occupant data and the vehicle data received at the vehicle hub of the vehicle.

24. The non-transitory computer-readable storage medium of claim 22, wherein the program code further comprises instructions to:

update the machine learning safe-driving model associated with the user profile of the occupant based on one or more of;

past occupant data of the occupant of the vehicle, past occupant data of other previous occupants of the vehicle, past occupant data of the occupant obtained when the occupant was located in another vehicle, or occupant data of other occupants of other vehicles.