Method and System for Providing Artificial Intelligence Analytic (AIA) Services for Performance Prediction

• US 20180182187A1
• Filed: 12/22/2017
• Published: 06/28/2018
• Est. Priority Date: 12/22/2016
• Status: Active Grant

• Current Assignee: Xevo, Inc. (Lear Corporation)
• Original Assignee: Surround.io Corporation (Lear Corporation)
• Inventors: Tong, Richard Chia Tsing, Welland, Robert Victor, Ludwig, John Hayes, Cordell, John Palmer, McKelvie, Samuel James
• Granted Patent: US 10,713,955 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 16/0231 Circuits relating to the driving or the functioning of the vehicle monitoring tyres B60C23/00; indicating overspeed B60K31/00; for dash boards B60K37/00, B60Q3/10; for indicating emergencies B60Q1/52; brake control systems B60T; registering or indicating the working of vehicles G07C5/00; measuring distance G01C, e.g. combinations of speed and distance G01C23/00; engine indicators G01L; measuring speed or acceleration G01P
• CPC Class Codes: B60Y 2400/3015 Optical cameras
• CPC Class Codes: G06F 18/25 Fusion techniques
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06Q 30/014 Providing recall services for goods or products
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06V 10/80 Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level multimodal speaker identification or verification G10L17/10
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/586 of parking space
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G07C 5/006 Indicating maintenance
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0808 Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G07C 5/0841 Registering performance data recording measured values G01D; information storage G11B
• CPC Class Codes: G07C 5/10 using counting means or digital clocks
• CPC Class Codes: G08G 1/143 inside the vehicles
• CPC Class Codes: G08G 1/168 : Driving aids for parking, e.g. acoustic or visual feedback on parking space
• CPC Class Codes: H04L 12/40 : Bus networks
• CPC Class Codes: H04L 2012/40215 : Controller Area Network CAN
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

One embodiment of the present invention predicts a vehicular event relating to machinal performance using information obtained from interior and exterior sensors, vehicle onboard computer (“VOC”), and cloud data. The process of predication is able to activate interior and exterior sensors mounted on a vehicle operated by a driver for obtaining current data relating to external surroundings, interior settings, and internal mechanical conditions of the vehicle. After forwarding the current data to VOC to generate a current vehicle status representing real-time vehicle performance in accordance with the current data, retrieving a historical data associated with the vehicle including mechanical condition is retrieved. In one aspect, a normal condition signal is issued when the current vehicle status does not satisfy with the optimal condition based on the historical data. Alternatively, a race car condition is issued when the current vehicle status meets with the optimal condition.

Claims

1. A method able to predict an event relating to vehicle performance in accordance with information obtained from a plurality of interior and exterior sensors, vehicle onboard computer (“

VOC”

), and cloud data, the method comprising;

activating at least a portion of a plurality of interior and exterior sensors mounted on a vehicle operated by a driver for obtaining current data relating to external surroundings, interior settings, and internal mechanical conditions of the vehicle;

forwarding the current data to the VOC to generate a current vehicle status representing substantially real-time vehicle performance in accordance with the current data;

retrieving a historical data associated with the vehicle including mechanical condition associated with the vehicle; and

issuing a normal condition signal when the current vehicle status does not satisfy with optimal condition based on the historical data.

2. The method of claim 1, further comprising;

uploading the current vehicle status to a vehicle performance predictor at least partially residing at a cloud via a communications network; and

obtaining big data from the cloud representing large car samples having similar attributes as the vehicle.

3. The method of claim 2, further comprising comparing the current vehicle status with the big data and the historical data to assess whether the vehicle operates in a normal condition.

4. The method of claim 3, further comprising issuing a race car condition when the current vehicle status meets with the optimal condition based on the historical data.

5. The method of claim 4, further comprising forwarding the current vehicle status to a subscriber for evaluating driver'"'"'s driving skill.

6. The method of claim 2, wherein obtaining big data from the cloud representing large car samples further includes accumulating information from cars with similar brands, similar mileages, similar years, similar geographic location, and similar drivers.

7. The method of claim 1, further comprising forwarding the current vehicle status to a subscriber for assessing normal wearing and tearing.

8. The method of claim 7, further comprising scheduling a maintenance appointment with the driver based on the current vehicle status.

9. The method of claim 7, further comprising initiating a manufacture recall for automobiles similar to the vehicle at least partially based on the current vehicle status.

10. The method of claim 1, further comprising updating the historical data in response to the current data.

11. The method of claim 1, wherein activating at least a portion of a plurality of interior and exterior sensors includes:

enabling a set of outward facing cameras mounted on the vehicle for recording external surrounding images representing a geographic environment in which the vehicle operates; and

initiating one or more inward facing cameras mounted in the vehicle for collecting interior images of the vehicle.

12. The method of claim 1, wherein activating at least a portion of a plurality of interior and exterior sensors includes activating a set of internal sensors attached to various mechanical components for measuring at least one of temperatures, functionalities, and audio sounds associated with mechanical components within the vehicle.

13. The method of claim 1, wherein activating at least a portion of the plurality of interior and exterior sensors includes detecting driver'"'"'s response time based on a set of identified road conditions and information from a controller area network (“

CAN”

) bus of the vehicle.

14. The method of claim 1, wherein activating at least a portion of the plurality of interior and exterior sensors includes recording real-time data relating to vehicle performance, road condition, traffic congestion, and weather condition.

15. A system capable of providing a vehicle performance prediction relating to an automobile operated by a driver, the system comprising:

a plurality of interior and exterior sensors mounted on a vehicle and internal mechanical components for obtaining information relating to external surroundings, interior environment, and components conditions;

a vehicle onboard computer (“

VOC”

) coupled to the plurality of interior and exterior sensors and configured to generate a current vehicle status representing current vehicle mechanical condition in accordance with the obtained information; and

a cloud network coupled to the VOC via a communications network and configured to include;

a normal condition module configured to determine a normal condition for the vehicle based on the current vehicle status, historical vehicle status, and big data which represents a large sample having similar attributes as the vehicle,

a prediction module coupled to the normal condition module and configured to predict vehicle failure in response to the normal condition.

16. The system of claim 15, further includes a race car module coupled to the normal condition module and configured to provide skills and mistakes associated with a race car driver operating the vehicle based on the current vehicle status, historical vehicle status, and big data which is a large set of accumulated samples having similar characteristics as the vehicle.

17. The system of claim 15, wherein the cloud network includes a subscription module for facilitating and enlisting subscribers.

18. The system of claim 15, wherein the plurality of interior and exterior sensors includes outward facing cameras mounted on a vehicle collecting external images representing a surrounding environment in which the vehicle operates and inward facing cameras mounted inside of the vehicle collecting interior images including operator facial expression and operator'"'"'s attention.

19. A method able to accumulate information relating to machinal performance and drivers in accordance with information obtained from a plurality of interior and exterior sensors, vehicle onboard computer (“

VOC”

), and cloud network, the method comprising;

activating a plurality of interior and exterior sensors mounted inside and outside of a vehicle operated by a driver for collecting real-time information relating to external surroundings, interior settings, and internal mechanical conditions of the vehicle;

forwarding the real-time information to the VOC to generate a current vehicle status representing substantial real-time vehicle performance in accordance with the real-time information;

uploading the current vehicle status to the cloud network and retrieving a historical data associated with the vehicle including performance data; and

generating a vehicle performance report in response to the historical data and big data containing relatively large samples having similar attributes as the vehicle.

20. The method of claim 19, further comprising scheduling a maintenance appointment by a subscriber repair shop with the driver based on the vehicle performance report.

21. The method of claim 19, further comprising forwarding the vehicle performance report to a subscribed automobile manufacture for vehicle recalls.

22. The method of claim 19, further comprising sending the vehicle performance report to a subscriber owner of the vehicle indicating current mechanical condition of the vehicle.