Lease observation and event recording

• US 10,249,104 B2
• Filed: 12/29/2016
• Issued: 04/02/2019
• Est. Priority Date: 12/06/2016
• Status: Active Grant

• Current Assignee: NIO Technology Company Limited (Shanghai Anbin Technology Co., Ltd.)
• Original Assignee: Nio Usa Inc.
• Inventors: Newman, Austin
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US15/394,158
• Publication Number:
  US 20180160057A1
• Time in Patent Office: 824 Days
• Field of Search: None
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06Q 30/0645 Rental transactions; Leasing transactions
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera

Abstract

A system and method for observing and reporting key vehicle events based upon information collected by a wide array of sensors already included in modern motor vehicles is provided. The system and method may be particularly valuable for electric vehicle applications.

Claims

1. An apparatus for observing and recording vehicle events, the apparatus, comprising:

one or more sensors;

one or more thermal imagers;

one or more high definition imagers, wherein the one or more thermal imagers and one or more high definition imagers are part of an advanced driver assistance system (ADAS) that continuously collects data about the vehicle and the environment surrounding the vehicle;

a real time communication interface;

a short range communication interface; and

a vehicle computer communicatively coupled to the one or more sensors, the one or more thermal imagers, the one or more high definition imagers, the real time communication interface, and the short range communication interface;

wherein the vehicle computer;

acquires a plurality of sensor data from the one or more sensors,

acquires a plurality of thermal images from the one or more thermal imagers,

acquires a plurality of high definition images from the one or more high definition imagers,

identifies one or more key vehicle events based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images,

generates a record based on data identified as the one or more key vehicle events,

stores the record, and

selectively transmits, via the real time communication interface, information based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images containing the one or more key vehicle events to a database server.

2. The apparatus according to claim 1, wherein the vehicle is an electric vehicle, wherein the key vehicle event is one or more of acceleration criteria, break usage, battery charge information, engine status, oil service status, tire wear and alignment, suspension details, tire pressure, and vehicle structure information, and wherein the one or more key vehicle events are determined from actions or events taken by the vehicle or applied to the vehicle.

3. The apparatus according to claim 1, wherein the real time communication interface selectively transmits the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images to a database server, based on the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images containing the one or more key vehicle events and wherein the database server identifies, from the one or more key vehicle events one or more of a life status of the vehicle, a necessary repair of the vehicle before or after transfer of ownership, a potential vehicle rating for leasing or purchasing of the vehicle, and a report regarding risky use and behavior of the vehicle.

4. The apparatus according to claim 2, wherein the key vehicle event is one or more of charging the vehicle at various charging levels, oil servicing and maintenance, engine status, tire wear and tread, suspension and structural information, and abusive conditions of the vehicle, wherein the vehicle computer is configured to selectively display an alert on a display communicatively coupled to the vehicle computer based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images containing the one or more key vehicle events, and wherein the one or more key vehicle events is an interaction between the vehicle and a pedestrian.

5. The apparatus according to claim 1, wherein the vehicle is an electric vehicle, wherein the vehicle is leased, wherein the one or more high definition imagers comprises a Forward Looking Infrared camera, wherein the key vehicle event is one or more of the vehicle hitting a large pothole, the vehicle being charged to 100% at a fast charge level, the vehicle driving at a top speed more or less frequently, and how hard a driver takes a turn in the vehicle, and wherein the database server:

receives the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images,

aggregates the received data and images by geolocation and time, and

analyzes the aggregated data to determine if a key vehicle event has been detected, wherein the database server, based on the analysis, one or more of validates a condition of a leased vehicle and determines and assigns a life criterion during inspection and review of the leased vehicle.

6. A method for observing and recording vehicle events, the method comprising:

acquiring, by a vehicle computer, a plurality of sensor data from one or more sensors;

acquiring, by a vehicle computer, a plurality of thermal images from one or more thermal imagers;

acquiring, by the vehicle computer, a plurality of high definition images from one or more high definition imagers, wherein the one or more thermal imagers and one or more high definition imagers are part of an advanced driver assistance system (ADAS) that continuously collects data about the vehicle and the environment surrounding the vehicle;

identifying one or more key vehicle events based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images,

generating a record based on data identified as one or more key vehicle events,

storing the record in a database, and

selectively transmitting, via a real time interface of the vehicle, computer information based on the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images containing the one or more key vehicle events to a database server.

7. The method according to claim 6, wherein the vehicle is an electric vehicle, wherein the key vehicle event is one or more of acceleration criteria, break usage, battery charge information, engine status, oil service status, tire wear and alignment, suspension details, tire pressure, and vehicle structure information, and wherein the one or more key vehicle events are determined from actions or events taken by the vehicle or applied to the vehicle.

8. The method according to claim 6, wherein the key vehicle event is one or more of charging the vehicle at various charging levels, oil servicing and maintenance, engine status, tire wear and tread, suspension and structural information, and abusive conditions of the vehicle and further comprising selectively displaying an alert on a display communicatively coupled to the vehicle computer based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images containing the one or more key vehicle events, wherein the one or more key vehicle events is an interaction between the vehicle and a pedestrian.

9. The method according to claim 7, wherein the real time communication interface is configured to selectively transmit the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images to a database server, based on the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images containing the one or more key vehicle events and wherein the database server identifies, from the one or more key vehicle events one or more of a life status of the vehicle, a necessary repair of the vehicle before or after transfer of ownership, a potential vehicle rating for leasing or purchasing of the vehicle, and a report regarding risky use and behavior of the vehicle.

10. The method according to claim 6, wherein the vehicle is an electric vehicle, wherein the vehicle is leased, wherein the one or more high definition imagers comprises a Forward Looking Infrared camera, wherein the key vehicle event is one or more of the vehicle hitting a large pothole, the vehicle being charged to 100% at a fast charge level, the vehicle driving at a top speed more or less frequently, and how hard a driver takes a turn in the vehicle, and further comprising:

receiving, by the database server, the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images,

aggregating the received data by geolocation and time, and

analyzing the aggregated data to determine if a key vehicle event has been detected, wherein the database server, based on the analysis, one or more of validates a condition of a leased vehicle and determines and assigns a life criterion during inspection and review of the leased vehicle.

11. A system for observing and recording vehicle events, the system comprising:

a vehicle, wherein the vehicle includes;

one or more sensors

one or more thermal imagers,

one or more high definition imagers,

a real time communication interface,

a short range communication interface, and

a vehicle computer communicatively coupled to the one or more sensors, the one or more thermal imagers, the one or more high definition imagers, the real time communication interface, and the short range communication interface; and

a database server communicatively coupled to the vehicle, wherein the database server includes;

a communication interface,

a memory,

storage, and

a processor communicatively coupled to the memory, the storage, and the communication interface;

wherein the processor of the database server;

receives, via the communication interface, a plurality of sensor data and plurality of images from the vehicle, wherein the plurality of images include images acquired by the one or more thermal imagers and the one or more high definition imagers,

aggregates the plurality of sensor data and images based on geolocation information and temporal information provided by the vehicle to form aggregated data, and

analyzes the aggregated data to determine if a key vehicle event has been detected.

12. The system according to claim 11, wherein the one or more thermal imagers and one or more high definition imagers are part of an advanced driver assistance system (ADAS) that continuously collects data about the vehicle and the environment surrounding the vehicle, wherein the vehicle is an electric vehicle, wherein the key vehicle event is one or more of acceleration criteria, break usage, battery charge information, engine status, oil service status, tire wear and alignment, suspension details, tire pressure, and vehicle structure information, and wherein the one or more key vehicle events are determined from actions or events taken by the vehicle or applied to the vehicle.

13. The system according to claim 12, wherein the processor of the database server is further configured to store the data containing one or more key vehicle events in a database and wherein the database server identifies, from the one or more key vehicle events one or more of a life status of the vehicle, a necessary repair of the vehicle before or after transfer of ownership, a potential vehicle rating for leasing or purchasing of the vehicle, and a report regarding risky use and behavior of the vehicle.

14. The system according to claim 11, wherein the vehicle is configured to:

acquire a plurality of sensor data from the one or more sensors,

acquire a plurality of thermal images from the one or more thermal imagers,

acquire a plurality of high definition images from the one or more high definition imagers,

identify one or more key vehicle events based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images,

generate a record based on data identified as the one or more key vehicle events,

store the record in a database, and

selectively transmit, via the real time communication interface, the database containing the record based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images containing the one or more key vehicle events to a database server and wherein the key vehicle event is one or more of charging the vehicle at various charging levels, oil servicing and maintenance, engine status, tire wear and tread, suspension and structural information, and abusive conditions of the vehicle.

15. The system according to claim 14, wherein the vehicle is an electric vehicle, wherein the vehicle is leased, wherein the one or more high definition imagers comprises a Forward Looking Infrared camera, wherein the key vehicle event is one or more of the vehicle hitting a large pothole, the vehicle being charged to 100% at a fast charge level, the vehicle driving at a top speed more or less frequently, and how hard a driver takes a turn in the vehicle, and wherein the real time communication interface is configured to selectively transmit the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images to a database server, based on the plurality of sensor data, the plurality of thermal images, and the plurality of high definition images containing the one or more key vehicle events.

16. The system according to claim 14, wherein the vehicle computer is configured to selectively display an alert on a display communicatively coupled to the vehicle computer based on the plurality of the sensor data, the plurality of the thermal images, and the plurality of the high definition images containing one or more key vehicle events and wherein the database server, based on the analysis, one or more of validates a condition of a leased vehicle and determines and assigns a life criterion during inspection and review of the leased vehicle.