SYSTEM AND METHODS FOR ASSESSING THE INTERIOR OF AN AUTONOMOUS VEHICLE

• US 20180126960A1
• Filed: 11/04/2016
• Published: 05/10/2018
• Est. Priority Date: 11/04/2016
• Status: Active Grant

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Reibling, Michael E., Chraim, Ramzi Ahmad, Cyr, Steven Michael, Siciak, Ray C.
• Granted Patent: US 10,479,328 B2
• Time in Patent Office: Days
• CPC Class Codes: B60S 1/64 for cleaning vehicle interiors, e.g. built-in vacuum cleaners
• CPC Class Codes: B60S 3/008 for interiors of land vehicles
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2420/408 Radar; Laser, e.g. lidar
• CPC Class Codes: B60W 60/00253 Taxi operations
• CPC Class Codes: G06Q 10/20 Administration of product repair or maintenance
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083

Abstract

An autonomous vehicle includes interior sensors including a camera, IR camera, electro-chemical sensor, humidity sensor, and temperature sensor. Initial and final outputs of these sensors are captured for a trip conveying one or more passengers. If changes in the outputs of the sensors are detected, whether the final outputs of the sensors are acceptable may be evaluated. In some embodiments, an aggregation of the outputs is evaluated and found unacceptable even where individual outputs are acceptable. Outputs may be presented to a dispatcher to confirm that the outputs are unacceptable. If the outputs are found to be unacceptable, the vehicle may be autonomously driven to a cleaning station. Personal items may be identified in camera outputs and alerts generated in response.

Claims

1. A system for a vehicle comprising:

a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;

a controller coupled to the plurality of interior sensors and programmed to—

receive a first output for each sensor of the plurality of sensors;

receive a second output for each sensor of the plurality of sensors after receiving the first output for each sensor of the plurality of sensors;

for each sensor of the plurality of sensors—

evaluate a difference between the second output and the first output for the each sensor; and

if the difference between the second output and the first output for the each sensor meets a threshold condition corresponding to the each sensor, invoke cleaning of the interior;

calculate, for each sensor of the plurality of sensors, a change value that is a change between the first output and the second output for the each sensor;

calculate an aggregate change as one of a sum and a weighted sum of the change values for the plurality of sensors;

compare the aggregate change to an aggregate threshold condition; and

if the aggregate change between the first outputs and the second outputs exceeds the aggregate threshold condition, invoke cleaning of the interior.

5. The system of claim 1, wherein the plurality of sensors include a humidity sensor.

7. The system of claim 5, wherein the controller is further programmed to, if the change between the first and second outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions:

activate a ventilation system of the vehicle;

again measure outputs of the at least one of the electro-chemical sensor and humidity sensor; and

if the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

8. The system of claim 5, wherein the controller is programmed to determine if the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

9. The system of claim 1, wherein the controller is programmed to invoke cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

10. The system of claim 9, wherein the controller is programmed to, if an aggregate change between the second outputs and the first outputs does not meet a threshold condition, autonomously driving the vehicle to a pick up location without first autonomously driving the vehicle to any cleaning station.

2-4. -4. (canceled)

6. (canceled)

11. A method for evaluating a vehicle, the method comprising:

providing a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;

receiving, by a controller coupled to the plurality of interior sensors, first outputs from the plurality of interior sensors;

receiving, by the controller, second outputs from the plurality of sensors after a trip in the vehicle by a passenger subsequent to receiving the first outputs;

calculating, by the controller, for each sensor of the plurality of sensors, a change value that is a change between the first output and the second output for the each sensor;

calculating, by the controller, an aggregate change as a weighted sum of the change values for the plurality of sensors;

comparing the aggregate change to a threshold condition;

determining, by the controller, that the aggregate change exceeds the threshold condition;

in response to determining that the aggregate change between the second outputs and the first outputs exceeds the threshold condition invoking, by the controller, cleaning of the interior.

15. The method of claim 11, wherein the plurality of sensors include a humidity sensor.

16. The method of claim 15, wherein the threshold condition is a first threshold condition;

wherein the method further comprises;

receiving, by the controller, third outputs of the plurality of sensors;

receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;

determining, by the controller, that a change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets a corresponding threshold condition;

in response to determining that the change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets the corresponding threshold condition, invoking, by the controller, cleaning of the interior.

17. The method of claim 15, further comprising:

determining outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions;

in response to determining that outputs of at least one of the electro-chemical sensor and humidity sensor meets the corresponding threshold condition—

activating, by the controller, a ventilation system of the vehicle;

again measuring, by the controller, the outputs of the at least one of the electro-chemical sensor and humidity sensor; and

determining, by the controller, that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions; and

in response to determining that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

18. The method of claim 15, further comprising determining that the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

19. The method of claim 11, wherein invoking cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

20. The method of claim 19, further comprising:

receiving, by the controller, third outputs of the plurality of sensors;

receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;

determining, by the controller, that an aggregate change between the third outputs and the fourth outputs does not meet the threshold condition; and

in response to determining that the aggregate change between the third outputs and the fourth outputs does not meet the threshold condition, autonomously driving, by the controller, the vehicle to a pick up location without driving the vehicle to any cleaning station.

12-14. -14. (canceled)