System and method for assessing the interior of an autonomous vehicle
First Claim
1. A system for a vehicle comprising:
- an infrared (IR) camera sensing an interior of the vehicle;
a visible light camera operably coupled to the controller and having the interior of the vehicle in a field of view thereof;
a controller coupled to the IR camera and programmed to—
receive a first output of the IR camera;
receive a second output of the IR camera subsequent to the first output;
if a change between the first output and the second output indicates an anomaly, invoke a remedial action;
receive a third output of the visible light camera; and
if the change between the first output and the second output indicates the anomaly, (a) identify a region of interest (ROI) in the third output corresponding to the anomaly and (b) transmit the ROI to a dispatcher.
1 Assignment
0 Petitions
Accused Products
Abstract
An autonomous vehicle includes interior sensors including an IR camera and a visible light camera. Images of an interior of the vehicle are captured using the cameras both before and after a passenger rides in the vehicle. The IR images from before and after are subtracted to obtain a difference image. Pixels above a threshold intensity a clustered. Clusters having an above-threshold size are determined to be anomalies. Portions of images from the visible light camera corresponding to the anomalies are sent to a dispatcher, who may then clear the vehicle to pick up another passenger or proceed to a cleaning station. Anomalies may be identified based on a combination of the IR images and visible light images.
50 Citations
18 Claims
-
1. A system for a vehicle comprising:
-
an infrared (IR) camera sensing an interior of the vehicle; a visible light camera operably coupled to the controller and having the interior of the vehicle in a field of view thereof; a controller coupled to the IR camera and programmed to— receive a first output of the IR camera; receive a second output of the IR camera subsequent to the first output; if a change between the first output and the second output indicates an anomaly, invoke a remedial action; receive a third output of the visible light camera; and if the change between the first output and the second output indicates the anomaly, (a) identify a region of interest (ROI) in the third output corresponding to the anomaly and (b) transmit the ROI to a dispatcher. - View Dependent Claims (2, 3, 4)
-
-
5. A system for a vehicle comprising:
-
an infrared (IR) camera sensing an interior of the vehicle; a visible light camera operably coupled to the controller and having the interior of the vehicle in a field of view thereof; a controller coupled to the IR camera and programmed to— receive a first output of the IR camera; receive a second output of the IR camera subsequent to the first output; if a change between the first output and the second output indicates an anomaly, invoke a remedial action; wherein the controller is further programmed to capture the first output with the IR camera prior to pickup of a passenger and to capture the second output with the IR camera after drop-off of the passenger. - View Dependent Claims (6, 7, 8, 9)
-
-
10. A method comprising, by a controller of a vehicle:
-
receiving a first output of an IR camera having an interior of the vehicle in a field of view thereof; receiving a second output of the IR camera subsequent to the first output; determining that a change between the first output and the second output indicates an anomaly; in response to determining that the change between the first output and the second output indicates the anomaly, invoking a remedial action; receiving a third output from a visible light camera, a field of view of the visible light camera including the interior of the vehicle; and in response to determining that the change between the first output and the second output indicates the anomaly, (a) identifying a region of interest (ROI) in the third output corresponding to the anomaly and (b) transmitting the ROI to a dispatcher. - View Dependent Claims (11, 12, 13)
-
-
14. A method comprising, by a controller of a vehicle:
-
receiving a first output of an IR camera having an interior of the vehicle in a field of view thereof; receiving a second output of the IR camera subsequent to the first output; determining that a change between the first output and the second output indicates an anomaly; in response to determining that the change between the first output and the second output indicates the anomaly, invoking a remedial action; and capturing the first output with the IR camera prior to pickup of a passenger and to capturing the second output with the IR camera after drop-off of the passenger. - View Dependent Claims (15, 16, 17, 18)
-
Specification