Teleassistance data prioritization for self-driving vehicles
First Claim
Patent Images
1. A self-driving vehicle (SDV) comprising:
- a communication interface;
a sensor system comprising one or more LIDAR sensors generating LIDAR data and one or more cameras generating image data, the LIDAR data and image data providing a live sensor view of a situational environment of the SDV;
acceleration, braking, and steering systems; and
a control system to execute instructions that cause the control system to;
analyze the live sensor view in accordance with a safety threshold to (i) detect objects of interest along a current route, (ii) classify each of the detected objects of interest in accordance with a certainty threshold, and (iii) autonomously operate the acceleration, braking, and steering systems along the current route;
when the safety threshold is not met, transmit a first teleassistance inquiry to a backend transport system, the first teleassistance inquiry comprising LIDAR data;
when the certainty threshold for an indeterminate object is not met, transmit a second teleassistance inquiry to the backend transport system, the second teleassistance inquiry comprising image data that includes the indeterminate object;
for each of the first and the second teleassistance inquiries, receive a resolution response from the backend transport system; and
autonomously operate the acceleration, braking, and steering systems to proceed in accordance with the resolution response.
6 Assignments
0 Petitions
Accused Products
Abstract
A self-driving vehicle can operate by analyzing a live sensor view to autonomously operate acceleration, braking, and steering systems of the SDV along a current route. Based on a detected anomaly associated with the live sensor view, the SDV can transmit a teleassistance inquiry to a backend transport system in accordance with a data prioritization scheme. The SDV can receive a resolution response from the backend transport system based on the teleassistance inquiry, and proceed in accordance with the resolution response.
144 Citations
16 Claims
-
1. A self-driving vehicle (SDV) comprising:
-
a communication interface; a sensor system comprising one or more LIDAR sensors generating LIDAR data and one or more cameras generating image data, the LIDAR data and image data providing a live sensor view of a situational environment of the SDV; acceleration, braking, and steering systems; and a control system to execute instructions that cause the control system to; analyze the live sensor view in accordance with a safety threshold to (i) detect objects of interest along a current route, (ii) classify each of the detected objects of interest in accordance with a certainty threshold, and (iii) autonomously operate the acceleration, braking, and steering systems along the current route; when the safety threshold is not met, transmit a first teleassistance inquiry to a backend transport system, the first teleassistance inquiry comprising LIDAR data; when the certainty threshold for an indeterminate object is not met, transmit a second teleassistance inquiry to the backend transport system, the second teleassistance inquiry comprising image data that includes the indeterminate object; for each of the first and the second teleassistance inquiries, receive a resolution response from the backend transport system; and autonomously operate the acceleration, braking, and steering systems to proceed in accordance with the resolution response. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A non-transitory computer readable medium storing instructions that, when executed by a control system of a self-driving vehicle (SDV), cause the control system to:
-
analyze a live sensor view of the SDV in accordance with a safety threshold to (i) detect objects of interest along a current route, (ii) classify each of the detected objects of interest in accordance with a certainty threshold, and (iii) autonomously operate acceleration, braking, and steering systems of the SDV along the current route, wherein the live sensor view comprises LIDAR data from one or more LIDAR sensors and image data from one or more cameras of the SDV; when the safety threshold is not met, transmit a first teleassistance inquiry to a backend transport system, the first teleassistance inquiry comprising LIDAR data; when the certainty threshold for an indeterminate object is not met, transmit a second teleassistance inquiry to the backend transport system, the second teleassistance inquiry comprising image data that includes the indeterminate object; for each of the first and the second teleassistance inquiries, receive a resolution response from the backend transport system; and autonomously operate the acceleration, braking, and steering systems to proceed in accordance with the resolution response. - View Dependent Claims (13, 14, 15)
-
-
16. A computer-implemented method of operating a self-driving vehicle (SDV), the method being performed by a control system of the SDV and comprising:
-
analyzing a live sensor view of the SDV in accordance with a safety threshold to (i) detect objects of interest along a current route, (ii) classify each of the detected objects of interest in accordance with a certainty threshold, and (iii) autonomously operate acceleration, braking, and steering systems of the SDV along the current route, wherein the live sensor view comprises LIDAR data from one or more LIDAR sensors and image data from one or more cameras of the SDV; in response to the safety threshold not being met, transmit a first teleassistance inquiry to a backend transport system, the first teleassistance inquiry comprising LIDAR data; in response to the certainty threshold for an indeterminate object not being met, transmit a second teleassistance inquiry to the backend transport system, the second teleassistance inquiry comprising image data that includes the indeterminate object; for each of the first and the second teleassistance inquiries, receive a resolution response from the backend transport system; and autonomously operate the acceleration, braking, and steering systems to proceed in accordance with the resolution response.
-
Specification