HUMAN-MACHINE INTERFACE (HMI) ARCHITECTURE
First Claim
1. A computer-implemented method of operating an autonomous driving vehicle (ADV), the method comprising:
- receiving, at a Web interface of a web server, an ADV command from a first client application, the ADV command being received using a Web communication protocol, wherein the first client application is one of a plurality of client applications hosted by the Web server;
in response to the ADV command, transmitting the ADV command via a remote procedure call (RPC) to a proxy server of a robotic operating system of the ADV, the proxy server configured to route the ADV command to an ADV perception and control system via a message bus; and
in response to receiving an ADV command response from the ADV perception and control system, multicasting the ADV command response to the first client application via a first socket connection and to a second client application of the plurality of client applications via a second socket connection.
1 Assignment
0 Petitions
Accused Products
Abstract
An autonomous driving vehicle (ADV) is operated using a human-machine interface (HMI). The web server provides the HMI to a computing device in response to an input received from the computing device. An ADV command is entered into the HMI and passed to an interface of the web server. In response to receiving the ADV command, the web server calls a remote procedure call to a proxy server in a backend server for processing by a perception and control module of the ADV. Results of the ADV command are received by the web server interface and stored in results memory with a unique identifier. The web server interface opens a socket that accesses the results memory. If the results memory changes, the socket reads the results memory and provides the ADV command results to the HMI. Multiple HMIs can simultaneously communicate with the web server interface and socket.
-
Citations
21 Claims
-
1. A computer-implemented method of operating an autonomous driving vehicle (ADV), the method comprising:
-
receiving, at a Web interface of a web server, an ADV command from a first client application, the ADV command being received using a Web communication protocol, wherein the first client application is one of a plurality of client applications hosted by the Web server; in response to the ADV command, transmitting the ADV command via a remote procedure call (RPC) to a proxy server of a robotic operating system of the ADV, the proxy server configured to route the ADV command to an ADV perception and control system via a message bus; and in response to receiving an ADV command response from the ADV perception and control system, multicasting the ADV command response to the first client application via a first socket connection and to a second client application of the plurality of client applications via a second socket connection. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory machine-readable medium having executable instructions stored therein, which when executed by a processor, cause the processor to perform operations for operating an autonomous driving vehicle (ADV), the operations comprising:
-
receiving, at a Web interface of a web server, an ADV command from a first client application, the ADV command being received using a Web communication protocol, wherein the first client application is one of a plurality of client applications hosted by the Web server; in response to the ADV command, transmitting the ADV command via a remote procedure call (RPC) to a proxy server of a robotic operating system of the ADV, the proxy server configured to route the ADV command to an ADV perception and control system via a message bus; and in response to receiving an ADV command response from the ADV perception and control system, multicasting the ADV command response to the first client application via a first socket connection and to a second client application of the plurality of client applications via a second socket connection. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A web server comprising:
-
a processor; and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for operating an autonomous driving vehicle (ADV), the operations comprising; receiving, at a Web interface of a web server, an ADV command from a first client application, the ADV command being received using a Web communication protocol, wherein the first client application is one of a plurality of client applications hosted by the Web server, in response to the ADV command, transmitting the ADV command via a remote procedure call (RPC) to a proxy server of a robotic operating system of the ADV, the proxy server configured to route the ADV command to an ADV perception and control system via a message bus, and in response to receiving an ADV command response from the ADV perception and control system, multicasting the ADV command response to the first client application via a first socket connection and to a second client application of the plurality of client applications via a second socket connection. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification