System and method for externally interfacing with an autonomous vehicle

• US 10,386,835 B2
• Filed: 01/04/2017
• Issued: 08/20/2019
• Est. Priority Date: 01/04/2016
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Vogt, Kyle, Rust, Ian, Bier, Solomon, Gross, Drew Allyn
• Primary Examiner(s): Patel, Shardul D
• Application Number:
  US15/398,552
• Publication Number:
  US 20170192428A1
• Time in Patent Office: 958 Days
• Field of Search: 701 2, 701 23, 701 49, 296 76
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments
• CPC Class Codes: G01C 21/3438 Rendez-vous, i.e. searching a destination where several users can meet, and the routes to this destination for these users; Ride sharing, i.e. searching a route such that at least two users can share a vehicle for at least part of the route
• CPC Class Codes: G01C 21/3461 Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types, segments such as motorways, toll roads, ferries
• CPC Class Codes: G01C 21/3492 employing speed data or traffic data, e.g. real-time or historical traffic control systems for road vehicles involving transmission of navigation instructions to the vehicle G08G1/0968
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0077 using redundant signals or controls
• CPC Class Codes: G05D 1/0212 with means for defining a desired trajectory involving a plurality of land vehicles G05D1/0287
• CPC Class Codes: G05D 1/0238 using obstacle or wall sensors G05D1/0246 and G05D1/0289 take precedence; lidar systems designed for anti-collision purposes G01S17/93
• CPC Class Codes: G05D 1/0257 using a radar radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931
• CPC Class Codes: G05D 1/0278 using satellite positioning signals, e.g. GPS
• CPC Class Codes: G05D 1/0287 involving a plurality of land vehicles, e.g. fleet or convoy travelling traffic control systems for road vehicles G08G1/00, particularly anticollision systems G08G1/16
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C

Abstract

A method for controlling an autonomous vehicle using an external interface is disclosed. The method includes an external interface that is in operable communication with one or more control systems of the autonomous vehicle. The method allows an entity in proximity of an outside of the autonomous vehicle to interact with the external interface; receives from the entity one or more control inputs, and controls one or more operations of the autonomous vehicle based on the one or more control inputs.

Claims

1. A method for controlling an autonomous vehicle at an external interface, the autonomous vehicle having an external interface, an onboard computer processor, and a powertrain, the method comprising:

at the external interface, operably in communication with the autonomous vehicle;

allowing an entity in a proximity of an outside of the autonomous vehicle to interact with the external interface;

receiving, from the entity, one or more control inputs; and

controlling, based on control inputs from the entity, one or more operations of the autonomous vehicle based on the one or more control inputs received using the external interface,

wherein the external interface comprises one or more pressure-sensitive areas positioned on an external surface of the autonomous vehicle, and wherein, based on an application of pressure to one or more sections of the one or more pressure-sensitive areas, the one or more pressure-sensitive areas control an operation of the autonomous vehicle for movement of the autonomous vehicle from a first location to a second location;

wherein the entity comprises an operator disposed outside the autonomous vehicle;

wherein the one or more pressure-sensitive areas comprise a touch screen on the external surface of the autonomous vehicle, the touch screen configured to receive operator instructions from the operator, by sensing the operator'"'"'s physical engagement of the touch screen, including the operator'"'"'s designation of the second location for the autonomous vehicle to be automatically moved to via the operator'"'"'s engagement of the touch screen;

wherein the step of receiving the one or more control inputs comprises receiving the operator instructions from the operator, including the operator'"'"'s designation of the second location for the autonomous vehicle to be automatically moved to, via sensing of the operator'"'"'s physical engagement of the touch screen on the external surface of the autonomous vehicle; and

wherein the method further comprises implementing the operator instructions, via the computer processor disposed onboard the autonomous vehicle, by automatically, physically moving the autonomous vehicle, via computer instructions provided by the computer processor and implemented by the powertrain of the autonomous vehicle, to the second location as requested via the operator'"'"'s physical engagement of the touch screen on the external surface of the autonomous vehicle.

2. The method of claim 1, wherein the external interface comprises an external digital control interface, disposed on the external surface of the vehicle, that is operable to control the autonomous vehicle via interactions with an onboard computer of the autonomous vehicle when the autonomous vehicle is incapable of establishing connectivity with one or more remotely located control data sources.

3. The method of claim 1, wherein the external interface comprises an external digital control interface, disposed on the external surface of the vehicle, that is operable to control the autonomous vehicle via interactions with an onboard computer of the autonomous vehicle when the autonomous vehicle identifies an assistance-desired scenario.

4. The method of claim 1, further comprising:

authenticating an identity of the entity via the external interface, wherein the external interface is operably in communication with one or more sensors and/or input receiving devices configured to capture entity authentication data, wherein authenticating the entity includes processing the entity authentication data.

5. The method of claim 1, further comprising:

authorizing a power to control the autonomous vehicle of the entity via the external interface, wherein the external interface is operably in communication with one or more sensors and/or input receiving devices configured to capture entity authorization data, wherein authorizing the entity includes processing the entity authorization data, and wherein the power authorized for the entity comprises a level of control provided to the entity for control of operations of the autonomous vehicle, the level of control for the entity selected from a plurality of different control levels in a predetermined control spectrum for the autonomous vehicle, based on the entity.

6. The method of claim 1, further comprising:

verifying the proximity of the entity to the autonomous vehicle, wherein verifying the proximity includes;

identifying a location of the entity,

determining whether the location of the entity is within a predetermined proximity threshold required for the entity to control the autonomous vehicle via the external interface, wherein if the entity is within the predetermined proximity threshold, enabling the external interface to implement a process for controlling the autonomous vehicle using the external interface.

7. The method of claim 1, wherein:

the operator draws a line on the touch screen from the autonomous vehicle to the second location, including a termination point of the line corresponding to the second location for automatic movement of the autonomous vehicle; and

the step of receiving the control inputs comprises sensing a drawing of the line by the operator, including the termination point corresponding to the second location for automatic movement of the autonomous vehicle.

8. The method of claim 7, wherein the operator draws the line, including the termination point, directly on the touch screen via a finger or input device of the operator.

9. The method of claim 7, further comprising:

displaying, on the touch screen, a top down view of the autonomous vehicle;

wherein the operator draws the line, including the termination point, from the autonomous vehicle to the second location, using the top down view of the autonomous vehicle.

10. The method of claim 1,

wherein the operator points to the second location on the touch screen.

11. The method of claim 10, further comprising:

displaying, on the touch screen, an area map of an area surrounding the autonomous vehicle;

wherein the operator points to the second location on the area map via the touch screen.

12. The method of claim 1, wherein the touch screen comprises two touchpads, wherein the entity'"'"'s engagement of both of the touchpads results in forward movement of the autonomous vehicle, and wherein the entity'"'"'s engagement of one of the touchpads without the other touchpad results in a turn for the autonomous vehicle.

13. An autonomous vehicle comprising:

a powertrain;

an external surface;

a pressure-sensitive touch screen disposed on the external surface;

an onboard computer processor disposed onboard the autonomous vehicle that includes a computer processor that controls one or more operations of the autonomous vehicle; and

a local communication interface that communicates data between the touch screen and the onboard computer processor of the autonomous vehicle;

wherein an operator that is external to and in proximity to the autonomous vehicle uses the touch screen to interact, via the local communication interface, with and control the autonomous vehicle;

wherein the touch screen comprises one or more sensors that are configured to receive operator instructions from the operator, by sensing the operator'"'"'s physical engagement of the touch screen, including the operator'"'"'s designation of the second location for the autonomous vehicle to be automatically moved to via the operator'"'"'s engagement of the touch screen; and

wherein the onboard computer processor is configured to implement the operator instructions by providing computer instructions to the powertrain to automatically, physically move the autonomous vehicle to the second location as requested via the operator'"'"'s physical engagement of the touch screen on the external surface of the autonomous vehicle.

14. The autonomous vehicle of claim 13, wherein:

the operator draws a line on the touch screen from the autonomous vehicle to the second location, including a termination point of the line corresponding to the second location for automatic movement of the autonomous vehicle; and

the touch screen senses a drawing of the line by the operator, including the termination point corresponding to the second location for automatic movement of the autonomous vehicle.

15. The autonomous vehicle of claim 14, wherein the operator draws the line, including the termination point, directly on the touch screen via a finger or input device of the operator.

16. The autonomous vehicle of claim 14, wherein:

the touch screen is configured to display a top down view of the autonomous vehicle; and

the operator draws the line, including the termination point, from the autonomous vehicle to the second location, using the top down view of the autonomous vehicle.

17. The autonomous vehicle of claim 13, wherein the operator points to the second location on the touch screen.

18. The autonomous vehicle of claim 17, wherein:

the touch screen is configured to display an area map of an area surrounding the autonomous vehicle; and

the operator points to the second location on the area map via the touch screen.

19. The autonomous vehicle of claim 13, wherein:

the touch screen comprises a first touchpad and a second touchpad positioned against the external surface of the autonomous vehicle, the first and second touchpads configured such that;

the autonomous vehicle will be automatically moved in a forward motion if both the first touchpad and the second touchpad are engaged by the operator; and

the autonomous vehicle will be automatically moved in a left turn motion if the first touchpad, but not the second touchpad, is engaged by the operator.

20. An autonomous vehicle comprising:

a powertrain;

an external surface;

a joystick disposed on the external surface;

an onboard computer processor disposed onboard the autonomous vehicle that includes a computer processor that controls one or more operations of the autonomous vehicle; and

a local communication interface that communicates data between the joystick and the onboard computer processor of the autonomous vehicle;

wherein an operator that is external to and in proximity to the autonomous vehicle uses the joystick to interact, via the local communication interface, with and control the autonomous vehicle;

wherein the joystick comprises one or more sensors that are configured to receive operator instructions from the operator, by sensing the operator'"'"'s physical engagement of the joystick, including the operator'"'"'s designation of the second location for the autonomous vehicle to be automatically moved to via the operator'"'"'s engagement of the joystick; and

wherein the onboard computer processor is configured to implement the operator instructions by providing computer instructions to the powertrain to automatically, physically move the autonomous vehicle to the second location as requested via the operator'"'"'s physical engagement of the joystick on the external surface of the autonomous vehicle.