Virtual moving safety limits for vehicles transporting objects

• US 10,459,449 B2
• Filed: 12/23/2016
• Issued: 10/29/2019
• Est. Priority Date: 04/10/2015
• Status: Active Grant

• Current Assignee: Intrinsic Innovation LLC (Alphabet Inc.)
• Original Assignee: X Development LLC (Alphabet Inc.)
• Inventors: Watts, Kevin William
• Primary Examiner(s): Antonucci, Anne M
• Assistant Examiner(s): Stroud, James E
• Application Number:
  US15/389,840
• Publication Number:
  US 20170108871A1
• Time in Patent Office: 1,040 Days
• Field of Search: 701 2
• CPC Class Codes: B60K 31/00 Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator fittings acting on two or more sub-units B60W30/14; speedometers G01P; systems or devices for controlling speed in general G05D13/00 ; in traffic anti-collision system for road vehicles G08G1/16
• CPC Class Codes: B60P 3/00 Vehicles adapted to transport, to carry or to comprise special loads or objects ambulances or other vehicles with special provisions for transporting patients or disabled persons, or their personal conveyances A61G3/00; hearses A61G21/00; fire-fighting land vehicles A62C27/00; refuse-collecting vehicles B65F3/00, B65F7/00; snow-removing vehicles E01H; armoured or armed vehicles F41H7/00; self-propelled mine-clearing vehicles F41H11/16
• CPC Class Codes: B60W 2300/12 Trucks; Load vehicles
• CPC Class Codes: B60W 2300/121 Fork lift trucks, Clarks
• CPC Class Codes: B60W 2520/10 Longitudinal speed
• CPC Class Codes: B60W 2520/105 Longitudinal acceleration
• CPC Class Codes: B60W 2520/125 Lateral acceleration
• CPC Class Codes: B60W 2530/10 Weight
• CPC Class Codes: B60W 2556/55 using telemetry
• CPC Class Codes: B60W 2720/10 Longitudinal speed
• CPC Class Codes: B60W 2720/14 Yaw
• CPC Class Codes: B60W 30/04 related to roll-over prevention
• CPC Class Codes: B60Y 2200/80 Other vehicles not covered by groups B60Y2200/10 - B60Y2200/60
• CPC Class Codes: B66F 17/003 for fork-lift trucks
• CPC Class Codes: B66F 9/063 Automatically guided
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0214 in accordance with safety or protection criteria, e.g. avoiding hazardous areas monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13
• CPC Class Codes: G05D 1/0223 : involving speed control of the vehicle vehicle fittings for automatically controlling, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator B60K31/00

Abstract

Example systems and methods are disclosed for implementing vehicle operation limits to prevent vehicle load failure during vehicle teleoperation. The method may include receiving sensor data from sensors on a vehicle that carries a load. The vehicle may be controlled by a remote control system. The load weight and dimensions may be determined based on the sensor data. In order to prevent a vehicle load failure, a forward velocity limit and an angular velocity limit may be calculated. Vehicle load failures may include the vehicle tipping over, the load tipping over, the load sliding off of the vehicle, or collisions. The vehicle carrying the load may be restricted from exceeding the forward velocity limit and/or the angular velocity limit during vehicle operation. The remote control system may display a user interface indicating to a remote operator the forward velocity limit and the angular velocity limit.

Claims

1. A method comprising:

receiving sensor data from one or more sensors on a vehicle that is controlled by a remote control system to move while carrying a load;

determining a load weight and one or more load dimensions based on the sensor data;

determining an envelope of permissible pairs of angular velocity values and forward velocity values for the vehicle while carrying the load, based at least in part on the load weight and the one or more load dimensions, to prevent vehicle load failure; and

providing for display of a representation of the envelope of permissible pairs of angular velocity values and forward velocity values on a user interface of the remote control system for the vehicle.

2. The method of claim 1, wherein the representation of the envelope comprises a graphical representation with a first axis representative of angular velocity and a second axis representative of forward velocity.

3. The method of claim 1, further comprising providing for display of a current pair of forward velocity and angular velocity values within the representation of the envelope.

4. The method of claim 1, wherein angular velocity values are represented as quantities of steering wheel turns.

5. The method of claim 1, wherein forward velocity values are represented as percentages of a predefined maximum velocity.

6. The method of claim 1, further comprising:

determining a forward acceleration limit for the vehicle while carrying the load, based at least in part on the load weight and the one or more load dimensions, to prevent vehicle load failure; and

providing for display of an indication of the forward acceleration limit on the user interface of the remote control system for the vehicle.

7. The method of claim 1, further comprising:

determining a current lateral acceleration of the vehicle while carrying the load, based at least in part on a current vehicle velocity and a current vehicle angular velocity; and

determining the envelope of permissible pairs of angular velocity values and forward velocity values based on the current lateral acceleration of the vehicle.

8. The method of claim 1, wherein the one or more load dimensions include a load height, a load length, and a load width.

9. The method of claim 8, further comprising:

determining a tip-over torque of the vehicle while carrying the load based at least in part on a vehicle weight, the load weight, the load height, and a current lateral acceleration of the vehicle, wherein the tip-over torque of the vehicle indicates an amount of torque on the vehicle generated by the current lateral acceleration of the vehicle;

determining a tip-over torque of the load based at least in part on the load weight, the load height, and a current lateral acceleration of the load, wherein the tip-over torque of the load indicates an amount of torque on the load generated by the current lateral acceleration of the load; and

determining the envelope of permissible pairs of angular velocity values and forward velocity values based on the tip-over torque of the vehicle and the tip-over torque of the load.

10. The method of claim 1, further comprising:

determining, for the vehicle carrying the load in a surrounding environment containing one or more objects, one or more respective minimum distances between the vehicle and the one or more objects to prevent collisions between the vehicle and the one or more objects; and

determining the envelope of permissible pairs of angular velocity values and forward velocity values to maintain the one or more respective minimum distances between the vehicle and the one or more objects.

11. The method of claim 1, further comprising:

determining the load weight based on sensor data from at least one force sensor on the vehicle; and

determining the one or more load dimensions based on sensor data from one or more optical scanners on the vehicle.

12. The method of claim 1, wherein the vehicle load failure includes a vehicle tip-over failure that occurs when the vehicle carrying the load tips over.

13. The method of claim 1, wherein the vehicle load failure includes a load tip-over failure that occurs when the load tips over off of the vehicle.

14. The method of claim 1, wherein the vehicle load failure includes a load slide-off failure that occurs when the load slides off the vehicle.

15. A non-transitory computer-readable medium storing instructions that are executable by one or more computing devices, wherein executing the instructions causes the one or more computing devices to perform functions comprising:

receiving sensor data from one or more sensors on a vehicle that is controlled by a remote control system to move while carrying a load;

determining a load weight and one or more load dimensions based on the sensor data;

determining an envelope of permissible pairs of angular velocity values and forward velocity values for the vehicle while carrying the load, based at least in part on the load weight and the one or more load dimensions, to prevent vehicle load failure; and

providing for display of a representation of the envelope of permissible pairs of angular velocity values and forward velocity values on a user interface of the remote control system for the vehicle.

16. The non-transitory computer-readable medium of claim 15, wherein the representation of the envelope comprises a graphical representation with a first axis representative of angular velocity and a second axis representative of forward velocity.

17. The non-transitory computer-readable medium of claim 15, wherein the functions further comprise providing for display of a current pair of forward velocity and angular velocity values within the representation of the envelope.

18. A system comprising:

a processor; and

a memory storing instructions that when executed by the processor cause the system to perform functions comprising;

receiving sensor data from one or more sensors on a vehicle that is controlled by a remote control system to move while carrying a load;

determining a load weight and one or more load dimensions based on the sensor data;

determining an envelope of permissible pairs of angular velocity values and forward velocity values for the vehicle while carrying the load, based at least in part on the load weight and the one or more load dimensions, to prevent vehicle load failure; and

providing for display of a representation of the envelope of permissible pairs of angular velocity values and forward velocity values on a user interface of the remote control system for the vehicle.

19. The system of claim 18, wherein the representation of the envelope comprises a graphical representation with a first axis representative of angular velocity and a second axis representative of forward velocity.

20. The system of claim 18, wherein the functions further comprise providing for display of a current pair of forward velocity and angular velocity values within the representation of the envelope.