Detecting objects within a vehicle in connection with a service

• US 10,329,827 B2
• Filed: 04/04/2018
• Issued: 06/25/2019
• Est. Priority Date: 05/11/2015
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: Uber Technologies, Inc.
• Inventors: Bradley, David McAllister, Valois, Jean-Sebastien
• Primary Examiner(s): Antonucci, Anne M
• Application Number:
  US15/945,365
• Publication Number:
  US 20180223584A1
• Time in Patent Office: 447 Days
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60N 2210/24 Cameras
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: E05F 15/70 with automatic actuation
• CPC Class Codes: E05Y 2400/44 Sensors not directly associated with the wing movement
• CPC Class Codes: E05Y 2400/45 Control modes
• CPC Class Codes: E05Y 2900/548 Trunk lids
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/0212 with means for defining a desired trajectory involving a plurality of land vehicles G05D1/0287
• CPC Class Codes: G05D 1/0276 using signals provided by a source external to the vehicle involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06Q 10/083 Shipping
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G08B 21/24 Reminder alarms, e.g. anti-loss alarms

Abstract

A system for monitoring a vehicle used in providing a service is disclosed. The system detects when the service is complete, and upon detecting that the service is complete, the system determines, from one or more sensors of the vehicle, that an object which should have been removed from the vehicle after completion of the transport service, remains in the vehicle. The system then automatically initiates performance of a remedial action.

Claims

1. A method for monitoring a vehicle that is operating to provide transport services, the method being implemented by one or more processors and comprising:

receiving, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;

receiving first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;

identifying, from the first image information, an object that has been placed in the interior of the vehicle in connection with the first transport service;

prior to completion of the first transport service, receiving second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;

determining that the object has been removed from the interior of the vehicle by comparing the first image information and the second image information; and

in response to determining that the object has been removed from the interior of the vehicle, initiating performance of a remedial action.

2. The method of claim 1, further comprising performing an image recognition process on the first image information and the second image information to recognize the object based on visual characteristics.

3. The method of claim 1, wherein the vehicle receives the second image information and compares the first image information and the second image information as the vehicle travels to the destination.

4. The method of claim 1, wherein the first transport service is a delivery service and the object is an item to be delivered.

5. The method of claim 1, wherein initiating performance of the remedial action includes automatically transmitting a notification that the object is no longer present in the vehicle to a computing system that arranged the first transport service.

6. The method of claim 1, wherein initiating performance of the remedial action includes automatically communicating, over one or more networks, a message to a computing device associated with a driver of the vehicle, the message notifying the vehicle that the object has been removed from the interior of the vehicle.

7. The method of claim 6, wherein the message includes an image of the object or results of the comparison between the first image information and the second image information.

8. The method of claim 1, further comprising:

determining that the object was placed in the vehicle by a user who entered the vehicle at the start location.

9. The method of claim 8, wherein initiating performance of the remedial action includes automatically communicating, over one or more networks, a message to a computing device associated with the user, the message notifying the user that the object has been removed from the interior of the vehicle.

10. The method of claim 8, further comprising:

associating the object with a profile or account of the user.

11. A vehicle comprising:

one or more sensors generating sensor data; and

a control system to execute instructions that cause the vehicle to perform operations including;

receiving, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;

receiving first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;

identifying, from the first image information, an object that has been placed in the interior of the vehicle in connection with the first transport service;

prior to completion of the first transport service, receiving second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;

determining that the object has been removed from the interior of the vehicle by comparing the first image information and the second image information; and

in response to determining that the object has been removed from the interior of the vehicle, initiating performance of a remedial action.

12. The vehicle of claim 11, further comprising performing an image recognition process on the first image information and the second image information to recognize the object based on visual characteristics.

13. The vehicle of claim 11, wherein the vehicle receives the second image information and compares the first image information and the second image information as the vehicle travels to the destination.

14. The vehicle of claim 11, wherein the first transport service is a delivery service and the object is an item to be delivered.

15. The vehicle of claim 11, wherein initiating performance of the remedial action includes automatically transmitting a notification that the object is no longer present in the vehicle to a computing system that arranged the first transport service.

16. The vehicle of claim 11, wherein initiating performance of the remedial action includes automatically communicating, over one or more networks, a message to a computing device associated with a driver of the vehicle, the message notifying the vehicle that the object has been removed from the interior of the vehicle.

17. The vehicle of claim 16, wherein the message includes an image of the object or results of the comparison between the first image information and the second image information.

18. The vehicle of claim 11, further comprising:

determining that the object was placed in the vehicle by a user who entered the vehicle at the start location.

19. The vehicle of claim 18, wherein initiating performance of the remedial action includes automatically communicating, over one or more networks, a message to a computing device associated with the user, the message notifying the user that the object has been removed from the interior of the vehicle.

20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors of an on-board computing system of a vehicle, cause the on-board computing system to perform operations including:

receiving, from a remote system, instructions for the vehicle to provide a first transport service from a start location to a destination;

receiving first image information of an interior of the vehicle from one or more cameras positioned within the vehicle;

identifying, from the first image information, an object that has been placed in the interior of the vehicle in connection with the first transport service;

prior to completion of the first transport service, receiving second image information of the interior of the vehicle from the one or more cameras positioned within the vehicle;

determining that the object has been removed from the interior of the vehicle by comparing the first image information and the second image information; and

in response to determining that the object has been removed from the interior of the vehicle, initiating performance of a remedial action.