Sensor management in autonomous vehicles

• US 10,453,275 B2
• Filed: 11/20/2017
• Issued: 10/22/2019
• Est. Priority Date: 11/20/2017
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Tatourian, Igor
• Primary Examiner(s): Jeanglaude, Gertrude Arthur
• Application Number:
  US15/817,841
• Publication Number:
  US 20190051063A1
• Time in Patent Office: 701 Days
• Field of Search: 701 298
• CPC Class Codes: G05D 1/0022 characterised by the communication link data switching networks in general H04L12/00
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles
• CPC Class Codes: G07C 5/006 Indicating maintenance
• CPC Class Codes: G07C 5/008 communicating information to a remotely located station transmission systems for measured values G08C
• CPC Class Codes: G07C 5/02 Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/0808 Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G07C 5/0816 Indicating performance data, e.g. occurrence of a malfunction

Abstract

An apparatus for sensor management in computer-assisted or autonomous driving (CA/AD) vehicles, comprising a sensor analyzer and a sensor manager. The sensor analyzer is to determine a difference between a baseline sensor reading of a landmark, and a subsequent reading of the same landmark at a later point in time. The sensor manager is to determine whether a management action is needed on the basis of the determined difference, in further consideration of differential experiences from other CA/AD vehicles.

Claims

1. An apparatus for managing a sensor in a computer-assisted or autonomous driving (CA/AD) vehicle, comprising:

a sensor analyzer to determine a difference between a baseline reading and a subsequent reading of a landmark by the sensor, the baseline reading having been recorded at a first point in time when the sensor first detects the landmark; and

the subsequent reading having been recorded at a second subsequent point in time when the sensor again detects the landmark; and

a sensor manager coupled to the sensor analyzer to determine whether a management action is needed for the sensor based at least in part on the determined difference between the baseline and subsequent readings experienced for a time period length defined by the first and second points of time, in view of other differential experiences for other time period lengths reported by other similar sensors on other CA/AD vehicles,

wherein, when it is determined that a management action is needed, the sensor manager is to either execute the management action or notify a user to take the management action.

2. The apparatus of claim 1, wherein the sensor analyzer is to further:

record the CA/AD vehicle'"'"'s physical location when the sensor first detects the landmark; and

detect the vehicle'"'"'s subsequent return to substantially the same physical location as the physical location recorded when the landmark was first detected.

3. The apparatus of claim 2, wherein the sensor manager is to further select the landmark based upon a usage characteristic of the sensor.

4. The apparatus of claim 1, wherein the landmark is a first landmark, and the sensor analyzer and the sensor manager are to perform the determinations for a plurality of landmarks that includes the first landmark.

5. The apparatus of claim 1, wherein the sensor manager is to determine whether the management action is needed in further view of environmental conditions at the time of the second reading.

6. The apparatus of claim 5, wherein the differential experiences further include environmental conditions experienced by the other CA/AD vehicles.

7. The apparatus of claim 5, wherein the environmental conditions may include weather, traffic, dirt or debris on the vehicle.

8. The apparatus of claim 1, wherein the apparatus is a CA/AD management system disposed within the vehicle, and further comprises:

an interface in communication with the sensor to receive the sensor readings; and

a network interface to communicate with a remote server to receive the other differential experiences.

9. The apparatus of claim 8, wherein the network interface is further to transmit the baseline reading, the subsequent reading, the difference between the baseline and subsequent readings, or a need for the determined management action.

10. The apparatus of claim 8, wherein the network interface comprises a wireless transceiver.

11. The apparatus of claim 1, wherein the apparatus is the CA/AD vehicle, and further comprises a sensor in communication with the sensor analyzer.

12. The apparatus of claim 9, wherein the sensor is to run a self-test, and the sensor manager is to determine whether the management action is needed in further view of results of the self-test.

13. The apparatus of claim 9, wherein the sensor comprises a plurality of sensors, and at least two of the plurality of sensors are of different types.

14. A method for managing a sensor in a computer-assisted or autonomous driving (CA/AD) vehicle, comprising:

recording a baseline reading of a landmark of the sensor of the CA/AD vehicle at a first point in time when the sensor first detects the landmark;

recording a subsequent reading of the landmark of the same sensor at a second subsequent point in time when the sensor again detects the landmark;

determining whether a management action is needed for the sensor based at least in part on a difference between the baseline and subsequent readings experienced for a time period length defined by the first and second points of time, in view of other differential experiences for other time period lengths reported by other similar sensors on other CA/AD vehicles; and

when it is determined that a management action is needed, either executing the management action or notifying a user to take the management action.

15. The method of claim 14, further comprising determining the difference between the baseline reading and the subsequent reading.

16. The method of claim 14, further comprising:

recording the CA/AD vehicle'"'"'s physical location when the sensor first detects the landmark; and

detecting the vehicle'"'"'s subsequent return to substantially the same physical location as the physical location recorded when the landmark was first detected.

17. The method of claim 14, wherein the method is performed by a CA/AD management system disposed within the vehicle, and further comprises:

interfacing with the sensor to receive the sensor readings; and

communicating via a network interface with a remote server to receive the other differential experiences.

18. A non-transitory computer-readable medium (CRM) comprising instructions to cause a sensor management apparatus for a computer-assisted or autonomous driving (CA/AD) vehicle, in response to execution of the instructions by a processor, to:

record a baseline reading of a landmark of a sensor of the CA/AD vehicle at a first point in time when the sensor first detects the landmark;

record a subsequent reading of the landmark of the same sensor at a second subsequent point in time when the CA/AD vehicle again detects the landmark;

determine whether a management action is needed for the sensor based at least in part on a difference between the baseline and subsequent readings experienced for a time period length defined by the first and second points of time, in view of other differential experiences for other time period lengths reported by other similar sensors on other CA/AD vehicles; and

when it is determined that a management action is needed, either execute the management action or notify a user to take the management action.

19. The CRM of claim 18, wherein the instructions are further to determine the difference between the baseline reading and the subsequent reading.

20. The CRM of claim 18, wherein the instructions are further to:

record the CA/AD vehicle'"'"'s physical location when the sensor first detects the landmark; and

detect the vehicle'"'"'s subsequent return to substantially the same physical location as the physical location recorded when the landmark was first detected.

21. The CRM of claim 18, wherein the instructions are further to select the landmark based upon a usage characteristic of the sensor.

22. A manager for a sensor in a computer-assisted or autonomous driving (CA/AD) vehicle, comprising:

means for recording a baseline reading of a landmark from the sensor of the CA/AD vehicle at a first point in time when the sensor first detects the landmark, and a subsequent reading of the landmark from the same sensor at a second subsequent point in time when the sensor again detects the landmark; and

means for determining whether a management action is needed for the sensor based at least in part on a difference between the baseline and subsequent readings experienced for a time period length defined by the first and second points of time, in view of other differential experiences for other time period lengths reported by other similar sensors on other CA/AD vehicles;

wherein, when it is determined that a management action is needed, the means for determining is to either execute the management action or notify a user to take the management action.

23. The manager of claim 22, wherein the means for recording is to further:

record the CA/AD vehicle'"'"'s physical location when the sensor first detects the landmark; and

detect the vehicle'"'"'s subsequent return to substantially the same physical location as the physical location recorded when the landmark was first detected.

24. The manager of claim 22, wherein the means for determining is to determine whether the management action is needed in further view of environmental conditions at the time of the second reading.

25. The manager of claim 22, wherein the manager is a CA/AD management system for the vehicle, and further comprises:

communication means in communication with the sensor to receive the sensor readings; and

network means to communicate with a remote server to receive the other differential experiences.