SYSTEMS AND METHODS FOR VERIFYING INTEGRITY OF A SENSING SYSTEM

• US 20190018408A1
• Filed: 07/12/2017
• Published: 01/17/2019
• Est. Priority Date: 07/12/2017
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Gulati, Rahul, Biswas, Mainak, Bhuyan, Pranjal, Saxena, Anshuman
• Application Number:
  US15/648,347
• Publication Number:
  US 20190018408A1
• Time in Patent Office: Days
• CPC Class Codes: G05D 1/0055 with safety arrangements
• CPC Class Codes: G05D 1/0248 in combination with a laser lasers per se H01S
• CPC Class Codes: G05D 1/0257 using a radar radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931
• CPC Class Codes: G07C 5/006 Indicating maintenance
• CPC Class Codes: G07C 5/0808 Diagnosing performance data testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005
• CPC Class Codes: G08G 1/09623 Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: G08G 1/096805 where the transmitted instructions are used to compute a route
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08

Abstract

Devices and methods are disclosed for verifying the integrity of a sensing system. In one aspect, a vehicle includes an integrated circuit configured to support a message-based protocol between the integrated circuit and a sensor device associated with the vehicle, and send a sensor capability safety support message, as part of the message-based protocol, to determine one or more capabilities of the sensor device. The integrated circuit is also configured to receive, in response to the sensor capability safety support message, identification data corresponding to the sensor device, from the sensor device. The memory is configured to store a plurality of request data corresponding to a plurality of fields supported by the message-based protocol and associated with the integrated circuit and the sensor device capabilities, and store the response, including the identification data, from the sensor device.

Claims

1. A vehicle comprising:

an integrated circuit that includes a processor that is configured to;

support a message-based protocol between the integrated circuit and one or more sensor devices associated with the vehicle, and

send a sensor capability safety support message, which is part of the message-based protocol, to determine one or more sensor device capabilities of the one or more sensor devices, and

receive, in response to the sensor capability safety support message, identification data corresponding to the one or more sensor devices, from the one or more sensor devices; and

a memory configured to;

store a plurality of request data corresponding to a plurality of fields supported by the message-based protocol and associated with the integrated circuit and the one or more sensor devices capabilities, and

store the response, including the identification data, from the one or more sensor devices.

2. The vehicle of claim 1, wherein the integrated circuit is configured to periodically receive first baseline vehicle safety data associated with the identification data corresponding to the one or more sensor devices based on the message-based protocol and compare the periodically received first baseline vehicle safety data with second baseline vehicle safety data from the memory, and identify a failure if the periodically received first baseline vehicle safety data does not match the second baseline vehicle safety data from the memory.

3. The vehicle of claim 2, wherein the integrated circuit is configured to provide limited functionality to the vehicle if the failure is identified.

4. The vehicle of claim 3, wherein the limited functionality is an altered navigation plan.

5. The vehicle of claim 2, wherein at least one of the one or more sensor devices is a camera, and the first baseline vehicle safety data is a known image test frame.

6. The vehicle of claim 2, wherein at least one of the one or more sensor devices is a LIDAR sensor, and the first baseline vehicle safety data is a known LIDAR test frame.

7. The vehicle of claim 2, wherein at least one of the one or more sensor devices is a RADAR sensor, and the first baseline vehicle safety data is a known chirp frame.

8. The vehicle of claim 2, further comprising a display configured to present a representation of the identified failure.

9. The vehicle of claim 2, further comprising a first sensor device and a second sensor device, wherein the first sensor device is designated to operate as a primary sensor device associated with the vehicle, and the second sensor device is designated to operate as a fallback sensor device associated with the vehicle, and wherein the integrated circuit is configured to switch the designation of the first device as the primary sensor device to a fallback sensor device, and switch the designation of the second device as the fallback sensor device to a primary sensor device when the failure is identified.

10. The vehicle of claim 9, wherein the primary sensor devices and fallback sensor devices are directly or indirectly coupled to a processor that includes a primary perception unit and secondary perception unit, each perception unit detects a visual object or warning.

11. The vehicle of claim 1, wherein the integrated circuit is configured to:

send, in the sensor capability safety support message, a request query data in a query field of the plurality of fields, and

receive, a response including the identification data, from one of the one or more sensor devices associated with the vehicle that includes data responsive to the request query data supported by the one or more sensor devices associated with the vehicle.

12. The vehicle of claim 1, wherein the integrated circuit is configured to:

send, in the sensor capability safety support message, a request type of test frame data in a type of test frame data field included in the plurality of fields, and

receive, a response including type of test frame supported by the one or more sensor devices associated with the vehicle, from the one or more sensor devices associated with the vehicle.

13. The vehicle of claim 1, wherein the integrated circuit is configured to:

send, in the sensor capability safety support message, a request including what frame rate data in a frame rate field included in the plurality of fields, and

receive, a response including what frame rate supported by the one or more sensor devices associated with the vehicle, from the one or more sensor devices associated with the vehicle.

14. The vehicle of claim 1, wherein the integrated circuit is configured to:

send, in the sensor capability safety support message, a request including what calibration data in a calibration type field included in the plurality of fields, and

receive, a response including what calibration type is supported by the one or more sensor devices associated with the vehicle, from the one or more sensor devices associated with the vehicle.

15. The vehicle of claim 1, wherein the identification data associated with one or more sensor devices is acknowledgment data that confirms one or more capabilities are supported from the one or more sensor devices.

16. The vehicle of claim 1, wherein the identification data associated with one or more sensor devices is acknowledgment data that confirms that one or more capabilities are not supported from the one or more sensor devices.

17. The vehicle of claim 1, wherein the integrated circuit is configured to read operational data, including baseline vehicle safety data from the memory, and send the operational data, including the baseline vehicle safety data to the one or more sensor devices that confirm that one or more capabilities are supported from the one or more sensor devices.

18. A method comprising:

sending a sensor capability safety support message to determine one or more sensor device capabilities of the one or more sensor devices, the sensor capability safety support message is part of a message-based protocol between an integrated circuit and one or more sensor devices associated with a vehicle;

receiving, in response to the sensor capability safety support message, identification data corresponding to the one or more sensor devices, from the one or more sensor devices;

storing a plurality of request data corresponding with a plurality of fields supported by the message-based protocol associated with the integrated circuit and the one or more sensor devices capabilities; and

storing the response, including the identification data, from the one or more sensor devices.

19. The method of claim 18, further comprising:

periodically receiving first baseline vehicle safety data associated with the identification data corresponding to the one or more sensor devices based on the message-based protocol;

comparing the periodically received first baseline vehicle safety data with second baseline vehicle safety data from the memory; and

identifying a failure if the periodically received first baseline vehicle safety data does not match the second baseline vehicle safety data from the memory.

20. The method of claim 19, wherein the one or more sensor devices comprises a first sensor device designated to operate as a primary sensor device associated with the vehicle and a second sensor device designated to operate as a fallback sensor device associated with the vehicle, wherein the method further comprises:

switching a designation of a first device as a primary sensor device to a fallback sensor device; and

switching a designation of a second device as a fallback sensor device to a primary sensor device when the failure is identified.

21. A system for sensing an environment surrounding a vehicle, the system comprising:

a source component that includes a processor configured to;

support a message-based protocol between the source component and a target component associated with the vehicle, and

send a capability safety support message, which is part of the message-based protocol, to determine one or more capabilities of the target component, and

receive, in response to the capability safety support message, identification data corresponding to the target component, from the target component; and

a memory configured to;

store a plurality of request data corresponding to a plurality of fields supported by the message-based protocol and associated with the source component and the one or more capabilities of the target component, and

store the response, including the identification data, from the target component.

22. The system of claim 21, wherein the source component is an integrated circuit and the target component is one or more sensor devices.

23. The system of claim 21, wherein the at least one source component is one or more sensor devices and the target component is an integrated circuit.

24. The system of claim 21, wherein one of the source and target component is configured to periodically receive first baseline vehicle safety data associated with the identification data corresponding to the target component based on the message-based protocol and compare the periodically received first baseline vehicle safety data with second baseline vehicle safety data from the memory, and identify a failure if the periodically received first baseline vehicle safety data does not match the second baseline vehicle safety data from the memory.

25. The system of claim 24, wherein one of the source and target component is configured to provide limited functionality to the vehicle if the failure is identified.

26. The system of claim 24, further comprising a first sensor device and a second sensor device, wherein the first sensor device is designated to operate as primary sensor device associated with the vehicle, and the second sensor device is designated to operate as a fallback sensor device associated with the vehicle, and wherein one of the source and target components is configured to switch the designation of the first device as the primary sensor device to a fallback sensor device, and switch the designation of the second device as the fallback sensor device to a primary sensor device when the failure is identified.

27. The system of claim 21, wherein the source component is configured to:

send, in the capability safety support message, a request query data in a query field of the plurality of fields, and

receive, a response including the identification data, from the target component associated with the vehicle that includes data responsive to the request query data supported by the target component associated with the vehicle.

28. A non-transitory computer readable medium comprising instructions that when executed cause a processor to perform a method comprising:

sending a capability safety support message to determine one or more capabilities of at least one target component, the capability safety support message is part of a message-based protocol between at least one source component and the at least one target component;

receiving, in response to the capability safety support message, identification data corresponding to the at least one target component, from the at least one target component;

storing a plurality of request data corresponding with a plurality of fields supported by the message-based protocol associated with the at least one source component and the one or more capabilities of the at least one target component; and

storing the response, including the identification data, from the at least one target component.

29. The non-transitory computer readable medium of claim 28, wherein the at least one source component is an integrated circuit and the at least one target component is a sensor device.

30. The non-transitory computer readable medium of claim 28, wherein the at least one source component is a sensor device and the at least one target component is an integrated circuit.