Data content integrity in display subsystem for safety critical use cases

• US 10,134,139 B2
• Filed: 03/14/2017
• Issued: 11/20/2018
• Est. Priority Date: 12/13/2016
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Gulati, Rahul, Jong, Alex Kwang Ho, Wong, John Chi Kit, Gupta, Sanjay, Ikizyan, Ike
• Primary Examiner(s): Akhavannik, Hadi
• Application Number:
  US15/458,488
• Publication Number:
  US 20180165814A1
• Time in Patent Office: 616 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/001 using an image reference approach

Abstract

Techniques of this disclosure may include processing one or more regions-of-interest (ROI) of an input image through a model of a display processor, calculating a first data integrity check value on the one or more ROI of the input image after processing through the model, processing the input image by the display processor, calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image, comparing the first data integrity check value to the second data integrity check value, and generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match.

Claims

1. A method of checking the integrity of an image, the method comprising:

processing one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

calculating a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

processing the input image by the display processor;

calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

comparing the first data integrity check value to the second data integrity check value; and

generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

2. The method of claim 1, wherein processing the input image by the display processor comprises:

processing the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

processing the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

3. The method of claim 2, wherein calculating the second data integrity check value comprises calculating the second data integrity check value after processing the input image by the second hardware block.

4. The method of claim 2, further comprising:

calculating a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

calculating a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor;

comparing the third data integrity check value to the fourth data integrity check value; and

generating the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

5. The method of claim 1, wherein the input image is an image produced by a rearview camera of a vehicle.

6. The method of claim 1, wherein the input image is an image to be displayed on an instrument cluster of a vehicle.

7. The method of claim 6, wherein the one or more ROI of the input image are tell-tale icons of the instrument cluster.

8. The method of claim 7, wherein one of the one or more ROI of the input image comprise a plurality of tell-tale icons of an instrument cluster.

9. The method of claim 1, further comprising:

generating one or more of an auditory, visual, or haptic warning in response to generating the interrupt.

10. The method of claim 1, further comprising:

initiating a recovery process in response to generating the interrupt.

11. An apparatus configured to check the integrity of an image, the apparatus comprising:

a processor, a display processor, and a comparison circuit,

wherein the processor is configured to;

process one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor; and

calculate a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor,

wherein display processor is configured to;

process the input image by the display processor; and

calculate a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image, and

wherein the comparison circuit is configured to;

compare the first data integrity check value to the second data integrity check value; and

generate an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

12. The apparatus of claim 11, wherein the display processor is further configured to:

process the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

process the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

13. The apparatus of claim 12, wherein the display processor is further configured to calculate the second data integrity check value after processing the input image by the second hardware block.

14. The apparatus of claim 12, wherein the processor is further configured to calculate a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor,

wherein the display processor is further configured to calculate a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor, and

wherein the comparison circuit is further configured to compare the third data integrity check value to the fourth data integrity check value, and

generate the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

15. The apparatus of claim 11, the apparatus further comprising:

a display configured to display the input image after processing by the display processor.

16. The apparatus of claim 15, the apparatus further comprising:

a rearview camera, wherein the input image is an image produced by a rearview camera of a vehicle.

17. The apparatus of claim 15, wherein the input image is an image to be displayed on an instrument cluster of a vehicle.

18. The apparatus of claim 17, wherein the display is configured to display the instrument cluster, and wherein the one or more ROI of the input image are tell-tale icons of the instrument cluster.

19. The method of claim 18, wherein one of the one or more ROI of the input image comprise a plurality of tell-tale icons of the instrument cluster.

20. The apparatus of claim 11, wherein the processor is further configured to generate one or more of an auditory, visual, or haptic warning in response to generating the interrupt.

21. The apparatus of claim 11, wherein the processor is further configured to initiate a recovery process in response to generating the interrupt.

22. The apparatus of claim 11, wherein the processor, the display processor, and the comparison circuit are part of an advanced driver assistance system (ADAS) of a vehicle.

23. An apparatus configured to check the integrity of an image, the apparatus comprising:

means for processing one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

means for calculating a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

means for processing the input image by the display processor;

means for calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

means for comparing the first data integrity check value to the second data integrity check value; and

means for generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

24. The apparatus of claim 23, wherein the means for processing the input image by the display processor comprises:

means for processing the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

means for processing the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

25. The apparatus of claim 24, wherein the means for calculating the second data integrity check value comprises means for calculating the second data integrity check value after processing the input image by the second hardware block.

26. The apparatus of claim 24, further comprising:

means for calculating a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

means for

means for comparing the third data integrity check value to the fourth data integrity check value; and

means for generating the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

27. A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors to:

process one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

calculate a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

process the input image by the display processor;

calculate a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

compare the first data integrity check value to the second data integrity check value; and

generate an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

28. The non-transitory computer-readable storage medium of claim 27, wherein to process the input image by the display processor, the instructions further cause the one or more processors to:

process the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

process the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

29. The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors to calculate the second data integrity check value after processing the input image by the second hardware block.

30. The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors to:

calculate a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

calculate a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor;

compare the third data integrity check value to the fourth data integrity check value; and

generate the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.