Scene obstruction detection using high pass filters

• US 10,402,696 B2
• Filed: 01/04/2017
• Issued: 09/03/2019
• Est. Priority Date: 01/04/2016
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Cheng, Victor
• Primary Examiner(s): Thomas, Mia M
• Application Number:
  US15/398,006
• Publication Number:
  US 20170193641A1
• Time in Patent Office: 972 Days
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle

Abstract

Advanced driver assistance systems need to be able to operate under real time constraints, and under a wide variety of visual conditions. The camera lens may be partially or fully obstructed by dust, road dirt, snow etc. The invention shown extracts high frequency components from the image, and is operable to classify the image as being obstructed or non-obstructed.

Claims

1. An image processing system comprising:

a memory to store instructions; and

a processor having an input to receive an input image corresponding to a scene and an output, the processing being configured to execute the instructions to perform scene obstruction detection on the input image by;

dividing the input image into a plurality of blocks;

applying horizontal and vertical high pass filtering to obtain, for each block, a respective horizontal high frequency content (HFC) value and a respective vertical HFC value;

determining a first mean and a first standard deviation based on the horizontal HFC values of the blocks;

determining a second mean and a second standard deviation based on the vertical HFC values of the blocks;

forming a multi-dimensional feature vector having components corresponding at least to the first mean, the first standard deviation, the second mean, and the second standard deviation;

classifying the input image as either obstructed or unobstructed by comparing a value determined as a combination of one or more predetermined parameters and the components of the feature vector to a decision boundary threshold, wherein the classification of the input image as either obstructed or unobstructed is based on a result of the comparison of the value to the decision boundary threshold; and

outputting, by the output, a result of the classification.

2. The image processing system of claim 1, wherein the one or more predetermined parameters are selected based on a cost function.

3. The image processing system of claim 1, wherein the combination is based on a linear combination.

4. The image processing system of claim 1, wherein a total number of the one or more predetermined parameters is one more than a total number of the components of the feature vector.

5. The image processing system of claim 1, wherein the one or more predetermined parameters parametrize the decision boundary threshold.

6. The image processing system of claim 5, wherein the decision boundary threshold is in the form of a hyperplane.

7. The image processing system of claim 1, wherein dividing the input image into the plurality of blocks comprises dividing into a grid of M blocks by N blocks, wherein at least one of M or N is an integer greater than 1, and wherein a total number of the plurality of blocks is equal to M×

N.

8. The image processing system of claim 7, wherein M is equal to N.

9. The image processing system of claim 7, wherein each block is the same size.

10. The image processing system of claim 1, wherein the classification is a binary classification.

11. The image processing system of claim 1, wherein the processor comprises a digital signal processor.

12. The image processing system of claim 1, comprising an image capture device to acquire the input image corresponding to the scene.

13. The image processing system of claim 12, wherein the image capture device is a video camera.

14. The image processing system of claim 13, wherein the video camera is a fixed focus camera.

15. The image processing system of claim 1, wherein the image processing system is part of an advanced driver assistance system for an automobile.

16. An image processing system comprising:

a memory to store instructions; and

a processor having an input to receive an input image corresponding to a scene and an output, the processing being configured to execute the instructions to perform scene obstruction detection on the input image by;

dividing the input image into a plurality of blocks;

applying horizontal and vertical high pass filtering to obtain, for each block, a respective horizontal high frequency content (HFC) value and a respective vertical HFC value;

determining a first mean and a first standard deviation based on the horizontal HFC values of the blocks;

determining a second mean and a second standard deviation based on the vertical HFC values of the blocks;

forming a multi-dimensional feature vector having components corresponding at least to the first mean, the first standard deviation, the second mean, and the second standard deviation;

classifying the input image as either obstructed or unobstructed by comparing a value computed based on the components of the feature vector to a decision boundary threshold, wherein the classification of the input image as either obstructed or unobstructed is based on a result of the comparison of the value to the decision boundary threshold, wherein the input image is classified as unobstructed when the value is less than the decision boundary threshold and is classified as obstructed when the value is greater than or equal to the decision boundary threshold; and

outputting, by the output, a result of the classification.

17. An image processing system comprising:

a memory to store instructions; and

a processor having an input to receive an input image corresponding to a scene and an output, the processing being configured to execute the instructions to perform scene obstruction detection on the input image by;

dividing the input image into a plurality of blocks;

applying horizontal and vertical high pass filtering to obtain, for each block, a respective horizontal high frequency content (HFC) value and a respective vertical HFC value;

determining a first mean and a first standard deviation based on the horizontal HFC values of the blocks;

determining a second mean and a second standard deviation based on the vertical HFC values of the blocks;

forming a multi-dimensional feature vector having components corresponding at least to the first mean, the first standard deviation, the second mean, and the second standard deviation, wherein forming the multi-dimensional feature vector having the components corresponding at least to the first mean, the first standard deviation, the second mean, and the second standard deviation further includes adding at least one additional component to the feature vector;

classifying the input image as either obstructed or unobstructed by comparing a value computed based on the components of the feature vector to a decision boundary threshold, wherein the classification of the input image as either obstructed or unobstructed is based on a result of the comparison of the value to the decision boundary threshold; and

outputting, by the output, a result of the classification.

18. The image processing system of claim 17, wherein the at least one additional component includes one or more of image brightness information, meta information, or temporal difference information.