Method and Apparatus for Detection and Removal of Rain from Videos using Temporal and Spatiotemporal Properties

• US 20130242188A1
• Filed: 11/11/2011
• Published: 09/19/2013
• Est. Priority Date: 11/15/2010
• Status: Active Grant

• Current Assignee: Indian Institute of Technology Kharagpur
• Original Assignee: Indian Institute of Technology Kharagpur
• Inventors: Tripathi, Abhishek Kumar, Mukhopadhyay, Sudipta
• Granted Patent: US 9,077,869 B2
• Time in Patent Office: Days
• US Class Current: 348/453
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 11/20 Conversion of the manner in which the individual colour picture signal components are combined, e.g. conversion of colour television standards
• CPC Class Codes: H04N 5/21 Circuitry for suppressing or minimising disturbance, e.g. moiré or halo

Abstract

The invention relates to a new method and system for detection and removal of rain from video using temporal/spatiotemporal properties. Advantageously, the temporal/spatiotemporal properties are involved to separate the rain pixels from the non-rain pixels. It is thus possible by way of the present invention to involve less number of consecutive frames, reducing the buffer size and delay. It works only on the intensity plane which reduces the complexity and execution time significantly along with accurate rain detection. This new technique does not assume the shape, size and velocity of the raindrops which makes it robust to different rain conditions. This method reduces the buffer size which reduces the system cost, delay and power consumption while maintaining sufficient quality of rain detection.

Claims

1-10. -10. (canceled)

11. A method for detection and removal of rain from video comprising:

(i) discriminating rain and non-rain moving objects pixels involving different time evolution of intensity values of a pixel at a position in the rain and non-rain regions by carrying out temporal or spatiotemporal discrimination in the single intensity plane whereby the rain and non rain moving object pixels are discriminated based on their difference in symmetry of waveform; and

(ii) inpainting of thus detected rain pixels by replacing it with the corresponding temporal mean of the intensity waveform.