METHODS AND DEVICES FOR DETECTING CHANGES IN BACKGROUND OF IMAGES USING MULTIPLE BINARY IMAGES THEREOF AND HOUGH TRANSFORMATION

• US 20100215287A1
• Filed: 05/19/2009
• Published: 08/26/2010
• Est. Priority Date: 02/20/2009
• Status: Active Grant

• Current Assignee: Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University)
• Original Assignee: Sungkyunkwan University Foundation For Corporate Collaboration (SungKyunKwan University)
• Inventors: Lee, Sang Jun, Jin, Seung Hun, Cho, Jung Uk, Kim, Dong Kyun, Kim, Ki Hoon, Pham, Xuan Dai, Jeon, Jae Wook
• Granted Patent: US 8,355,599 B2
• Time in Patent Office: Days
• US Class Current: 382/281
• CPC Class Codes: G06T 2207/20061 Hough transform
• CPC Class Codes: G06T 2207/20068 Projection on vertical or horizontal image axis
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 10/753 Transform-based matching, e.g. Hough transform

Abstract

The invention relates to a device and method for detecting changes in background of successive images. More particularly, the invention relates to a device and method for detecting changes in background of successive images by obtaining vertically accumulated values and horizontally accumulated values from multiple binary images of previous image and current image, obtaining pairs of rows and pairs of columns based on the vertically accumulated values and horizontally accumulated values, and transforming pairs of rows and pairs of columns using Hough transformation.

Also, the invention relates to an interface system including background changes detecting device and display device connected to the background changes detecting device.

Claims

1. A device for detecting changes in background of images using multiple binary images thereof and Hough transformation, comprising:

image input module for receiving successive inputs of gray scale images;

accumulated values obtaining module for separating both previous image I_k-1 and current image I_k inputted through the image input module into same number of binary images, counting the number of pixels having pixel values within certain range of pixel values, said range of pixel values being respectively assigned to each binary image, and obtaining vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k), said vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) representing the total number of the counted pixels in each column of the previous image I_k-1 and current image I_k, said horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) representing the total number of the counted pixels in each row of the previous image I_k-1 and current image I_k;

pairs obtaining module for determining effective pairs of rows (i, i′

) of the previous image I_k-1 and current image I_k and effective pairs of columns (j, j′

) of the previous image I_k-1 and current image I_k on the basis of the accumulated values obtained by the accumulated values obtaining module; and

Hough transformation module for transforming the effective pairs using Hough transformation and determining peak values ρ

^V, θ

^V, ρ

^H, θ

^H,

wherein changes in background of images are detected from the peak values ρ

^V, θ

^V, ρ

^H, θ

^H.

2. The device according to claim 1, wherein the detected changes in background of images are determined by a₁₁, a₂₂, b₁, b₂ of the following equation.

3. The device according to claim 1, wherein the accumulated values obtaining module obtains vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) by counting the total number of pixels having pixel values within a range between

4. The device according to claim 1, wherein the pairs obtaining module determines pairs of rows (i, i′

) and pairs of columns (j, j′

) satisfying the conditions below as effective pairs of rows (i, i′

) and the effective pairs of columns (j, j′

).

5. The device according to claim 1, wherein a_min, a minimum value of a₁₁ and a₂₂, and a_max, a maximum value of a₁₁ and a₂₂ can be set up by user and the Hough transformation module performs Hough transformation in a range of θ

as follows.

6. A method for detecting changes in background of images using multiple binary images thereof and Hough transformation, comprising:

receiving successive inputs of gray scale images comprising previous image I_k-1 and current image I_k;

separating both the previous image I_k-1 and current image I_k into same number of binary images, counting the number of pixels having pixel values within certain range of pixel values, said range of pixel values being respectively assigned to each binary image, and obtaining vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k), said vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) representing the total number of the counted pixels in each column of the previous image I_k-1 and current image I_k, said horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) representing the total number of the counted pixels in each row of the previous image I_k-1 and current image I_k;

obtaining effective pairs of rows (i, i′

) of the previous image I_k-1 and current image I_k and effective pairs of columns (j, j′

) of the previous image I_k-1 and current image I_k on the basis of the accumulated values; and

transforming the effective pairs using Hough transformation and determining peak values ρ

^V, θ

^V, ρ

^H, θ

^H,

wherein the changes in background of the images are detected from the peak values ρ

^V, θ

^V, ρ

^H, θ

^H.

7. The method according to claim 6, wherein the detected changes in background of images are determined by a₁₁, a₂₂, b₁, b₂ of the following equation.

8. The method according to claim 6, wherein N binary images I^l_k-1, I^I_k (0≦

l≦

N−

1) are separated from both the previous image I_k-1 and current image I_k, and the vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) are obtained by counting the total number of pixels having pixel values within a range between

9. The method according to claim 6, wherein the pairs obtaining module determines pairs of rows (i, i′

) and pairs of columns (j, j′

) satisfying the conditions below as effective pairs of rows (i, i′

) and the effective pairs of columns (j, j′

).

10. The method according to claim 6, wherein a_min, a minimum value of a₁₁ and a₂₂, and a_max, a maximum value of a₁₁ and a₂₂ can be set up by user and the Hough transformation module performs Hough transformation in a range of θ

as follows.

11. An interface system using detection of changes in background of successive images,

background changes detecting device for detecting changes in background of gray scale images using binary images of the gray scale images, said gray scale images being inputted successively in time;

and

display device, in communication with the background changes detecting device, for displaying images for implementing interface mechanism,

wherein the display device comprises;

display window for displaying images comprising images of menu buttons for implementing the interface mechanism;

pointing means, displayed by the display window, for indicating certain menu button in the displayed images; and

controlling module for receiving the detected changes in background from the background changes detecting device, controlling the pointing means to move in real time in proportion to the detected changes in background, and controlling functions assigned to a certain menu to be performed if, with the pointing means indicating the certain menu, the current image is enlarged or abridged from the previous image beyond predetermined proportion.

12. The interface system according to claim 11, wherein the display device further comprises:

image input module for receiving successive inputs of gray scale images,

wherein the background changes detecting device, in communication with the display device, comprises;

accumulated values obtaining module for separating both previous image I_k-1 and current image I_k inputted through the image input module into same number of binary images, counting the number of pixels having pixel values within certain range of pixel values, said range of pixel values being respectively assigned to each binary image, and obtaining vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k), said vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) representing the total number of the counted pixels in each column of the previous image I_k-1 and current image I_k, said horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) representing the total number of the counted pixels in each row of the previous image I_k-1 and current image I_k;

pairs obtaining module for determining effective pairs of rows (i, i′

) of the previous image I_k-1 and current image I_k and effective pairs of columns (j, j′

) of the previous image I_k-1 and current image I_k on the basis of the accumulated values obtained by the accumulated values obtaining module; and

Hough transformation module for transforming the effective pairs using Hough transformation and determining peak values ρ

^V, θ

^V, ρ

^H, θ

^H,

wherein changes in background of images are detected from the peak values ρ

^V, θ

^V, ρ

^H, θ

^H.

13. The interface system according to claim 11, wherein the detected changes in background of images are determined by a₁₁, a₂₂, b₁, b₂ of the following equation.

14. The interface system according to claim 11, wherein N binary images I^l_k-1, I^l_k (0≦

l≦

N−

1) are separated from both the previous image I_k-1 and current image I_k, and the vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) are obtained by counting the total number of pixels having pixel values within a range between

15. The interface system according to claim 11, wherein the background changes detecting device and the display device are incorporated into one mobile device.

16. The interface system according to claim 11, wherein the display device is a mobile device and the display device is in communication with the background changes detecting device wiredly or wirelessly.

17. The interface system according to claim 11, wherein the display window displays the inputted images of gray scale.

18. An interface system using detection of changes in background of successive images,

background changes detecting device for detecting changes in background of gray scale images using binary images of the gray scale images, said gray scale images being inputted successively in time;

and

display device, in communication with the background changes detecting device, for displaying images for implementing interface mechanism,

wherein the display device comprises;

display window for displaying images comprising images of menu buttons for implementing the interface mechanism;

pointing means displayed by the display window and fixed to indicate a certain point of the display window; and

controlling module for receiving the detected changes in background from the background changes detecting device, controlling the images displayed by the display window to move in real time in proportion to the detected changes in background, and controlling functions assigned to a certain menu to be performed if, with the pointing means indicating the certain menu, the current image is enlarged or abridged from the previous image beyond predetermined proportion.

19. The interface system according to claim 18, wherein the display device further comprises:

image input module for receiving successive inputs of gray scale images,

wherein the background changes detecting device, in communication with the display device, comprises;

accumulated values obtaining module for separating both previous image I_k-1 and current image I_k inputted through the image input module into same number of binary images, counting the number of pixels having pixel values within certain range of pixel values, said range of pixel values being respectively assigned to each binary image, and obtaining vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k), said vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) representing the total number of the counted pixels in each column of the previous image I_k-1 and current image I_k, said horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) representing the total number of the counted pixels in each row of the previous image I_k-1 and current image I_k;

pairs obtaining module for determining effective pairs of rows (i, i′

) of the previous image I_k-1 and current image I_k and effective pairs of columns (j, j′

) of the previous image I_k-1 and current image I_k on the basis of the accumulated values obtained by the accumulated values obtaining module; and

Hough transformation module for transforming the effective pairs using Hough transformation and determining peak values ρ

^V, θ

^V, ρ

^H, θ

^H,

wherein changes in background of images are detected from the peak values ρ

^V, θ

^V, ρ

^H, θ

^H.

20. The interface system according to claim 18, wherein the detected changes in background of images are determined by a₁₁, a₂₂, b₁, b₂ of the following equation.

21. The interface system according to claim 18, wherein N binary images I^l_k-1, I^l_k (0≦

l≦

N−

1) are separated from both the previous image I_k-1 and current image I_k, and the vertically accumulated values h_j^V(I_k-1), h_j′

^V(I_k) and horizontally accumulated values h_i^H(I_k-1), h_i′

^H(I_k) are obtained by counting the total number of pixels having pixel values within a range between

22. The interface system according to claim 18, wherein the background changes detecting device and the display device are incorporated into one mobile device.

23. The interface system according to claim 18, wherein the display device is a mobile device and the display device is in communication with the background changes detecting device wiredly or wirelessly.

24. The interface system according to claim 18, wherein the display window displays the inputted images of gray scale.