Repetitive object detecting device and method

• US 8,243,161 B2
• Filed: 07/23/2009
• Issued: 08/14/2012
• Est. Priority Date: 11/28/2008
• Status: Active Grant

• Current Assignee: JVC Kenwood Corporation
• Original Assignee: JVC Kenwood Corporation
• Inventors: Koizumi, Maki, Aiba, Hideki, Shishido, Tomoyuki
• Primary Examiner(s): MOE, AUNG SOE
• Application Number:
  US12/922,694
• Publication Number:
  US 20110007209A1
• Time in Patent Office: 1,118 Days
• Field of Search: 348/222.1, 348/441, 348/443, 348/469, 348/446, 348/459, 375/240.16
• US Class Current: 348/222.1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H04N 19/521 for estimating the reliability of the determined motion vectors or motion vector field, e.g. for smoothing the motion vector field or for correcting motion vectors
• CPC Class Codes: H04N 19/57 Motion estimation characterised by a search window with variable size or shape

Abstract

A repetitive object detecting device includes data-retention and difference-calculation units, an adding unit, a horizontal direction accumulating unit and a small and large comparing unit. Each data-retention and difference-calculation unit carries out, with respect to a plurality of lines, a process for setting as reference pixel data pixel data located at an end of a plurality of pieces of pixel data, and calculating a difference between the reference pixel data and pixel data separated from the reference pixel data by k pixels (2≦k≦maximum number) to obtain difference data by each separated pixel number k. The adding unit adds the difference data in the plurality of lines by each separated pixel number k. The horizontal direction accumulating unit accumulates the added data by each separated pixel number k in a horizontal direction. The small and large comparing unit carries out a small and large comparison with respect to the horizontal accumulated value by each separated pixel number k to decide whether or not the reference pixel data is pixel data which is located in a repetitive object including a certain repetitive pattern.

Claims

1. A repetitive object detecting device comprising:

a difference calculation unit configured to carry out, with respect to a plurality of lines, a process for setting as reference pixel data pixel data located at an end of a plurality of pieces of pixel data within a certain range in one line of a video signal, and calculating a difference between the reference pixel data and each piece of pixel data within a range from pixel data separated from the reference pixel data by two pixels to pixel data separated from the reference pixel data by the maximum number of pixels in the plurality of pieces of pixel data so as to obtain difference data by each of separated pixel numbers;

an adding unit configured to add the difference data obtained with respect to the plurality of lines by the difference calculation unit by each of the separated pixel numbers so as to obtain added data by each of the separated pixel numbers;

a horizontal direction accumulating unit configured to sequentially delay the added data obtained by each of the separated pixel numbers for a time corresponding to one pixel within a range from a time corresponding to one pixel to a time corresponding to a pixel number generated by subtracting a pixel number one from each of the separated pixel numbers, and accumulate added data before the delaying and all delayed pieces of added data so as to obtain a horizontal accumulated value by each of the separated pixel numbers in which added data obtained by each of the separated pixel numbers is accumulated in a horizontal direction; and

a small and large comparing unit configured to carry out a small and large comparison with respect to the horizontal accumulated value obtained by each of the separated pixel numbers by the horizontal direction accumulating unit so as to decide whether or not the reference pixel data is pixel data which is located in a repetitive object including a certain repetitive pattern.

2. The repetitive object detecting device according to claim 1, wherein the small and large comparing unit comprises:

a plurality of comparing portions configured to compare, with respect to each of horizontal accumulated values within a range from a horizontal accumulated value for a maximum separated pixel number to a horizontal accumulated value for a separated pixel number four among the horizontal accumulated value obtained by each of the separated pixel numbers, a first value based on a horizontal accumulated value for each separated pixel number with a second value based on a horizontal accumulated value for a separated pixel number which is about a half of the each separated pixel number; and

a decision portion configured to decide whether or not the reference pixel data is pixel data which is located in the repetitive object based on output values from the plurality of comparing portions.

3. The repetitive object detecting device according to claim 2, wherein if the each separated pixel number is an even number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of the each separated pixel number, and if the each separated pixel number is an odd number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of (the each separated pixel number −

1) or a half of (the each separated pixel number +1).

4. The repetitive object detecting device according to claim 2, wherein a plurality of adders configured to add a certain offset value to the horizontal accumulated values for the each separated pixel number to obtain the first value is included.

5. The repetitive object detecting device according to claim 2, wherein the decision portion outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object.

6. The repetitive object detecting device according to claim 5, further comprising a horizontal direction repetitive decision unit comprising:

a plurality of data retention portions configured to sequentially delay the pixel number value for a time corresponding to one pixel of the plurality of pieces of pixel data; and

a comparing decision portion configured to set any of pixel number values from the plurality of data retention portions as a first pixel number value of concerned pixel data, and compare the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.

7. The repetitive object detecting device according to claim 6, wherein the second pixel number value is a pixel number value which is about a half of the first pixel number value.

8. The repetitive object detecting device according to claim 7, wherein if the first pixel number value is an even number, the second pixel number value is a pixel number value which is a half of the first pixel number value, and if the first pixel number is an odd number, the second pixel number value is a pixel number value which is a half of (the first pixel number value −

1) or a half of (the first pixel number value +1).

9. The repetitive object detecting device according to claim 1, wherein the small and large comparing unit comprises:

a plurality of first comparing portions configured to compare, with respect to each of horizontal accumulated values within a range from a horizontal accumulated value for a maximum separated pixel number to a horizontal accumulated value for a separated pixel number four among the horizontal accumulated value obtained by each of the separated pixel numbers, a first value based on a horizontal accumulated values for each separated pixel number with a second value based on a horizontal accumulated value for a separated pixel number which is about a half of the each separated pixel number;

a plurality of second comparing portions configured to compare a third value based on the horizontal accumulated value for the each separated pixel number with a fourth value based on a horizontal accumulated value for a separated pixel number less than or a separated pixel number larger than the each separated pixel number by one;

a plurality of AND circuits configured to carry out AND operation with respect to outputs from the first comparing portions and outputs from the second comparing portions; and

a decision portion configured to decide whether or not the reference pixel data is pixel data which is located in the repetitive object based on output values from the plurality of AND circuits.

10. The repetitive object detecting device according to claim 9, wherein if the each separated pixel number is an even number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of the each separated pixel number, and if the each separated pixel number is an odd number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of (the each separated pixel number −

1) or a half of (the each separated pixel number +1).

11. The repetitive object detecting device according to claim 9, wherein a plurality of adders configured to add a certain offset value to the horizontal accumulated values for the each separated pixel number to obtain the first value is included.

12. The repetitive object detecting device according to claim 9, wherein the decision portion outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object.

13. The repetitive object detecting device according to claim 12, further comprising a horizontal direction repetitive decision unit comprising:

a plurality of data retention portions configured to sequentially delay the pixel number value for a time corresponding to one pixel of the plurality of pieces of pixel data; and

a comparing decision portion configured to set any of pixel number values from the plurality of data retention portions as a first pixel number value of concerned pixel data, and compare the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.

14. The repetitive object detecting device according to claim 13, wherein the second pixel number value is a pixel number value which is about a half of the first pixel number value.

15. The repetitive object detecting device according to claim 14, wherein if the first pixel number value is an even number, the second pixel number value is a pixel number value which is a half of the first pixel number value, and if the first pixel number is an odd number, the second pixel number value is a pixel number value which is a half of (the first pixel number value −

1) or a half of (the first pixel number value +1).

16. The repetitive object detecting device according to claim 1, wherein the difference calculation unit uses, as the plurality of pieces of pixel data, pieces of pixel data generated by reducing pieces of pixel data, which the video signal includes within the certain range, by as much as half.

17. The repetitive object detecting device according to claim 1, wherein the difference calculation unit uses, as the plurality of lines, lines each separated by one or more lines among consecutive lines which the video signal includes.

18. A repetitive object detecting method comprising:

an extracting step for extracting a plurality of pieces of pixel data within a certain range in one line of a video signal by a plurality of lines;

a difference calculating step for, with respect to the plurality of lines, setting as reference pixel data pixel data located at an end of the plurality of pieces of pixel data and calculating a difference between the reference pixel data and each piece of pixel data within a range from pixel data separated from the reference pixel data by two pixels to pixel data separated from the reference pixel data by the maximum number of pixels in the plurality of pieces of pixel data so as to obtain difference data by each of separated pixel numbers;

an adding step for adding the difference data obtained with respect to the plurality of lines by each of the separated pixel numbers so as to obtain added data by each of the separated pixel numbers;

a horizontal accumulating step for sequentially delaying the added data obtained by each of the separated pixel numbers for a time corresponding to one pixel within a range from a time corresponding to one pixel to a time corresponding to a pixel number generated by subtracting a pixel number one from each of the separated pixel numbers, and accumulating added data before the delaying and all delayed pieces of added data so as to obtain a horizontal accumulated value by each of the separated pixel numbers in which added data obtained by each of the separated pixel numbers is accumulated in a horizontal direction; and

a deciding step for carrying out a small and large comparison with respect to the horizontal accumulated value obtained by each of the separated pixel numbers so as to decide whether or not the reference pixel data is pixel data which is located in a repetitive object including a certain repetitive pattern.

19. The repetitive object detecting method according to claim 18, wherein the deciding step comprises:

a comparing step for comparing, with respect to each of horizontal accumulated values within a range from a horizontal accumulated value for a maximum separated pixel number to a horizontal accumulated value for a separated pixel number four among the horizontal accumulated value obtained by each of the separated pixel numbers, a first value based on a horizontal accumulated value for each separated pixel number with a second value based on a horizontal accumulated value for a separated pixel number which is about a half of the each separated pixel number; and

a deciding step for deciding whether or not the reference pixel data is pixel data which is located in the repetitive object based on a comparison result in the comparing step.

20. The repetitive object detecting method according to claim 19, wherein if the each separated pixel number is an even number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of the each separated pixel number, and if the each separated pixel number is an odd number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of (the each separated pixel number −

1) or a half of (the each separated pixel number +1).

21. The repetitive object detecting method according to claim 19, wherein the first value is obtained by adding a certain offset value to the horizontal accumulated values for the each separated pixel number.

22. The repetitive object detecting method according to claim 19, wherein the deciding step outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object.

23. The repetitive object detecting method according to claim 22, further comprising:

a delaying step for sequentially delaying the pixel number value for a time corresponding to one pixel of the plurality of pieces of pixel data; and

a deciding step for setting any of pixel number values delayed in the delaying step as a first pixel number value of concerned pixel data, and comparing the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.

24. The repetitive object detecting method according to claim 23, wherein the second pixel number value is a pixel number value which is about a half of the first pixel number value.

25. The repetitive object detecting method according to claim 24, wherein if the first pixel number value is an even number, the second pixel number value is a pixel number value which is a half of the first pixel number value, and if the first pixel number is an odd number, the second pixel number value is a pixel number value which is a half of (the first pixel number value −

1) or a half of (the first pixel number value +1).

26. The repetitive object detecting method according to claim 18, wherein the deciding step comprises:

a first comparing step for comparing, with respect to each of horizontal accumulated values within a range from a horizontal accumulated value for a maximum separated pixel number to a horizontal accumulated value for a separated pixel number four among the horizontal accumulated value obtained by each of the separated pixel numbers, a first value based on a horizontal accumulated values for each separated pixel number with a second value based on a horizontal accumulated value for a separated pixel number which is about a half of the each separated pixel number;

a second comparing step comparing a third value based on the horizontal accumulated value for the each separated pixel number with a fourth value based on a horizontal accumulated value for a separated pixel number less than or a separated pixel number larger than the each separated pixel number by one;

an AND operation calculating step for carrying out AND operation with respect to a comparison result in the first comparing step and a comparison result in the second comparing step; and

a deciding step for deciding whether or not the reference pixel data is pixel data which is located in the repetitive object based on a calculation result in the AND operation calculating step.

27. The repetitive object detecting method according to claim 26, wherein if the each separated pixel number is an even number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of the each separated pixel number, and if the each separated pixel number is an odd number, the horizontal accumulated value for the separated pixel number which is about a half of the each separated pixel number is a horizontal accumulated value for a separated pixel number which is a half of (the each separated pixel number −

1) or a half of (the each separated pixel number +1).

28. The repetitive object detecting method according to claim 26, wherein the first value is obtained by adding a certain offset value to the horizontal accumulated values for the each separated pixel number.

29. The repetitive object detecting method according to claim 26, wherein the deciding step outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object.

30. The repetitive object detecting method according to claim 29, further comprising:

a delaying step for sequentially delaying the pixel number value for a time corresponding to one pixel of the plurality of pieces of pixel data; and

a deciding step for setting any of pixel number values delayed in the delaying step as a first pixel number value of concerned pixel data, and comparing the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.

31. The repetitive object detecting method according to claim 30, wherein the second pixel number value is a pixel number value which is about a half of the first pixel number value.

32. The repetitive object detecting method according to claim 31, wherein if the first pixel number value is an even number, the second pixel number value is a pixel number value which is a half of the first pixel number value, and if the first pixel number is an odd number, the second pixel number value is a pixel number value which is a half of (the first pixel number value −

1) or a half of (the first pixel number value +1).

33. The repetitive object detecting method according to claim 18, wherein the extracting step extracts, as the plurality of pieces of pixel data, pieces of pixel data generated by reducing pieces of pixel data, which the video signal includes within the certain range, by as much as half.

34. The repetitive object detecting method according to claim 18, wherein the extracting step extracts the plurality of pieces of pixel data from lines each separated by one or more lines among consecutive lines which the video signal includes.

35. A repetitive object detecting device comprising:

a difference calculation unit configured to carry out, with respect to a plurality of vertical lines, a process for setting as a vertical line a pixel data column arranged in a vertical direction at a certain horizontal position of a video signal, setting as reference pixel data pixel data located at an end of a plurality of pieces of pixel data within a certain range in one vertical line, and calculating a difference between the reference pixel data and each piece of pixel data within a range from pixel data separated from the reference pixel data by two pixels in the vertical direction to pixel data separated from the reference pixel data by the maximum number of pixels in the plurality of pieces of pixel data so as to obtain difference data by each of separated pixel numbers;

an adding unit configured to add the difference data obtained by the difference calculation unit by each of the separated pixel numbers in the plurality of vertical lines so as to obtain added data by each of the separated pixel numbers;

a vertical direction accumulating unit configured to sequentially delay the added data obtained by each of the separated pixel numbers for a time corresponding to one pixel in the vertical direction within a range from a time corresponding to one pixel in the vertical direction to a time corresponding to a pixel number in the vertical direction generated by subtracting a pixel number one from each of the separated pixel numbers, and accumulate added data before the delaying and all delayed pieces of added data so as to obtain a vertical accumulated value by each of the separated pixel numbers in which added data obtained by each of the separated pixel numbers is accumulated in a vertical direction; and

a small and large comparing unit configured to carry out a small and large comparison with respect to the vertical accumulated value obtained by each of the separated pixel numbers by the vertical direction accumulating unit so as to decide whether or not the reference pixel data is pixel data which is located in a repetitive object including a certain repetitive pattern.

36. The repetitive object detecting device according to claim 35,

wherein the small and large comparing unit outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object, and

wherein the repetitive object detecting device further comprises a horizontal direction repetitive decision unit comprising:

a plurality of data retention portions configured to sequentially delay the pixel number value for a time corresponding to one line of the plurality of pieces of pixel data; and

a comparing decision portion configured to set any of pixel number values from the plurality of data retention portions as a first pixel number value of concerned pixel data, and compare the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.

37. A repetitive object detecting method comprising:

an extracting step for setting as a vertical line a pixel data column arranged in a vertical direction at a certain horizontal position of a video signal and extracting a plurality of pieces of pixel data within a certain range in one vertical line by a plurality of vertical lines;

a difference calculating step for, with respect to the plurality of vertical lines, setting as reference pixel data pixel data located at an end of the plurality of pieces of pixel data and calculating a difference between the reference pixel data and each piece of pixel data within a range from pixel data separated from the reference pixel data by two pixels in the vertical direction to pixel data separated from the reference pixel data by the maximum number of pixels in the plurality of pieces of pixel data so as to obtain difference data by each of separated pixel numbers;

an adding step for adding the difference data obtained with respect to the plurality of vertical lines by each of the separated pixel numbers so as to obtain added data by each of the separated pixel numbers;

a vertical accumulating step for sequentially delaying the added data obtained by each of the separated pixel numbers for a time corresponding to one pixel in the vertical direction within a range from a time corresponding to one pixel in the vertical direction to a time corresponding to a pixel number in the vertical direction generated by subtracting a pixel number one from each of the separated pixel numbers, and accumulating added data before the delaying and all delayed pieces of added data so as to obtain a vertical accumulated value by each of the separated pixel numbers in which added data obtained by each of the separated pixel numbers is accumulated in a vertical direction; and

a deciding step for carrying out a small and large comparison with respect to the vertical accumulated value obtained by each of the separated pixel numbers so as to decide whether or not the reference pixel data is pixel data which is located in a repetitive object including a certain repetitive pattern.

38. The repetitive object detecting method according to claim 37,

wherein the deciding step outputs a pixel number value which represents the number of pixels in one cycle of the repetitive pattern when deciding that the reference pixel data is pixel data which is located in the repetitive object, and

wherein the repetitive object detecting method further comprises:

a delaying step for sequentially delaying the pixel number value for a time corresponding to one line of the plurality of pieces of pixel data; and

a deciding step for setting any of pixel number values delayed in the delaying step as a first pixel number value of concerned pixel data, and comparing the first pixel number value with a second pixel number value which is at least one of pixel number values at past time and future time with respect to the first pixel number value to decide whether or not the concerned pixel data is pixel data which is located in the repetitive object.