Image segmentation device

• US 5,631,975 A
• Filed: 10/19/1994
• Issued: 05/20/1997
• Est. Priority Date: 04/14/1992
• Status: Expired due to Fees

• Current Assignee: Jaques-Ariel Sirat, Lionel Bouchard, Philippe Riglet
• Original Assignee: Jaques-Ariel Sirat, Lionel Bouchard, Philippe Riglet
• Inventors: Bouchard, Lionel, Sirat, Jaques-Ariel, Riglet, Philippe
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US08/326,147
• Time in Patent Office: 944 Days
• Field of Search: 382/173, 382/174, 382/275, 382/274, 382/115, 382/107, 382/282, 382/278, 382/100, 382/270, 348/154, 348/415, 348/416, 395/118, 395/119
• US Class Current: 382/173
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 19/543 using regions

Abstract

Images having a moving pattern against a fixed or quasi-fixed background are segmented by determining a silhouette of the moving pattern, and forming a segmentation image filling the silhouette. On a pixel-by-pixel basis, differences are determined between the current image and previous images of a sequence, and compared with a threshold to form a binary image of background and useful zone. The boundaries of the useful zone are regularized, and irregularities in the useful zone and in the background are suppressed. A segmentation image is then formed within the silhouette.

Claims

1. An apparatus for producing segmentation images of a pattern moving against a background, said images being in the form of digital signals corresponding to luminance or color information for respective pixels along scanned lines, comprising:

means for determining a silhouette of a useful zone, including;

1) means for calculating differences in luminance of pixels of a present image and pixels of at least one image of a sequence of images preceding the present image,

2) means for determining respective comparisons of said differences with a threshold, and

3) means, responsive to the respective comparisons, for generating a binary image wherein each pixel is assigned a respective one of two luminance values, the two luminance values respectively representing said background and said useful zone,

means for suppressing irregularities which may affect said useful zone, including

1) means for determining an inclination of the contour between the useful zone and said background relative to a line being currently scanned,

2) a contour regularizing circuit for suppressing irregularities in a contour of said silhouette by delimiting, for each scanned line crossing said useful zone, a segment belonging to said useful zone, said circuit determining a correlation between the respective inclination for the line being currently scanned and the delimited segment on the line preceding the line being currently scanned, and

3) means for adopting a uniform luminance value inside said segment equal to a predetermined value, and

means, responsive to said silhouette and said means for suppressing irregularities, for forming a segmentation image having a uniform background and a representation of said pattern derived from said present image and said sequence of images.

2. An apparatus as claimed in claim 1, characterized in that said means for determining an inclination compares discontinuity values between two successive lines through the useful zone.

3. An apparatus as claimed in claim 1, characterized in that said one image is spaced from said present image by at least one other image of said sequence, luminance of pixels of said one other image not being used in the calculation of said differences.

4. An apparatus as claimed in claim 1, characterized in that said means for suppressing irregularities comprises:

a noise suppression circuit connected to an output of said means for determining a silhouette, for suppressing noise in a zone of said binary image corresponding to said background, and

preceding an input of said means for forming, an irregularity suppression circuit for suppressing irregularities in the contour separating said useful zone and said background,

said noise suppression and irregularity suppression circuits comprising means for calculating an average for an environment of a pixel being considered, for comparing said average with a predetermined luminance threshold, and for taking a majority decision as to the binary value adopted for the luminance of said pixel being considered.

5. An apparatus as claimed in claim 4, characterized in that said predetermined value is the maximum value on a scale of luminance levels.

6. An apparatus as claimed in claim 1, characterized in that said means for forming comprises a substitution circuit for substituting, for said binary image, an image in shades of grey or color without background, and

a circuit for suppressing effects of movement between said present image and the first of the images of said sequence of images.

7. An apparatus as claimed in claim 6, characterized in that said one image is spaced from said present image by at least one other image of said sequence, luminance of pixels of said one other image not being used in the calculation of said differences.

8. An apparatus for producing segmentation images of a pattern moving against a background, said images being in the form of digital signals corresponding to luminance or color information for respective pixels along scanned lines, comprising:

means for determining a silhouette of a useful zone, including;

1) means for calculating differences in luminance of individual pixels of a present image and corresponding individual pixels of a plurality of images from a sequence of images preceding the present image, said present image and each image of said plurality being spaced from each other by at least one respective other image of said sequence, luminance of pixels of said respective other images not being used in the calculation of said differences,

2) means for determining respective comparisons of said differences with a threshold, and

3) means, responsive to the respective comparisons, for generating a binary image wherein each pixel is assigned a respective one of two luminance values, the two luminance values respectively representing said background and said useful zone,

means for suppressing irregularities which may affect said useful zone, including

1) means for determining an inclination of the contour between the useful zone and said background relative to a line being currently scanned,

2) a contour regularizing circuit for suppressing irregularities in a contour of said silhouette by delimiting, for each scanned line crossing said useful zone, a segment belonging to said useful zone, said circuit determining a correlation between the respective inclination for the line being currently scanned and the delimited segment on the line preceding the line being currently scanned, and

3) means for adopting a uniform luminance value inside said segment equal to a predetermined value, and

means, responsive to said silhouette and said means for suppressing irregularities, for forming a segmentation image having a uniform background and a representation of said pattern derived from said present image and said sequence of images.

9. An apparatus as claimed in claim 8, characterized in that said means for determining an inclination compares discontinuity values between two successive lines through the useful zone.

10. An apparatus as claimed in claim 8, characterized in that said means for suppressing irregularities comprises a noise suppression circuit connected to an output of said means for determining a silhouette, for suppressing noise in a zone of said binary image corresponding to said background, and

preceding an input of said means for forming, an irregularity suppression circuit for suppressing irregularities in the contour separating said useful zone and said background,

said noise suppression and irregularity suppression circuits comprising means for calculating an average for an environment of a pixel being considered, for comparing said average with a predetermined luminance threshold, and for taking a majority decision as to the binary value adopted for the luminance of said pixel being considered.

11. An apparatus as claimed in claim 10, characterized in that said means for forming comprises a substitution circuit for substituting, for said binary image, an image in shades of grey or color without background, and

a circuit for suppressing effects of movement between said present image and the first of the images of said sequence of images.

12. An apparatus as claimed in claim 11, characterized in that said predetermined value is the maximum value on a scale of luminance levels.

13. An apparatus as claimed in claim 8, characterized in that said means for forming comprises a substitution circuit for substituting, for said binary image, an image in shades of grey or color without background, and

a circuit for suppressing effects of movement between said present image and the first of the images of said sequence of images.

14. An apparatus as claimed in claim 13, characterized in that said means for determining an inclination compares discontinuity values between two successive lines through the useful zone.

15. An apparatus for producing, in the form of digital signals corresponding to luminance or color information, segmentation images of a pattern moving against a background, comprising:

means for determining a silhouette of a useful zone, said silhouette having a contour, and said means for determining including means for determining signal differences between a present image and a previous image, and means, responsive to said means for determining signal differences, for generating a binary image,

means for suppressing irregularities which may affect said useful zone, and

means, responsive to said silhouette and said means for suppressing, for forming a segmentation image having a uniform background and a representation of said pattern,

said means for suppressing including a contour regularizing circuit for delimiting, for each scanned line crossing said useful zone, a segment belonging to said useful zone by determining a correlation between delimitation of a segment on the line preceding the line being currently scanned and inclination of the contour between the useful zone and said background relative to said line being currently scanned.

16. An apparatus as claimed in claim 15, characterized in that said means for suppressing irregularities comprises means for adopting a uniform luminance value inside said segment equal to a predetermined value.

17. An apparatus as claimed in claim 15, characterized in that said means for suppressing irregularities comprises a noise suppression circuit connected to an output of said means for determining a silhouette, for suppressing noise in a zone of said binary image corresponding to said background, and

preceding an input of said means for forming, an irregularity suppression circuit for suppressing irregularities in the contour separating said useful zone and said background,

said noise suppression and irregularity suppression circuits comprising means for calculating an average for an environment of a pixel being considered, for comparing said average with a predetermined luminance threshold, and for taking a majority decision as to the binary value adopted for the luminance of said pixel being considered.

18. An apparatus as claimed in claim 16, characterized in that said predetermined value is the maximum value on a scale of luminance levels.

19. An apparatus as claimed in claim 15, characterized in that said means for forming comprises a substitution circuit for substituting, for said binary image, an image in shades of grey or color without background, and

a circuit for suppressing effects of movement between said present image and the first of the images of said sequence of images.

20. An apparatus as claimed in claim 15, characterized in that said means for suppressing irregularities includes:

1) means for determining an inclination of the contour between the useful zone and said background relative to a line being currently scanned,

2) a contour regularizing circuit for suppressing irregularities in a contour of said silhouette by delimiting, for each scanned line crossing said useful zone, a segment belonging to said useful zone, said circuit determining a correlation between the respective inclination for the line being currently scanned and the delimited segment on the line preceding the line being currently scanned, and

3) means for adopting a uniform luminance value inside said segment equal to a predetermined value.

21. An apparatus as claimed in claim 20, characterized in that said means for determining an inclination compares discontinuity values between two successive lines through the useful zone.