Interactive Segmentation of Images With Single Scribbles

• US 20090304280A1
• Filed: 07/25/2007
• Published: 12/10/2009
• Est. Priority Date: 07/25/2006
• Status: Active Grant

• Current Assignee: HumanEyes Technologies Limited
• Original Assignee: HumanEyes Technologies Limited
• Inventors: Aharoni, Nadav, Gonen, Yoav, Zomet, Assaf
• Granted Patent: US 8,594,428 B2
• Time in Patent Office: Days
• US Class Current: 382/180
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 2207/20096 Interactive definition of curve of interest
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/162 involving graph-based methods
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation

Abstract

A computer-implemented assigns attributes to an image by processing pixels of the image containing a single marked area spanning more than a single pixel that defines for a current iteration a target attribute so as to determine an optimal function that defines a respective attribute of pixels in the image. Respective attributes are assigned to pixels in the image according to the optimal function; and the attributes of the pixels are displayed.

Claims

1. A computer-implemented method for assigning attributes to an image, the method comprising:

allowing a user to mark a plurality of pixels of an image as a single marked area by a single scribble, the single marked area defines, for a current iteration, a target attribute;

determining according to the target attribute an optimal function that defines at least one respective attribute of pixels in the image;

assigning the at least one respective attributes to pixels in the image according to the optimal function; and

displaying the at least one attributes of said pixels.

3. The method according to claim 1, further including inputting a sensitivity measure to determine the size of the region that is influenced by the marked area.

4. The method according to claim 1, further including constraining pixels in the marked area to have said target attribute.

5. The method according to claim 1, further including applying an additional input constraint to pixels in the image.

6. The method according to claim 1, wherein an additional input constraint is a given assignment of attributes to pixels in the image.

7. The method according to claim 6, wherein the given assignment is the result of a previous iteration.

28. The method according to claim 1, wherein said image is an unsegmented image.

29. The method according to claim 1, wherein said single marked area having at least two sub areas each having a different of a plurality of colors.

2. (canceled)

8-9. -9. (canceled)

10. A method for assigning properties to an image or a video sequence in a video space-time volume, the method comprising:

allowing a user to use a computer selection tool during successive iterations for marking a respective single area in the image or in the video space-time volume spanning more than a single pixel, so as to assign at least one property to the pixels in said area;

computing at each iteration respective properties of pixels in the image or video, given the properties of the pixels in the marked area and given the computed result at a previous iteration; and

displaying the image so as to highlight at least one of the computed properties.

11. The method according to claim 10, wherein computing properties preserves properties assigned to the marked area and some of the properties of pixels in non-marked areas computed in a previous iteration.

12. The method according to claim 10, wherein the computed properties being used for segmenting an image to a plurality of regions or the space-time volume of a video sequence, each assigned property being respectively a classification of each image pixel to one of plurality of segments or a classification of each image pixel at each video frame to one of plurality of segments.

14. The method according to claim 10, wherein the computed properties being used for matting of an image or a video, wherein the assigned property for each pixel is respectively the portions of which it belongs to each of plurality of layers or the portions of which it belongs to each of plurality of layers.

16. The method according to claim 10, wherein the computed properties being used for a member of a group consisting of augmenting color to an image or a video sequence, changing the colors of an image or a video sequence, and removing red-eve effects from videos and images.

13. (canceled)

15. (canceled)

17-20. -20. (canceled)

21. A system (30) for assigning properties to an image or a video sequence, the system comprising:

a marking tool (33) to allow a user to mark by a single scribble during successive iterations a respective single area in the image or in a video space-time volume spanning more than a single pixel, so as to assign properties to the pixels in said area;

a computational unit (31) responsive to the properties of the marked area and to an additional input constraint for computing at each iteration respective properties of pixels in the image or video, and

a display unit (36) coupled to the computational unit for displaying the image or video.

22. The system according to claim 21, wherein the additional input constraint is a given assignment of attributes to pixels in the image.

23. The system according to claim 22, wherein the given assignment is the result of a previous iteration.

24. The system according to claim 21, wherein the given assignment is used as a boundary constraint.

25. The system according to claim 21, wherein said input is derived as an output from an external computer program.

26. The system according to claim 21, wherein the computational unit is adapted to compute said properties such that properties assigned to the marked area are preserved and some of the properties of pixels in non-marked areas computed in the previous iteration are preserved.

27. The system according to claim 21, further including a sensitivity selector (35) coupled to the computational unit for adjusting the sensitivity of the distance at which properties propagate away from marking made to said area.

31. The computer-implemented method of claim 26, wherein said segmenting is performed according to a color value in at least one of said plurality of pixels.

32. The computer-implemented method of claim 26, wherein said image is an unsegmented image.

30. A computer-implemented method for assigning attributes to an image, the method comprising:

presenting an image to a user;

allowing a user to mark a plurality of pixels of an object depicted in said image by a single scribble;

segmenting said image to create an area containing said object; and

displaying the area.