User-aided image segmentation

• US 8,891,864 B2
• Filed: 06/03/2011
• Issued: 11/18/2014
• Est. Priority Date: 02/16/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pettigrew, Daniel, Bryant, Andrew
• Primary Examiner(s): Allison, Andrae S
• Application Number:
  US13/134,308
• Publication Number:
  US 20120210274A1
• Time in Patent Office: 1,264 Days
• Field of Search: None
• US Class Current: 382/167
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607

Abstract

Some embodiments provide a program that provides a graphical user interface (GUI). The GUI includes a display area for displaying an image that includes several pixels. Each pixel includes a set of pixel values in a three-dimensional color space. The GUI includes a first selectable GUI item for activating a color masking tool (1) for selecting a set of pixels in the image and (2) for defining a three-dimensional volume to encompass the pixel values of the set of pixels in the three-dimensional color space. The three-dimensional volume serves as an approximation of a rectangular cuboid that has at least one rounded corner. The GUI includes a second selectable GUI item for applying a color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the three-dimensional volume in the three-dimensional color space.

Claims

1. A non transitory machine readable medium storing a program which when executed by at least one processing unit provides a graphical user interface (GUI), the GUI comprising:

a display area for displaying an image comprising a plurality of pixels, each pixel comprising a set of pixel values in a three dimensional color space;

a first selectable GUI item for activating a color masking tool for selecting a set of pixels in the image, defining a rectangular cuboid to encompass the pixel values of the set of pixels in the three dimensional color space, and defining a three dimensional volume within the rectangular cuboid that encompasses the pixel values of the set of pixels, wherein the three dimensional volume has at least one rounded corner in order to create a tighter fit around the pixel values of the set of pixels; and

a second selectable GUI item for applying a color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the three dimensional volume in the three dimensional color space.

2. The non transitory machine readable medium of claim 1, wherein each corner of the three dimensional volume is a rounded corner.

3. The non transitory machine readable medium of claim 1, wherein the three dimensional volume is a superellipsoid.

4. The non transitory machine readable medium of claim 1, wherein the set of pixels is a first set of pixels, the rectangular cuboid is a first rectangular cuboid, and the three dimensional volume is a first three dimensional volume, wherein the color masking tool is further for selecting a second set of pixels in the image, defining a second rectangular cuboid to encompass the pixel values of the second set of pixels in the three dimensional color space, and defining a second three dimensional volume within the second rectangular cuboid that encompasses the pixel values of the second set of pixels, wherein the second three dimensional volume has at least one rounded corner in order to create a tighter fit around the pixel values of the set of pixels.

5. The non transitory machine readable medium of claim 4, wherein the second selectable GUI item is further for applying the color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the second three dimensional volume in the three dimensional color space.

6. The non transitory machine readable medium of claim 4, wherein the second set of pixels includes at least one pixel in the first set of pixels.

7. The non transitory machine readable medium of claim 4, wherein the second set of pixels in the image includes at least one pixel in the image that has pixel values that are encompassed by the first three dimensional volume.

8. The non transitory machine readable medium of claim 1, wherein the color masking tool is a first color masking tool, the set of pixels is a first set of pixels, and the three dimensional volume is a first three dimensional volume, wherein the GUI further comprises a third selectable GUI item for activating a second color masking tool for selecting a second set of pixels in the image and defining a second three dimensional volume to encompass the pixel values of the second set of pixels in the three dimensional color space, the second three dimensional volume having at least one rounded corner and serving as an approximation of a rectangular cuboid.

9. The non transitory machine readable medium of claim 1, wherein the image is a still image.

10. The non transitory machine readable medium of claim 1, wherein the image is a frame of a video clip.

11. The non transitory machine readable medium of claim 1, wherein the three dimensional color space is an RGB color space.

12. The non transitory machine readable medium of claim 11, wherein the set of pixel values comprises a red component value, a green component value, and a blue component value.

13. The non transitory machine readable medium of claim 1, wherein the set of pixels in the image is a first set of pixels, wherein the GUI further comprises a third selectable GUI item for invoking a shape masking tool comprising an adjustable mask for display in the display area and a set of selectable GUI items for adjusting the adjustable mask.

14. The non transitory machine readable medium of claim 13, wherein the adjustable mask is a rectangle with rounded corners.

15. The non transitory machine readable medium of claim 13, wherein the adjustable mask is a superellipse.

16. A method of providing a graphical user interface (GUI), the method comprising:

providing a display area for displaying an image comprising a plurality of pixels, each pixel comprising a set of pixel values in a three dimensional color space;

providing a first selectable GUI item for activating a color masking tool for selecting a set of pixels in the image, defining a rectangular cuboid to encompass the pixel values of the set of pixels in the three dimensional color space, and defining a three dimensional volume within the rectangular cuboid that encompasses the pixel values of the set of pixels, wherein the three dimensional volume has at least one rounded corner in order to create a tighter fit around the pixel values of the set of pixels; and

providing a second selectable GUI item for applying a color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the three dimensional volume in the three dimensional color space.

17. The method of claim 16, wherein each corner of the three dimensional volume is a rounded corner.

18. The method of claim 16, wherein the three dimensional volume is a superellipsoid.

19. The method of claim 16, wherein the set of pixels is a first set of pixels, the rectangular cuboid is a first rectangular cuboid, and the three dimensional volume is a first three dimensional volume, wherein the color masking tool is further for selecting a second set of pixels in the image, defining a second rectangular cuboid to encompass the pixel values of the second set of pixels in the three dimensional color space, and defining a second three dimensional volume within the second rectangular cuboid that encompasses the pixel values of the second set of pixels, wherein the second three dimensional volume has at least one rounded corner in order to create a tighter fit around the pixel values of the set of pixels.

20. The method claim 19, wherein the second selectable GUI item is further for applying the color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the second three dimensional volume in the three dimensional color space.

21. The method of claim 16, wherein the color masking tool is a first color masking tool, the set of pixels is a first set of pixels, and the three dimensional volume is a first three dimensional volume, wherein the method further comprises providing a third selectable GUI item for activating a second color masking tool for selecting a second set of pixels in the image and defining a second three dimensional volume to encompass the pixel values of the second set of pixels in the three dimensional color space, the second three dimensional volume having at least one rounded corner and serving as an approximation of a rectangular cuboid.

22. A method of providing user interface (GUI), the method comprising:

providing a display area for displaying an image comprising a plurality of pixels, each pixel comprising a set of pixel values in a three dimensional color space;

providing a first selectable GUI item for activating a color masking tool for;

selecting a first set of pixels and a second set of pixels in the image;

defining a first three dimensional volume to encompass pixel values of the first set of pixels in the three dimensional color space and a second three dimensional volume to encompass pixels values of the second set of pixels in the three dimensional color space, the first and second three dimensional volumes each having at least one rounded corner and serving as approximations of rectangular cuboids;

identifying a portion of the first three dimensional volume in the three dimensional color space that does not collide with the second three dimensional volume in the three dimensional color space; and

determining a third three dimensional volume in the three-dimensional color space that includes the identified portion of the first three dimensional volume in the three dimensional color space; and

providing a third selectable GUI item for applying a color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the third three dimensional volume in the three dimensional color space.

23. The method of claim 22, wherein the first, second, and third three dimensional volumes are superellipsoids.

24. A method of providing a graphical user interface (GUI), the method comprising:

providing a display area for displaying an image comprising a plurality of pixels, each pixel comprising a set of pixel values in a three dimensional color space;

providing a first selectable GUI item for activating a color masking tool for (1) selecting a set of pixels in the image and defining a first three dimensional volume, serving as an approximation of a rectangular cuboid having at least one rounded corner, to encompass pixel values of the set of pixels in the three dimensional color space, wherein pixels in the image that have pixel values included in the first three dimensional volume are fully selected, and (2) identifying, in the three dimensional color space, a second three dimensional volume that defines a transition region about the first three dimensional volume, wherein each point of the surface of the second three dimensional volume is within an offset distance from at least one point on the surface of the first three dimensional volume, wherein pixels in the image that have pixel values included in the defined transition region are partially selected; and

providing a second selectable GUI item for applying a color correction operation to the image by modifying pixels in the image that have pixel values encompassed by the three dimensional volumes in the three dimensional color space, wherein the second selectable GUI item applies the color correction operation to the image by fully applying the color correction operation to pixels in the image that are fully selected and partially applying the color correction operation to pixels in the image that are partially selected.

25. The method of claim 24, wherein the first and second three dimensional volumes in the three dimensional color space are superellipsoids.

26. The method of claim 24, wherein the first and second three dimensional volumes in the three dimensional color space are non-spherical shapes.