Background removal tool for a presentation application

• US 9,619,471 B2
• Filed: 06/20/2014
• Issued: 04/11/2017
• Est. Priority Date: 08/06/2007
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Flider, Mark, Zimmer, Mark Alan
• Primary Examiner(s): CHEN, FRANK S
• Application Number:
  US14/311,147
• Publication Number:
  US 20140300630A1
• Time in Patent Office: 1,026 Days
• Field of Search: None
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A presentation application for masking portions of an object, such as the background of an image, is provided. The presentation application may provide a background removal tool that allows a user to define an initial point in the background of the object. The presentation application may establish an initial background color based on the initial point, and may compute and automatically adjust a color tolerance of the background color based on the distance that a user-controlled cursor is from the initial point. Using a seed-fill algorithm, the presentation application can select a contiguous portion of the object for masking that includes the initial point and surrounding pixels that are within the background color tolerance. To smoothen the edges of the contiguous portion, the presentation application can convert the portion to a vector graphic before making the object.

Claims

1. A method of displaying a graphical object, the method comprising:

in a presentation application executing on an electronic device;

receiving a selection of a portion of a graphical object;

identifying an unknown pixel from the graphical object based on the selected portion;

identifying a plurality of neighboring pixels for the unknown pixel;

determining an alpha value for the unknown pixel that indicates a degree to which the unknown pixel is part of a foreground of the graphical object, the determination being based, at least in part, on determining a pixel of least resistance from among the plurality of neighboring pixels and determining whether the pixel of least resistance is in a direction that opposes a guidance vector;

designating, based on the alpha value, the unknown pixel as part of at least one of the foreground or a background of the graphical object;

creating a bitmap of the foreground only or the background only in response to the designation;

converting the bitmap to a vector graphic of the selected portion;

generating a masked graphical object by masking the vector graphic; and

displaying the masked graphical object using a display coupled to the electronic device.

2. The method of claim 1, wherein creating a bitmap comprises:

converting one selected from the foreground and the background to a black bitmap object; and

converting one selected from the foreground and the background that has not been converted into the black bitmap object to a white bitmap object.

3. The method of claim 1, wherein converting the bitmap comprises performing a tracing algorithm on the bitmap.

4. The method of claim 1, wherein generating the masked graphical object comprises hiding the vector graphic without deleting information about the graphical object.

5. The method of claim 1, wherein generating the masked graphical object comprises performing a Boolean addition of the vector graphic with the graphical object.

6. The method of claim 1, wherein the vector graphic is smoothened with respect to the bitmap.

7. The method of claim 1, wherein generating the masked graphical object comprises combining the vector graphic with one or more previously computed masks.

8. The method of claim 1, wherein generating the masked graphical object comprises:

generating a new mask to hide the vector graphic without deleting information about the graphical object;

applying a plurality of masks, including the new mask, to the graphical object while leaving the graphical object unchanged; and

storing the unchanged graphical object and the plurality of masks.

9. The method of claim 1, further comprising:

determining, using a seed-fill algorithm, one or more areas in the graphical object based on a color tolerance that is computed to indicate a threshold difference between a color of an initial point in the graphical object and a same or similar color of the one or more areas; and

designating the determined one or more areas as part of the foreground only or the background only.

10. An electronic device configured to display a graphical object, the electronic device comprising:

a processor configured to;

receive, during execution of a presentation application, a selection of a portion of a graphical object;

identify an unknown pixel of the graphical object based on the selected portion;

identify a plurality of neighboring pixels for the unknown pixel;

determine an alpha value for the unknown pixel that indicates a degree to which the unknown pixel is part of a foreground of the graphical object, the determination being based, at least in part on, determining a pixel of least resistance from among the plurality of neighboring pixels and determining whether the pixel of least resistance is in a direction that opposes a guidance vector;

designate, based on the alpha value, the unknown pixel as part of at least one of the foreground or a background of the graphical object;

create a bitmap of the foreground only or the background only in response to the designation;

convert the bitmap to a vector graphic;

generate a masked graphical object by masking the vector graphic; and

cause the masked graphical object to be displayed using a display coupled to the electronic device.

11. The electronic device of claim 10, wherein the processor being configured to create a bitmap comprises the processor being configured to:

convert one selected from the foreground and the background to a black bitmap object; and

convert one selected from the foreground and the background that has not been converted into the black bitmap object to a white bitmap object.

12. The electronic device of claim 10, wherein the processor being configured to convert the bitmap comprises the processor being configured to:

perform a tracing algorithm on the bitmap.

13. The electronic device of claim 10, wherein the processor being configured to generate the masked graphical object comprises the processor being configured to hide the vector graphic without deleting information about the graphical object.

14. The electronic device of claim 10, wherein the processor being configured to generate the masked graphical object comprises the processor being configured to:

perform a Boolean addition of the vector graphic with the graphical object.

15. The electronic device of claim 10, wherein the vector graphic is smoothened with respect to the bitmap.

16. The electronic device of claim 10, wherein the processor being configured to generate the masked graphical object comprises the processor being configured to:

combine the vector graphic with one or more previously computed masks.

17. The electronic device of claim 10, wherein the processor being configured to generate the masked graphical object comprises the processor being configured to:

generate a new mask to hide the vector graphic without deleting information about the graphical object;

apply a plurality of masks, including the new mask, to the graphical object while leaving the graphical object unchanged; and

store the unchanged graphical object and the plurality of masks.

18. The electronic device of claim 10, wherein the processor is further configured to:

determine, using a seed-fill algorithm, one or more areas in the graphical object based on a color tolerance that is computed to indicate a threshold difference between a color of an initial point in the graphical object and a same or similar color of the one or more areas; and

designate the determined one or more areas as part of the foreground only or the background only.

19. A non-transitory computer readable storage device encoded with one or more instructions for displaying a graphical object, which when executed by a computer system, cause the computer system to:

receive during execution of a presentation application, a selection of a portion of a graphical object;

identify an unknown pixel from the graphical object based on the selected portion;

identify a plurality of neighboring pixels for the unknown pixel;

determine an alpha value for the unknown pixel that indicates a degree to which the unknown pixel is part of a foreground of the graphical object, the determination being based, at least in part on, determining a pixel of least resistance from among the plurality of neighboring pixels and determining whether the pixel of least resistance is in a direction that opposes a guidance vector;

designate, based on the alpha value, the unknown pixel as part of at least one of the foreground or a background of the graphical object;

create a bitmap of the foreground only or the background only in response to the designation;

convert the bitmap to a vector graphic;

generate a masked graphical object by masking the vector graphic; and

cause the masked graphical object to be displayed using a display coupled to the electronic device.

20. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to create a bitmap comprise one or more instructions, which when executed by the computer system, cause the computer system to:

convert one selected from the foreground and the background to a black bitmap object; and

convert the object one selected from the foreground and the background that has not been converted into the black bitmap object to a white bitmap object.

21. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to convert the bitmap comprise one or more instructions, which when executed by the computer system, cause the computer system to perform a tracing algorithm on the bitmap.

22. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to generate the masked graphical object comprise one or more instructions that cause the computer system to hide the vector graphic without deleting information about the graphical object.

23. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to generate the masked graphical object comprise one or more instructions, which when executed by the computer system, cause the computer system to perform a Boolean addition of the vector graphic with the graphical object.

24. The non-transitory computer readable storage device of claim 19, wherein the vector graphic is smoothened with respect to the bitmap.

25. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to generate the masked graphical object comprise one or more instructions, which when executed by the computer system, cause the computer system to combine the vector graphic with one or more previously computed masks.

26. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions that cause the computer system to generate the masked graphical object comprise one or more instructions, which when executed by the computer system, cause the computer system to:

generate a new mask to hide the vector graphic without deleting information about the graphical object;

apply a plurality of masks, including the new mask, to the graphical object while leaving the graphical object unchanged;

store the unchanged graphical object and the plurality of masks.

27. The non-transitory computer readable storage device of claim 19, wherein the one or more instructions comprise one or more additional instructions, which when executed by the computer system, cause the computer system to:

determine, using a seed-fill algorithm, one or more areas in the graphical object based on a color tolerance that is computed to indicate a threshold difference between a color of an initial point in the graphical object and a same or similar color of the one or more areas; and

designate the determined one or more areas as part of the foreground only or the background only.