Editing options for image regions

• US 10,114,532 B2
• Filed: 12/06/2013
• Issued: 10/30/2018
• Est. Priority Date: 12/06/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Krishnaswamy, Aravind, Besbris, David Gary
• Primary Examiner(s): Bhatia, Ajay M
• Assistant Examiner(s): Pan, Phoebe X
• Application Number:
  US14/099,797
• Publication Number:
  US 20150160839A1
• Time in Patent Office: 1,789 Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Implementations relate to editing options for image regions. Some implementations include detecting a region portion of an image based on one or more characteristics of pixels of the image. The detected region has an identified class selected from multiple identifiable classes, and each identifiable class is associated with a set of multiple editing options. Each editing option is associated with edit operation(s) operable to adjust value(s) of one or more image pixels. One of the sets of editing options is presented for selection, where the presented set is associated with the identified class of the detected region and each of the editing options in the presented set is operable to adjust value(s) of one or more pixels of the detected region. The presented set of editing options is different from at least one of the other sets of editing options associated with the other classes.

Claims

1. A method comprising:

receiving a definition of a user-defined class of image region from a user, wherein the definition includes one or more defined image characteristics of the image region;

associating a defined set of editing options with the user-defined class of image region, wherein the defined set of editing options is selected from a plurality of available editing options, each editing option in the defined set being associated with at least one edit operation that adjusts a respective set of one or more pixel values of the image region;

detecting a region of an image based on one or more characteristics of one or more pixels of the image, wherein the detected region is a portion of the image that excludes at least one pixel of the image;

determining an identified class of the detected region from a plurality of identifiable classes of regions, wherein each of the plurality of identifiable classes of regions is associated with a respective set of one or more editing options, each editing option in each set being associated with one or more edit operations that adjust a respective set of one or more pixel values of the image, wherein the identified class is determined as the user-defined class based on a determination that one or more image characteristics of the detected region match the one or more defined image characteristics of the image region included in the definition of the user-defined class;

examining previously-selected editing options selected by multiple users of an online networked service to change pixel values of images;

examining classes of regions that include the changed pixel values from the previously-selected editing options;

determining a resulting set of editing options that include editing options selected from the previously-selected editing options based on a frequency of selection of the previously-selected editing options for the identified class of the detected region by the multiple users, wherein the resulting set of editing options are included in the set of one or more editing options associated with the identified class;

presenting the resulting set of editing options for selection, wherein each of the editing options in the resulting set adjusts a respective set of one or more pixel values of the detected region in response to being selected, and wherein the resulting set of editing options is different from at least one of the other sets of editing options associated with the identifiable classes other than the user-defined class; and

providing the definition of the user-defined class and the resulting set of editing options to one or more devices such that each editing option in the resulting set of editing options is available for selection by one or more other users with respect to one or more other images associated with the one or more other users, wherein the resulting set of editing options is configured to be presented for selection by the one or more other users in response to one or more image characteristics of one or more detected regions of the one or more other images matching the one or more defined image characteristics of the user-defined class.

2. The method of claim 1 wherein the one or more defined image characteristics are one or more image characteristics of an area of the image region delineated by input received via a drawing tool.

3. The method of claim 1 wherein the one or more defined image characteristics include one or more colors of pixels in the image region.

4. The method of claim 1 wherein the one or more defined image characteristics include a location of the image region with respect to one or more image borders.

5. The method of claim 4 wherein the location of the image region with respect to the one or more image borders includes a location within a defined image area, wherein the defined image area is at least one of a center area surrounding a center image position, or a quadrant of the image region.

6. The method of claim 1 wherein at least one editing option of the resulting set of editing options includes a convolution operation that changes a pixel value of a first pixel in the detected region and changes a pixel value of at least one pixel in a region neighboring the first pixel.

7. The method of claim 6 wherein the convolution operation includes at least one of:

a blur operation that blurs the first pixel and a plurality of neighboring pixels in the detected region;

a noise reduction operation that reduces noise in the detected region;

a local contrast enhancement operation that adjusts contrast of one or more pixels in the detected region relative to pixels neighboring the one or more pixels in the detected region; and

a sharpening operation that causes the pixel value of the first pixel to differ from pixel values of one or more neighboring pixels of the first pixel.

8. The method of claim 1 wherein the definition of the user-defined class includes one or more second image characteristics of one or more image features surrounding the image region associated with the user-defined class, wherein the one or more second image characteristics includes pixel color.

9. The method of claim 1 wherein detecting the region includes examining a plurality of different image characteristics to detect the region and determine the identified class, and wherein the plurality of different image characteristics include a texture provided by colors of pixels in the image, wherein the texture includes regularly spaced features appearing within the image.

10. The method of claim 1 wherein detecting the region includes automatically segmenting the image into a plurality of regions including the detected region, and wherein determining the identified class of the detected region includes automatically identifying the classes of the segmented regions.

11. The method of claim 1 wherein the defined set of editing options is presented for selection in response to receiving user input indicating the detected region in the image, wherein the user input includes at least one of hovering a pointer over the detected region and tapping the detected region.

12. The method of claim 1 further comprising:

receiving a selection of one of the resulting editing options; and

causing the one or more editing operations associated with the selected resulting editing option to be performed on the detected region.

13. The method of claim 1 wherein the plurality of identifiable classes include classes of different types including one or more of a face class, a landscape class, or a building class.

14. The method of claim 1 wherein the resulting set of editing options is available for selection on the one or more devices in response to an acceptance received from the one or more other users.

15. A nontransitory computer readable medium having stored thereon program instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving a definition of a user-defined class of image region from a user, wherein the definition includes one or more defined image characteristics of the image region;

associating a defined set of editing options to the user-defined class of image region, wherein the defined set of editing options is selected from a plurality of available editing options, each editing option in the defined set being associated with one or more edit operations that adjust a respective set of one or more pixel values of the image region;

detecting a region of an image based on one or more characteristics of one or more pixels of the image, wherein the detected region is a portion of the image that excludes at least one pixel of the image;

determining an identified class of the detected region from a plurality of identifiable classes of regions, wherein each of the plurality of identifiable classes of regions is associated with a respective set of one or more editing options, each editing option in each set being associated with one or more edit operations that adjust a respective set of one or more pixel values of the image, wherein the identified class is determined as the user-defined class based on a determination that one or more image characteristics of the detected region match the one or more defined image characteristics of the image region included in the definition of the user-defined class;

examining previously-selected editing options selected by multiple users of an online networked service to change pixel values of images;

examining classes of regions that include the changed pixel values from the previously-selected editing options;

determining a resulting set of editing options that include editing options selected from the previously-selected editing options based on a frequency of selection of the previously-selected editing options for the identified class of the detected region by the multiple users, wherein the resulting set of editing options are included in the set of one or more editing options associated with the identified class;

presenting the resulting set of editing options for selection, wherein each editing option of the resulting set of editing options adjusts a respective set of one or more pixel values of the detected region in the image in response to being selected, and wherein the resulting set of editing options is different from at least one of the other sets of editing options associated with the identifiable classes other than the user-defined class; and

providing the definition of the user-defined class and the resulting set of editing options to one or more devices such that each editing option in the resulting set of editing options is available for selection by one or more other users with respect to one or more other images associated with the one or more other users, wherein the resulting set of editing options is configured to be presented for selection by the one or more other users in response to one or more image characteristics of one or more detected regions of the one or more other images matching the one or more defined image characteristics of the user-defined class.

16. The method of claim 15 wherein the definition of the user-defined class includes one or more second image characteristics of one or more image features surrounding the image region associated with the user-defined class, wherein the one or more second image characteristics includes pixel color, wherein the one or more defined image characteristics are obtained from an image area selected by a user in a defining image, and wherein the one or more defined image characteristics include a location in the image area, wherein the image area is a particular quadrant of the defining image.

17. A system comprising:

a storage device; and

at least one processor accessing the storage device and operative to perform operations comprising;

detecting a region of an image based on one or more characteristics of one or more pixels of the image, wherein the region is a portion of the image that excludes at least one pixel of the image;

determining an identified class of the detected region selected from a plurality of identifiable classes of regions, wherein the identified class is a user-defined class of image region previously defined by user input, wherein the identified class is determined as the user-defined class of image region based on a determination that one or more image characteristics of the detected region match one or more defined image characteristics of the user-defined class, wherein the user-defined class is associated with a set of editing options previously defined by user input, each editing option being associated with one or more edit operations that adjust one or more values of one or more pixels of the image;

examining previously-selected editing options selected by multiple users of an online networked service to change pixel values of images;

examining classes of regions that include the changed pixel values from the previously-selected editing options;

determining a resulting set of editing options that include editing options selected from the previously-selected editing options based on a frequency of selection of the previously-selected editing options for the identified class of the detected region by the multiple users, wherein the resulting set of editing options are included in the set of editing options that is associated with the identified class;

presenting the resulting set of editing options for selection, wherein each of the editing options in the presented resulting set adjusts one or more values of one or more pixels of the detected region in response to being selected, and wherein the presented resulting set of editing options is different from at least one other set of editing options associated with identifiable classes of regions other than the identified class; and

providing the definition of the user-defined class and the resulting set of editing options to one or more devices such that each editing option in the resulting set of editing options is available for selection by one or more other users with respect to one or more other images associated with the one or more other users, wherein the resulting set of editing options is configured to be presented for selection by the one or more other users in response to one or more image characteristics of one or more detected regions of the one or more other images matching the one or more defined image characteristics of the user-defined class.

18. The system of claim 17 wherein the one or more defined image characteristics are obtained from an image area selected by the user input in a defining image, and wherein the one or more defined image characteristics include a location in the image area, wherein the image area is a particular quadrant of the defining image.