Object based image processing

• US 9,396,409 B2
• Filed: 09/29/2014
• Issued: 07/19/2016
• Est. Priority Date: 09/29/2014
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Zavesky, Eric, Gibbon, David Crawford, Begeja, Lee, Reibman, Amy Ruth
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US14/500,689
• Publication Number:
  US 20160092751A1
• Time in Patent Office: 659 Days
• Field of Search: 382/205, 382/209, 382/218, 382/219, 382/278, 358/3.26, 358/3.27, 358/538
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2136 based on sparsity criteria, e.g. with an overcomplete basis
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06F 18/23213 with fixed number of clusters, e.g. K-means clustering
• CPC Class Codes: G06T 2207/20004 Adaptive image processing
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30168 Image quality inspection
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/40 Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/464 using a plurality of salient features, e.g. bag-of-words [BoW] representations
• CPC Class Codes: G06V 10/763 Non-hierarchical techniques, e.g. based on statistics of modelling distributions
• CPC Class Codes: G06V 10/7715 Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods

Abstract

A method includes receiving image data corresponding to an image and detecting an object represented within the image. The method further includes selecting a portion of the image data that corresponds to the object and determining object quality values based on the portion of the image data. The method also includes determining an object category corresponding to the object and accessing object category metrics associated with the object category. The method includes performing a comparison of the object quality values to the object category metrics associated with the object category and initiating an action based on the comparison.

Claims

1. A method comprising:

receiving, at an image processing device, image data corresponding to an image;

detecting an object represented within the image;

selecting a portion of the image data that corresponds to the object;

determining object quality values based on the portion of the image data;

determining an object category corresponding to the object;

accessing object category metrics associated with the object category;

performing a comparison of the object quality values to the object category metrics associated with the object category; and

initiating a first action based on the comparison, wherein the first action is associated with modifying parameters associated with image processing based on the comparison, and wherein the parameters associated with image processing include an image resolution parameter, a frame rate parameter, an encoding parameter, a bandwidth parameter, a bitrate parameter, an image capture device mode parameter, or a combination thereof.

2. The method of claim 1, wherein the first action is associated with providing a notification based on a result of the comparison.

3. The method of claim 2, wherein the notification indicates that the image data is altered.

4. The method of claim 1, further comprising initiating a second action to modify values associated with the portion of the image data based on the comparison to generate modified values.

5. The method of claim 4, further comprising outputting second image data, wherein the second image data is based on the modified values associated with the portion.

6. The method of claim 4, wherein the second action is associated with providing a notification based on a result of the comparison.

7. The method of claim 6, wherein the notification indicates that the image data was previously altered.

8. The method of claim 1, wherein the object category metrics include a sharpness metric, a blurriness metric, a low-lighting metric, a texture metric, a color metric, or a combination thereof.

9. A system comprising:

a processor; and

a memory accessible to the processor, the memory comprising instructions that, when executed by the processor, cause the processor to perform operations comprising;

receiving image data corresponding to an image;

detecting an object represented within the image;

selecting a portion of the image data that corresponds to the object;

determining object quality values based on the portion of the image data;

determining an object category corresponding to the object;

accessing object category metrics associated with the object category;

performing a comparison of the object quality values to the object category metrics associated with the object category; and

initiating a first action based on the comparison, wherein the action is associated with modifying parameters associated with image processing based on the comparison, and wherein the parameters associated with image processing include an image resolution parameter, a frame rate parameter, an encoding parameter, a bandwidth parameter, a bitrate parameter, an image capture device mode parameter, or a combination thereof.

10. The system of claim 9, wherein the operations comprise initiating a second action based on the comparison, the second action including modifying parameters associated with image processing based on the comparison, providing a notification based on a result of the comparison, or both.

11. The system of claim 9, wherein the processor and the memory are included in a mobile device.

12. The system of claim 9, wherein the processor and the memory are included in a media device.

13. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving image data corresponding to an image;

detecting an object represented within the image;

selecting a portion of the image data that corresponds to the object;

determining object quality values based on the portion of the image data;

determining an object category corresponding to the object;

accessing object category metrics associated with the object category;

performing a comparison of the object quality values to the object category metrics associated with the object category; and

initiating a first action based on the comparison, wherein the action is associated with modifying parameters associated with image processing based on the comparison, and wherein the parameters associated with image processing include an image resolution parameter, a frame rate parameter, an encoding parameter, a bandwidth parameter, a bitrate parameter, an image capture device mode parameter, or a combination thereof.

14. The computer-readable storage device of claim 13, wherein the operations further comprise:

determining a result of the comparison; and

selecting the first action from a plurality of actions based on the result of the comparison.

15. The computer-readable storage device of claim 13, wherein the first action is associated with providing a notification based on a result of the comparison.

16. The computer-readable storage device of claim 15, wherein the notification indicates that the image data is altered.

17. The computer-readable storage device of claim 13, wherein the operations further comprise initiating a second action to modify values associated with the portion of the image data based on the comparison to generate modified values.

18. The computer-readable storage device of claim 17, wherein the operations further comprise:

selecting a second portion of the image data that corresponds to a second object;

determining second object quality values based on the second portion of the image data;

accessing second object category metrics associated with a second object category that corresponds to the second object;

performing a second comparison of the second object quality values to the second object category metrics associated with the second object category; and

modifying second values associated with the second portion of the image data based on the second comparison to generate modified second values.

19. The computer-readable storage device of claim 18, wherein the operations further comprise outputting second image data, wherein the second image data is based on the modified values associated with the portion and the modified second values associated with the second portion.

20. The computer-readable storage device of claim 17, wherein the operations further comprise:

selecting a second portion of the image data that corresponds to a second object;

determining second object quality values based on the second portion of the image data;

accessing second object category metrics associated with a second object category that corresponds to the second object;

performing a second comparison of the second object quality values to the second object category metrics associated with the second object category; and

providing a notification based on a result of the second comparison.