Compensating for blooming of a shape in an image

• US 8,970,707 B2
• Filed: 05/04/2009
• Issued: 03/03/2015
• Est. Priority Date: 12/17/2008
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Marks, Richard Lee, Mikhailov, Anton, Larsen, Eric
• Primary Examiner(s): KATSIKIS, KOSTAS J
• Application Number:
  US12/435,226
• Publication Number:
  US 20100149340A1
• Time in Patent Office: 2,129 Days
• Field of Search: 348/169, 348/221.1, 348/241, 348/222.1, 382/254, 382/263, 382/264, 382/272, 382/274, 382/275, 382/194, 382/221, 382/255, 382/295, 382/296, 382/298, 382/299, 382/254.255, 382/206
• US Class Current: 348/169
• CPC Class Codes: G06T 5/30 Erosion or dilatation, e.g. thinning
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 25/621 for the control of blooming

Abstract

A number of brightness samples are taken outside a shape to compensate for blooming of the shape in an image generated by a digital camera. The brightness of each of the samples is determined and averaged, and the size of the shape is adjusted based on the difference between the brightness of the shape and the average of the brightness samples.

Claims

1. A method to compensate for blooming of a shape of an ellipse in an image that has been generated by a digital video camera, comprising:

sampling a plurality of pixels outside of the shape of the ellipse;

determining a brightness of each of the sampled pixels;

averaging the brightness of those sampled pixels;

determining a semi-major axis of the ellipse; and

compensating for blooming of the shape based on the difference between a brightness of the shape and the average brightness of the sampled pixels, wherein the compensating for blooming includes applying an empirical data mapping to adjust the semi-major axis based on the difference between the brightness of the shape and the average brightness of the sampled pixels.

2. The method of claim 1, wherein the brightness of the shape is determined by:

sampling one or more pixels within the shape in the image;

determining a brightness of each of the sampled one or more pixels within the shape; and

averaging those sampled pixels to determine the brightness of the shape.

3. The method of claim 1, wherein the brightness of the shape is known.

4. A method to compensate for blooming of a shape of an ellipse in an image generated by a digital camera, comprising:

determining an edge of the shape of the ellipse;

sampling a plurality of pixels outside of the edge of the shape along a corresponding plurality of radii for the shape, each beginning at a centroid of the shape and ending at an edge of the shape;

determining a brightness of each of the sampled pixels; and

for each sampled pixel, adjusting the corresponding radius for the shape based on a difference between a brightness inside the edge of the shape and the brightness of the sampled pixel.

5. The method of claim 4, wherein the adjustment of the corresponding radius is based on empirical mapping data.

6. The method of claim 4, wherein the determining the edge of the shape includes determining the location and dimensions of the shape in the image.

7. The method of claim 4, wherein the brightness inside the edge of the shape is determined by:

sampling one or more pixels inside the edge of the shape in the image;

determining a brightness of each of the sampled one or more pixels; and

averaging those sampled pixels to determine the brightness of the shape.

8. The method of claim 4, wherein the brightness inside the edge of the shape is known.

9. A non-transitory machine-readable storage medium that provides instructions that, if executed by a processor, will cause said processor to perform operations to compensate for blooming of a shape of an ellipse in an image that has been generated by a digital camera, the operations comprising:

sampling a plurality of pixels outside of the shape;

determining a brightness of each of the sampled pixels;

averaging the brightness of those sampled pixels;

determining a semi-major axis of the ellipse; and

compensating for blooming of the shape based on the difference between a brightness of the shape and the average brightness of the sampled pixels, wherein the compensating for blooming includes applying an empirical data mapping to adjust the semi-major axis based on the difference between the brightness of the shape and the average brightness of the sampled pixels.

10. The non-transitory machine-readable storage medium claim 9, wherein the brightness of the shape is determined by:

sampling one or more pixels within the shape in the image;

determining a brightness of each of the sampled one or more pixels within the shape; and

averaging those sampled pixels to determine the brightness of the shape.

11. The non-transitory machine-readable storage medium claim 9, wherein the brightness of the shape is known.

12. A computing device to compensate for blooming of an object projected as an ellipse shape on an image that has been generated by a digital camera, the computing device comprising:

a processor to execute instructions; and

a memory coupled with the processor, the memory having instructions that, when executed, cause the processor to perform operations including,

sampling a plurality of pixels outside of the ellipse shape,

determining a brightness of each of the sampled pixels,

averaging the brightness of those sampled pixels,

determining a semi-major axis of the ellipse shape, and

compensating for blooming of the ellipse shape based on the difference between a brightness of the ellipse shape and the average brightness of the sampled pixels, wherein the compensating for blooming includes applying an empirical data mapping to adjust the semi-major axis based on the difference between the brightness of the ellipse shape and the average brightness of the sampled pixels.

13. The computing device of claim 12, wherein the brightness of the shape is determined by:

sampling one or more pixels within the shape in the image;

determining a brightness of each of the sampled one or more pixels within the shape; and

averaging those sampled pixels to determine the brightness of the shape.

14. The computing device of claim 12, wherein the brightness of the shape is known.

15. A computing device to compensate for blooming of an object projected as a shape of an ellipse on an image, the computing device, comprising:

a processor to execute instructions; and

a memory coupled with the processor, the memory having instructions that, when executed, cause the processor to perform operations including;

determining an edge of the shape of the ellipse,

sampling a plurality of pixels outside of the edge of the shape along a corresponding plurality of radii for the shape, each beginning at a centroid of the shape and ending at an edge of the shape,

determining a brightness of each of the sampled pixels, and

for each sampled pixel, adjusting the corresponding radius for the shape based on a difference between a brightness inside the edge of the shape and the brightness of the sampled pixel.

16. The computing device of claim 15, wherein the adjustment of the corresponding radius is based on empirical mapping data.

17. The computing device of claim 15, wherein the determining the edge of the shape includes determining the location and dimensions of the shape in the image, wherein the edge of the shape includes pixels immediately surrounding the shape.

18. The computing device of claim 15, wherein the brightness inside the edge of the shape is determined by:

sampling one or more pixels inside the edge of the shape in the image;

determining a brightness of each of the sampled one or more pixels; and

averaging those sampled pixels to determine the brightness of the shape.

19. The computing device of claim 15, wherein the brightness inside the edge of the shape is known.

20. A non-transitory machine-readable storage medium that provides instructions that, if executed by a processor, will cause said processor to perform operations to compensate for blooming of a shape of an ellipse in an image generated by a digital camera, the operations comprising:

determining an edge of the shape of the ellipse;

sampling a plurality of pixels outside of the edge of the shape along a corresponding plurality of radii for the shape, each beginning at a centroid of the shape and ending at an edge of the shape;

determining a brightness of each of the sampled pixels; and

for each sampled pixel, adjusting the corresponding radius for the shape based on a difference between a brightness inside the edge of the shape and the brightness of the sampled pixel.

21. The non-transitory machine-readable storage medium of claim 20, wherein the brightness of the shape is determined by:

sampling one or more pixels inside the edge of the shape in the image;

determining a brightness of each of the sampled one or more pixels; and

averaging those sampled pixels to determine the shape'"'"'s brightness.

22. The non-transitory machine-readable storage medium of claim 20, wherein the brightness inside the edge of the shape is known.

23. The non-transitory machine-readable storage medium of claim 20, wherein the adjustment of the corresponding radius is based on empirical mapping data.

24. The non-transitory machine-readable storage medium of claim 20, wherein determining the edge of the shape includes determining the location and dimension of the shape in the image.

25. A method to compensate for blooming of a shape of an ellipse in an image that has been generated by a digital video camera, comprising:

sampling a plurality of pixels outside of the shape of the ellipse;

determining a brightness of each of the sampled pixels;

averaging the brightness of those sampled pixels;

determining a semi-major axis of the ellipse; and

compensating for blooming of the shape based on the difference between a brightness of the shape and the average brightness of the sampled pixels, wherein the compensating for blooming includes adjusting the semi-major axis based on the difference between the brightness of the shape and the average brightness of the sampled pixels.