Composition of digital images for perceptibility thereof

• US 8,665,286 B2
• Filed: 08/12/2010
• Issued: 03/04/2014
• Est. Priority Date: 08/12/2010
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Gustafsson, Harald, Persson, Jan Patrik, Persson, Per
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US12/855,051
• Publication Number:
  US 20120038658A1
• Time in Patent Office: 1,300 Days
• Field of Search: 345/418, 345426-428, 345/581, 345589-593, 345597-600, 345/606, 345617-619, 345629-630, 345/207, 345/690, 345/694, 345/697, 345/1.2, 345/48, 345/63, 345/77, 348552-553, 348/557, 348563-564, 348/602, 348/673, 348/702, 348/739, 358509-510, 358517-518, 358/538, 358/540, 358447-448, 358/461, 358/453, 358/463, 382 82-284, 382311-312
• US Class Current: 345/589
• CPC Class Codes: H04N 9/3182 Colour adjustment, e.g. white balance, shading or gamut white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607
• CPC Class Codes: H04N 9/3191 Testing thereof testing of displays in general G09G3/006
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

Teachings herein compose a digital image so that the image is perceptible on a viewing surface, such as a projection surface or a transparent screen. In doing so, the teachings advantageously recognize a digital image as consisting of one or more logical objects, like buttons of a user interface. Often, logical objects may be spatially arranged within the image and/or colored in different possible ways without substantially affecting the meaning conveyed by the image. Exploiting this, teachings herein evaluate light reflected from, or transmitted through, the viewing surface, and compose the digital image from one or more logical objects that have a spatial arrangement or coloration determined in dependence on that evaluation. The teachings might, for example, place a logical object within the image so that it will be displayed on a region of the surface which has high contrast with the object'"'"'s colors and/or low color variance.

Claims

1. A method of composing a digital image to provide for perceptibility of the image on a viewing surface, the method implemented by an image processor and comprising:

evaluating light reflected from, or transmitted through, the viewing surface;

composing the digital image from one or more logical objects having a spatial arrangement or coloration determined in dependence on said evaluation; and

outputting the composed digital image as digital data for display on the viewing surface.

2. The method of claim 1, wherein said composing the digital image comprises placing any given logical object at a position within the digital image that will be displayed on a region of the viewing surface which, according to said evaluation, has at least one of:

higher contrast with one or more colors of the logical object than another region; and

lower color variance than another region.

3. The method of claim 1, wherein said composing the digital image comprises selecting one or more colors for any given logical object that, according to said evaluation, have higher contrast with a region of the viewing surface onto which the logical object will be displayed than other possible colors.

4. The method of claim 1, wherein-said composing the digital image comprises:

for different positions in a set of possible positions of a given logical object within the digital image, and for different colors in a set of possible colors for the object, determining a perceptibility for the object if placed at that position and colored with that color;

determining a position and color for the object that either maximizes the object'"'"'s perceptibility or offers at least a pre-determined perceptibility; and

placing the object at that position, and selecting that color for the object.

5. The method of claim 1, wherein said evaluation comprises evaluating light reflected from, or transmitted through, different regions of the viewing surface and determining, for each region, at least one of:

the extent to which the region contrasts with one or more different colors; and

the color variance in the region.

6. The method of claim 1, wherein said evaluation comprises obtaining two different images of light reflected from, or transmitted through, the viewing surface, one image being with, and the other image being without, a pre-determined color or the digital image itself having been displayed on the surface.

7. The method of claim 6, wherein said obtaining comprises:

obtaining a first one of the two different images; and

obtaining a second one of the two different images by deriving it from the first one, the derivation including either;

digitally adding the pre-determined color or the digital image itself to the first one;

or

digitally subtracting the pre-determined color or the digital image itself from the first one.

8. The method of claim 6, wherein said evaluation further comprises either:

comparing the images to determine the extent to which the pre-determined color or the digital image itself contrasts with the viewing surface;

or

identifying a color in the image without a pre-determined color or the digital image itself having been displayed on the surface and computing or looking up in a look up table one or more colors that contrast with that identified color.

9. The method of claim 1, wherein the digital image is projected onto a first portion of the viewing surface, and wherein the method further comprises:

evaluating light reflected from a portion of the surface that is immediately adjacent to the first portion;

detecting a spatial shift from projecting the digital image onto the first portion to projecting the digital image onto a second portion that includes said adjacent portion; and

responsive to said detection, updating composition of the digital image based on the evaluation of light reflected from said adjacent portion.

10. The method of claim 1, wherein said composing the digital image comprises:

layering a first logical object underneath a second logical object;

determining a coloration for the second logical object based at least in part on that coloration having higher contrast with the coloration of the first logical object than other possible colorations; and

flattening the first and second logical objects to form a flattened digital image.

11. The method of claim 1, wherein the viewing surface comprises a front face of a substantially transparent screen, with light incident on a back face of the screen substantially transmitted through the screen to the front face, and wherein evaluating light transmitted through the viewing surface comprises evaluating light incident on the back face of the screen.

12. The method of claim 1, wherein the digital image comprises a user interface and wherein composing the digital image from one or more logical objects comprises composing the digital image from one or more user interface objects.

13. A device configured to compose a digital image to provide for perceptibility of the image on a viewing surface, the device including an image processor configured to:

evaluate light reflected from, or transmitted through, the viewing surface;

compose the digital image from one or more logical objects having a spatial arrangement or coloration determined in dependence on said evaluation; and

output the composed digital image as digital data for display on the viewing surface.

14. The device of claim 13, wherein the image processor is configured to compose the digital image by placing any given logical object at a position within the digital image that will be displayed on a region of the viewing surface which, according to said evaluation, has at least one of:

higher contrast with one or more colors of the logical object than another region; and

lower color variance than another region.

15. The device of claim 13, wherein the image processor is configured to compose the digital image by selecting one or more colors for any given logical object that, according to said evaluation, have higher contrast with a region of the viewing surface onto which the logical object will be displayed than other possible colors.

16. The device of claim 13, wherein the image processor is configured to compose the digital image by:

for different positions in a set of possible positions of a given logical object within the digital image, and for different colors in a set of possible colors for the object, determining a perceptibility for the object if placed at that position and colored with that color;

determining a position and color for the object that either maximizes the object'"'"'s perceptibility or offers at least a pre-determined perceptibility; and

placing the object at that position, and selecting that color for the object.

17. The device of claim 13, wherein the image processor is configured to evaluate light reflected from, or transmitted through, different regions of the viewing surface and to determine, for each region, at least one of:

the extent to which the region contrasts with one or more different colors; and

the color variance in the region.

18. The device of claim 13 wherein the image processor is configured to evaluate light reflected from, or transmitted through, the viewing surface by obtaining two different images of the light reflected from, or transmitted through, the viewing surface, one image being with, and the other image being without, a pre-determined color or the digital image itself having been displayed on the surface.

19. The device of claim 18, wherein the image processor is configured to obtain the two different images by:

obtaining a first one of the two different images; and

obtaining a second one of the two different images by deriving it from the first one, the derivation including either;

adding the pre-determined color or the digital image itself to the first one;

or

subtracting the pre-determined color or the digital image itself from the first one.

20. The device of claim 18, wherein the image processor is configured to evaluate light reflected from, or transmitted through, the viewing surface further by either:

comparing the images to determine the extent to which the pre-determined color or the digital image itself contrasts with the viewing surface;

or

identifying a color in the image without a pre-determined color or the digital image itself having been displayed on the surface and computing or looking up in a look up table one or more colors that contrast with that identified color.

21. The device of claim 13, wherein the digital image is projected onto a first portion of the viewing surface, and wherein the image processor is further configured to:

evaluate light reflected from a portion of the surface that is immediately adjacent to the first portion;

detect a spatial shift from projecting the digital image onto the first portion to projecting the digital image onto a second portion that includes said adjacent portion; and

responsive to said detection, update composition of the digital image based on the evaluation of light reflected from said adjacent portion.

22. The device of claim 13, wherein the image processor is configured to compose the digital image from one or more logical objects by:

layering a first logical object underneath a second logical object;

determining a coloration for the second logical object based at least in part on that coloration having higher contrast with the coloration of the first logical object than other possible colorations; and

flattening the first and second logical objects to form a flattened digital image.

23. The device of claim 13, wherein the viewing surface comprises a front face of a substantially transparent screen, with light incident on a back face of the screen substantially transmitted through the screen to the front face, and wherein the image processor is configured to evaluate light transmitted through the viewing surface by evaluating light incident on the back face of the screen.

24. The device of claim 13, wherein the digital image comprises a user interface of the device and wherein the image processor is compose the digital image from one or more user interface objects.