Systems and Methods for Enhanced Image Adaptation
First Claim
1. A method for enhanced image adaptation for a display device having a target area T, the method comprising:
- modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;
for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object (AOi) in the region R;
selecting a substantially optimal adaptation scheme as a function of determined objective measures of IF with respect to the region R; and
adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for adapting images for substantially optimal presentation by heterogeneous client display sizes are described. In one aspect, an image is modeled with respect to multiple visual attentions to generate respective attention objects for each of the visual attentions. For each of one or more image adaptation schemes, an objective measure of information fidelity (IF) is determined for a region R of the image. The objective measures are determined as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object in the region R. A substantially optimal adaptation scheme is then selected as a function of the calculated objective measures. The image is then adapted via the selected substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area of the client display.
-
Citations
37 Claims
-
1. A method for enhanced image adaptation for a display device having a target area T, the method comprising:
-
modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;
for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object (AOi) in the region R;
selecting a substantially optimal adaptation scheme as a function of determined objective measures of IF with respect to the region R; and
adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.
-
-
2. A method as recited in claim 0, wherein the multiple visual attentions are based on saliency, face, and text attention models.
-
3. A method as recited in claim 0, wherein each objective measure is unique as compared to each other objective measure(s).
-
4. A method as recited in claim 0, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.
-
5. A method as recited in claim 0, wherein the image is contained in composite content comprising other images, and wherein modeling the image further comprises determining a context of the image as compared to respective context(s) of the other images to assist in determining attention object attributes of the image.
-
6. A method as recited in claim 0, and wherein the method further comprises:
-
assigning a respective attention value to each attention object, the attention value indicating a relative importance of image information represented by the attention object as compared to other ones of the attention objects;
indicating a respective weight for each of the visual attentions; and
for each visual attention, adjusting assigned attention values of corresponding attention objects based on corresponding visual attention weight.
-
-
7. A method as recited in claim 0, wherein adjusting assigned attention values further comprises:
-
normalizing the assigned attention values to (0,
1); and
computing adjusted attention values as follows;
AVi=wk·
AVik ,wherein AVi is an adjusted attention value for attention object i derived from visual attention model k, wk is the weight of the visual attention model k, and AVik is a normalized attention value of attention object AOi detected in the visual attention model k.
-
-
8. (canceled)
-
9. A method as recited in claim 0, wherein selecting the substantially optimal adaptation scheme further comprises searching a region of the image for an attention object set that represents higher IF after adaptation as compared to collective IF values of other attention object sets after adaptation.
-
10. A method as recited in claim 0, wherein selecting the substantially optimal adaptation scheme further comprises calculating the substantially optimal adaptation scheme via integer programming and use of a branch and bound algorithm.
-
11. (canceled)
-
12. A method as recited in claim 0, wherein adapting the image via the substantially optimal adaptation scheme to generate an adapted image further comprises iteratively scaling the region R to a region r comprising a determined set of optimal attention objects (Iopt) by extending and/or contracting the region while keeping Iopt valid.
-
13. (canceled)
-
14. A method as recited in claim 0, wherein adapting the image further comprises scaling the region R comprising a determined set of optimal attention objects (Iopt) such that Iopt remains valid and such that the region R is scaled to a highest resolution to fit within target area T.
-
15-16. -16. (canceled)
-
17. A computer-readable medium comprising computer-executable instructions for enhanced image adaptation for a display device having a target area T, the computer-executable instructions comprising instructions for:
-
modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;
for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object (AOi) in the region R;
selecting a substantially optimal adaptation scheme as a function of determined objective measures of IF with respect to the region R; and
adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.
-
-
18. A computer-readable medium as recited in claim 0, wherein the multiple visual attentions are based on saliency, face, and text attention models.
-
19. A computer-readable medium as recited in claim 0, wherein each objective measure is unique as compared to each other objective measure(s).
-
20. A computer-readable medium as recited in claim 0, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.
-
21. A computer-readable medium as recited in claim 0, wherein the image is contained in composite content comprising other images, and wherein the instructions for modeling the image further comprises determining a context of the image as compared to respective context(s) of the other images to assist in determining attention object attributes of the image.
-
22-32. -32. (canceled)
-
33. A computing device for enhanced image adaptation for a display device having a target area T, the computing device comprising:
-
a processor; and
a memory coupled to the processor, the memory comprising computer-program executable instructions executable by the processor for;
modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;
for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object (AOi ) in the region R;
selecting a substantially optimal adaptation scheme as a function of determined objective measures of IF with respect to the region R; and
adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.
-
-
34. A computing device as recited in claim 0, wherein the multiple visual attentions are based on saliency, face, and text attention models.
-
35. A computing device as recited in claim 0, wherein each objective measure is unique as compared to each other objective measure(s).
-
36. A computing device as recited in claim 0, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.
-
37-49. -49. (canceled)
Specification