Systems and methods for enhanced image adaptation

• US 7,260,261 B2
• Filed: 02/20/2003
• Issued: 08/21/2007
• Est. Priority Date: 02/20/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ma, Wei-Ying, Xie, Xing, Zhang, Hong-Jiang, Fan, Xin, Chen, Liqun
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): Rosario; Dennis
• Application Number:
  US10/371,125
• Publication Number:
  US 20040165784A1
• Time in Patent Office: 1,643 Days
• Field of Search: 382/180, 382/195, 382/239, 382/173, 382/229
• US Class Current: 382/173
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06T 7/00 Image analysis
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/462 Salient features, e.g. scale invariant feature transforms [SIFT]

Abstract

Systems and methods for adapting images for substantially optimal presentation by heterogeneous client display sizes are described. In one aspect, an image is modeled with respect to multiple visual attentions to generate respective attention objects for each of the visual attentions. For each of one or more image adaptation schemes, an objective measure of information fidelity (IF) is determined for a region R of the image. The objective measures are determined as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object in the region R. A substantially optimal adaptation scheme is then selected as a function of the calculated objective measures. The image is then adapted via the selected substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area of the client display.

Claims

1. A method for enhanced image adaptation for a display device having a target area T, the method comprising:

modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;

assigning a respective attention value to each attention object, the attention value indicating a relative importance of image information represented by the attention object as compared to other ones of the attention objects;

indicating a respective weight for each of the visual attentions;

for each visual attention, adjusting assigned attention values of corresponding attention objects based on corresponding visual attention weight, the adjusting comprising;

normalizing the assigned attention values to a unit interval; and

computing adjusted attention values according to;

${\mathrm{AV}}_i=w_k·<br><br>{\mathrm{AV}}_i^k,$

wherein AV_i is an adjusted attention value for attention object i derived from a visual attention model k, w_k is a weight of the visual attention model k, and AV_i^k is a normalized attention value of attention object AO_i detected for the visual attention model k;

for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of a resource constraint of the display device and as a function of a weighted sum of IF of a value of each attention object (AO_i) in the region R;

selecting a substantially optimal adaptation scheme from among the one or more image adaptation schemes, each image adaptation scheme ranked as a function of, at least, its determined objective measure of information fidelity IF with respect to the region R; and

adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.

2. A method as recited in claim 1, wherein the multiple visual attentions are based on saliency, face, and text attention models.

3. A method as recited in claim 1, wherein each objective measure is unique as compared to each other objective measure(s).

4. A method as recited in claim 1, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.

5. A method as recited in claim 1, wherein the image is contained in composite content comprising other images, and wherein modeling the image further comprises determining a context of the image as compared to respective contexts of the other images to assist in determining attention object attributes of the image.

6. A method as recited in claim 1, wherein the weighted sum of information fidelity (IF) of each (i) attention object (AO) in the region R is based on:

${\mathrm{IF}}_R=\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i};<br><br>$

and

wherein ROI_i is a spatial size of AO_i.

7. A method as recited in claim 1, wherein selecting the substantially optimal adaptation scheme further comprises searching a region of the image for an attention object set that represents higher IF after adaptation as compared to collective IF values of other attention object sets after adaptation.

8. A method as recited in claim 1, wherein selecting the substantially optimal adaptation scheme further comprises calculating the substantially optimal adaptation scheme via integer programming and use of a branch and bound algorithm.

9. A method as recited in claim 1, wherein selecting the substantially optimal adaptation scheme is based on the following:

$\begin{array}{c}\underset{I}{\max }<br><br>\left({\mathrm{IF}}_I\right)=<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>u\left(r_I^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right)\right)\\ =<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i\right)<br><br><br><br>\forall <br><br>\mathrm{valid}<br><br><br><br>I⋐<br><br>\left\{{\mathrm{AO}}_1,{\mathrm{AO}}_2,\mathrm{\dots <br><br>}<br><br><br><br>{\mathrm{AO}}_N\right\};<br><br>\mathrm{and}\end{array}$

wherein I is a set of AOs, ROI is a spatial size of AO_i, and MPS_i is a minimal perceptible size beyond which AO_i is not to be reduced.

10. A method as recited in claim 1, wherein adapting the image via the substantially optimal adaptation scheme to generate an adapted image further comprises iteratively scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) by extending and/or contracting the region while keeping I_opt valid.

11. A method as recited in claim 1, wherein adapting the image further comprises scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) according to the following scaling equation:

$r_{I_{\mathrm{opt}}}^{\max }=\underset{{\mathrm{AO}}_i\in <br><br>I_{\mathrm{opt}}}{\max }<br><br>\left({\mathrm{MPS}}_i/\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)\right);<br><br>$

wherein MPS_i is the Minimal Perceptible Size of AO_i, wherein ROI_i is a spatial area of AO_i in the image; and

wherein the sealing equation is solved such that I_opt remains valid and such that the region r is scaled to a largest region within target area T.

12. A method as recited in claim 1, wherein adapting the image further comprises seating the region R comprising a determined set of optimal attention objects (I_opt) such that I_opt remains valid and such that the region R is scaled to a highest resolution to fit within target area T.

13. A method as recited in claim 1, wherein the weighted sum of information fidelity (IF) of each (i) attention object (AO) in the region R is based on:

$\hspace{1em}<br><br>\begin{array}{c}{\mathrm{IF}}_R=\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i}\\ =\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>u\left(r_R^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right);<br><br>\end{array}$

wherein u(x) is defined as

$u<br><br>\left(x\right)=\{\begin{array}{cc}1,& \mathrm{if}<br><br><br><br>x\ge <br><br>0\\ 0,& \mathrm{otherwise}\end{array};<br><br>$

 

and

wherein ROI_i is a spatial size of AO_i, wherein size(x) calculates the spatial size, and r_R denotes a ratio of image scaling down.

14. A method as recited in claim 13, wherein the ratio of image scaling down is computed as follows:

$r_R=\min <br><br>\left(\frac{{\mathrm{Width}}_T}{{\mathrm{Width}}_R},\frac{{\mathrm{Height}}_T}{{\mathrm{Height}}_R}\right);<br><br>$

and

wherein Width_T, Height_T, Width_R, and Height_R represent widths and heights of target area T and solution region R, respectively.

15. A computer-readable medium storing computer-executable instructions for enhanced image adaptation for a display device having a target area T, the computer-executable instructions comprising instructions for:

modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;

for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of, at least;

a resource constraint of the display device; and

a weighted sum of an information fidelity of each attention object (AO_i) in the region R based on;

${\mathrm{IF}}_R=\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i},$

wherein IF_R corresponds to the weighted sum, ROI_i is a spatial size of the attention object AO_i, AV_i is a value of the attention object AO_i, and IF_AOi is the information fidelity of the attention object AO_i;

selecting a substantially optimal adaptation scheme from among the one or more image adaptation schemes, each image adaptation scheme ranked as a function of, at least, its determined objective measure of information fidelity IF with respect to the region R; and

adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T.

16. A computer-readable medium as recited in claim 15, wherein the multiple visual attentions are based on saliency, face, and text attention models.

17. A computer-readable medium as recited in claim 15, wherein each objective measure is unique as compared to each other objective measure(s).

18. A computer-readable medium as recited in claim 15, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.

19. A computer-readable medium as recited in claim 15, wherein the image is contained in composite content comprising other images, and wherein the instructions for modeling the image further comprises determining a context of the image as compared to respective contexts of the other images to assist in determining attention object attributes of the image.

20. A computer-readable medium as recited in claim 15, and wherein the computer-executable instructions further comprise instructions for:

assigning a respective attention value to each attention object, the attention value indicating a relative importance of image information represented by the attention object as compared to other ones of the attention objects;

indicating a respective weight for each of the visual attentions; and

for each visual attention, adjusting assigned attention values of corresponding attention objects based on corresponding visual attention weight.

21. A computer-readable medium as recited in claim 20, wherein the instructions for adjusting assigned attention values further comprise instructions for:

normalizing the assigned attention values to (0,

     1); and

computing adjusted attention values as follows;

${\mathrm{AV}}_i=w_k·<br><br>\stackrel{\_}{{\mathrm{AV}}_i^k},$

wherein AV_i is an adjusted attention value for attention object i derived from visual attention model k, w_k is the weight of the visual attention model k, and AV_i^k is a normalized mention value of attention object AO_i detected in the visual attention model k.

22. A computer-readable medium as recited in claim 15, wherein the instructions for selecting the substantially optimal adaptation scheme further comprise instructions for searching a region of the image for an attention object set that represents higher IF after adaptation as compared to collective IF values of other attention object sets after adaptation.

23. A computer-readable medium as recited in claim 15, wherein the instructions for selecting the substantially optimal adaptation scheme further comprise instructions for calculating the substantially optimal adaptation scheme via integer programming and use of a branch and bound algorithm.

24. A computer-readable medium as recited in claim 15, wherein the instructions for selecting the substantially optimal adaptation scheme is based on the following:

$\begin{array}{c}\underset{I}{\max }<br><br>\left({\mathrm{IF}}_I\right)=<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>u\left(r_I^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right)\right)\\ =<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i\right)<br><br><br><br>\forall <br><br>\mathrm{valid}<br><br><br><br>I⋐<br><br>\left\{{\mathrm{AO}}_1,{\mathrm{AO}}_2,\mathrm{\dots <br><br>}<br><br><br><br>{\mathrm{AO}}_N\right\};<br><br>\mathrm{and}\end{array}$

wherein I is a set of AOs, ROI is a spatial size of AO_i, and MPS_i is a minimal perceptible size beyond which AO_i is not to be reduced.

25. A computer-readable medium as recited in claim 15, wherein the instructions for adapting the image further comprise instructions for iteratively scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) by extending and/or contracting the region while keeping I_opt valid.

26. A computer-readable medium as recited in claim 15, wherein the instructions for adapting the image further comprise instructions for scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) according to the following scaling equation:

$r_{I_{\mathrm{opt}}}^{\max }=\underset{{\mathrm{AO}}_i\in <br><br>I_{\mathrm{opt}}}{\max }<br><br>\left({\mathrm{MPS}}_i/\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)\right);<br><br>$

wherein MPS_i is the Minimal Perceptible Size of AO_i, wherein ROI_i is a spatial area of AO_i in the image; and

wherein the scaling equation is solved such that I_opt remains valid and such that the region r is scaled to a largest region within target area T.

27. A computer-readable medium as recited in claim 15, wherein the instructions for adapting the image further comprise instructions for scaling the region R comprising a determined set of optimal attention objects (I_opt) such that I_opt remains valid and such that the region R is scaled to a highest resolution to fit within target area T.

28. A computer-readable medium as recited in claim 15, wherein the weighted sum of information fidelity (IF) of each (i) attention object (AO) in the region R is based on:

$\begin{array}{c}{\mathrm{IF}}_R=\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i}\\ =\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>u\left(r_R^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right);<br><br>\end{array}$

wherein u(x) is defined as

$u<br><br>\left(x\right)=\{\begin{array}{cc}1,& \mathrm{if}<br><br><br><br>x\ge <br><br>0\\ 0,& \mathrm{otherwise}\end{array};<br><br>$

 

and

wherein ROI_i is a spatial size of AO_i, wherein size(x) calculates the spatial size, and r_R denotes a ratio of image scaling down.

29. A computer-readable medium as recited in claim 28, wherein the ratio of image scaling down is computed as follows:

$r_R=\min <br><br>\left(\frac{{\mathrm{Width}}_T}{{\mathrm{Width}}_R},\frac{{\mathrm{Height}}_T}{{\mathrm{Height}}_R}\right);<br><br>$

and

wherein Width_T, Height_T, Width_R, and Height_R represent widths and heights of target area T and solution region R, respectively.

30. A computing device for enhanced image adaptation for a display device having a target area T, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program executable instructions executable by the processor for, at least;

modeling an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;

for each of one or more image adaptation schemes, determining a respective objective measure of information fidelity (IF) of a region R of the image as a function of, at least;

a resource constraint of the display device; and

a weighted sum of an information fidelity of each attention object (AO_i) in the region R;

selecting a substantially optimal adaptation scheme from among the one or more image adaptation schemes, each image adaptation scheme ranked as a function of, at least, its determined objective measure of information fidelity IF with respect to the region R; and

adapting the image via the substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area T, the adapting comprising;

scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) according to the following scaling equation;

$r_{I_{\mathrm{opt}}}^{\max }=\underset{{\mathrm{AO}}_i\in <br><br>I_{\mathrm{opt}}}{\max }<br><br>\left({\mathrm{MPS}}_i/\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)\right);<br><br>$

wherein MPS_i is a minimum perceptible size of AO_i, and ROI_i is a spatial area of AO_i in the image; and

wherein the scaling equation is solved such that I_opt remains valid and such that the region r is scaled to a largest region within the target area T.

31. A computing device as recited in claim 30, wherein the multiple visual attentions are based on saliency, face, and text attention models.

32. A computing device as recited in claim 30, wherein each objective measure is unique as compared to each other objective measure(s).

33. A computing device as recited in claim 30, wherein resource constraint comprises one or more of spatial region size (T), color depth, and/or ratio of compression.

34. A computing device as recited in claim 30, wherein the image is contained in composite content comprising other images, and wherein the instructions for modeling the image further comprises determining a context of the image as compared to respective contexts of the other images to assist in determining attention object attributes of the image.

35. A computing device as recited in claim 30, and wherein the computer-executable instructions further comprise instructions for:

assigning a respective attention value to each attention object, the attention value indicating a relative importance of image information represented by the attention object as compared to other ones of the attention objects;

indicating a respective weight for each of the visual attentions; and

for each visual attention, adjusting assigned attention values of corresponding attention objects based on corresponding visual attention weight.

36. A computing device as recited in claim 35, wherein the instructions for adjusting assigned attention values further comprise instructions for:

normalizing the assigned attention values to (0,

     1); and

computing adjusted attention values as follows;

${\mathrm{AV}}_i=w_k·<br><br>\stackrel{\_}{{\mathrm{AV}}_i^k},$

wherein AV_i is an adjusted attention value for attention object i derived from visual attention model k, w_k is the weight of the visual attention model k, and AV_i^k is a normalized attention value of attention object AO_i detected in the visual attention model k.

37. A computing device as recited in claim 30, wherein the weighted sum of information fidelity (IF) of each (i) attention object (AO) in the region R is based on:

${\mathrm{IF}}_R=\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i};<br><br>$

and

wherein ROI_i is a spatial size of AO_i.

38. A computing device as recited in claim 30, wherein the instructions for selecting the substantially optimal adaptation scheme further comprise instructions for searching a region of the image for an attention object set that represents higher IF after adaptation as compared to collective IF values of other attention object sets after adaptation.

39. A computing device as recited in claim 30, wherein the instructions for selecting the substantially optimal adaptation scheme further comprise instructions for calculating the substantially optimal adaptation scheme via integer programming and use of a branch and bound algorithm.

40. A computing device as recited in claim 30, wherein the instructions for selecting the substantially optimal adaptation scheme is based on the following:

$\begin{array}{c}\underset{I}{\max }<br><br>\left({\mathrm{IF}}_I\right)=<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\overset{}{\sum <br><br>}}<br><br><br><br>{\mathrm{AV}}_i·<br><br>u<br><br>\left(r_I^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right)\right)\\ =<br><br>\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_i\in <br><br>I}{\overset{}{\sum <br><br>}}<br><br><br><br>{\mathrm{AV}}_i\right)<br><br><br><br>\forall <br><br><br><br>\mathrm{valid}<br><br><br><br>I⋐<br><br>\left\{{\mathrm{AO}}_1,{\mathrm{AO}}_2,\mathrm{\dots <br><br>}<br><br><br><br>{\mathrm{AO}}_N\right\};<br><br>\mathrm{and}\end{array}$

wherein I is a set of AOs, ROI is a spatial size of AO_i, and MPS_i is a minimal perceptible size beyond which AO_i is not to be reduced.

41. A computing device as recited in claim 30, wherein the instructions for adapting the image further comprise instructions for iteratively scaling the region R to a region r comprising a determined set of optimal attention objects (I_opt) by extending and/or contracting the region while keeping I_opt valid.

42. A computing device as recited in claim 30, wherein the instructions for adapting the image further comprise instructions for scaling the region R comprising a determined set of optimal attention objects (I_opt) such that I_opt remains valid and such that the region R is scaled to a highest resolution to fit within target area T.

43. A computing device as recited in claim 30, wherein the weighted sum of information fidelity (IF) of each (i) attention object (AO) in the region R is based on:

$\begin{array}{c}{\mathrm{IF}}_R=<br><br>\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\overset{}{\sum <br><br>}}<br><br><br><br>{\mathrm{AV}}_i·<br><br>{\mathrm{IF}}_{{\mathrm{AO}}_i}\\ =<br><br>\underset{{\mathrm{ROI}}_i⋐<br><br>R}{\overset{}{\sum <br><br>}}<br><br><br><br>{\mathrm{AV}}_i·<br><br>u<br><br>\left(r_R^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right);<br><br>\end{array}$

wherein u(x) is defined as

$u<br><br>\left(x\right)=\{\begin{array}{cc}1,& \mathrm{if}<br><br><br><br>x\ge <br><br>0\\ 0,& \mathrm{otherwise}\end{array};<br><br>\mathrm{and}$

wherein ROI_i is a spatial size of AO_i, wherein size(x) calculates the spatial size, and r_R denotes a ratio of image scaling down.

44. A computing device as recited in claim 43, wherein the ratio of image scaling down is computed as follows:

$r_R=\min <br><br>\left(\begin{array}{cc}\frac{{\mathrm{Width}}_T}{{\mathrm{Width}}_R},& \frac{{\mathrm{Height}}_T}{{\mathrm{Height}}_R}\end{array}\right);<br><br><br><br>\mathrm{and}$

wherein Width_T, Height_T, Width_R, and Height_R represent widths and heights of target area T and solution region R, respectively.

45. A computer-implemented system for enhanced image adaptation for a display device having a target area T, the system comprising one or more program modules configured to, at least:

model an image with respect to a plurality of visual attentions to generate a respective set of attention objects for each attention of the visual attentions;

determine, for each of one or more image adaptation schemes, a respective objective measure of information fidelity (IF) of a region R of the image as a function of, at least;

a resource constraint of the display device; and

a weighted sum of an information fidelity of each attention object (AO_i) in the region R;

select a substantially optimal adaptation scheme from among the one or more image adaptation schemes, each image adaptation scheme ranked as a function of, at least, its determined objective measure of information fidelity IF with respect to the region R, and the selecting based on the following;

$\hspace{1em}<br><br>\begin{array}{c}\underset{I}{\max }<br><br>\left({\mathrm{IF}}_I\right)=\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_1\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i·<br><br>u<br><br>\left(r_I^2·<br><br>\mathrm{size}<br><br>\left({\mathrm{ROI}}_i\right)-{\mathrm{MPS}}_i\right)\right)\\ =\underset{I}{\max }<br><br>\left(\underset{{\mathrm{AO}}_1\in <br><br>I}{\sum <br><br>}<br><br>{\mathrm{AV}}_i\right)<br><br>\forall <br><br>\mathrm{valid}<br><br><br><br>I⋐<br><br>\left\{{\mathrm{AO}}_1,{\mathrm{AO}}_2,\mathrm{\dots <br><br>}<br><br><br><br>{\mathrm{AO}}_N\right\},\end{array}$

wherein I is a set of valid attention objects, IF_I is an information fidelity of I, AV_i is an attention value of AO_i, r_I is a scaling ratio for an image corresponding to I, size(ROI_i) is a spatial size of a region ROI_i corresponding to AO_i, MPS_i is a minimal perceptible size of AO_i, and the function u(x) has the value 1 when x is nonnegative and 0 otherwise; and

adapt the image via the substantially optimal adaptation scheme to generate an adapted image on an output display as a function of at least the target area T.

46. The system of claim 45, wherein at least one attention of the visual attentions is based on at least one of:

a saliency attention model, a face attention model, and a text attention model.

47. The system of claim 45, wherein the resource constraint comprises at least one of spatial region size, color depth, and ratio of compression.

48. The system of claim 45, wherein:

the image is contained in a composite content comprising other images; and

modeling the image further comprises determining a context of the image as compared to respective contexts of the other images to assist in determining attention object attributes of the image.

49. The system of claim 45, wherein the one or more program modules are further configured to, at least:

assign a respective attention value to each attention object, the attention value indicating a relative importance of image information represented by the attention object as compared to other ones of the attention objects;

indicate a respective weight for each of the visual attentions; and

for each visual attention, adjust assigned attention values of corresponding attention objects based on corresponding weights.