SYSTEMS AND METHODS FOR OPTIMIZING ORDER OF IMAGE TRANSFORMATIONS

• US 20140132610A1
• Filed: 11/14/2012
• Published: 05/15/2014
• Est. Priority Date: 11/14/2012
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Lerios, Apostolos
• Granted Patent: US 9,361,659 B2
• Time in Patent Office: Days
• US Class Current: 345/501
• CPC Class Codes: G06F 9/3851 from multiple instruction streams, e.g. multistreaming
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038

Abstract

Techniques to optimize the ordering of image transformations. Ordering cost functions are applied to possible transformation orderings of image transformations of a user-selected transformation ordering. Computing costs are calculated based on the cost functions. An optimal transformation ordering is selected from the possible transformation orderings based on the computing costs. In one embodiment, a first transformation and a second transformation of the user-selected transformation ordering are swapped. In one embodiment, at least one of the ordering cost functions is based on a per-pixel cost value. In one embodiment, a fidelity loss threshold representing an acceptable level of difference between a first image resulting from the optimal transformation ordering and a second image resulting from the user-selected transformation ordering is determined. In one embodiment, selection of the optimal ordering transformation is based on satisfaction of the fidelity loss threshold.

Claims

1. A computer implemented method comprising:

applying, by a computer system, ordering cost functions to possible transformation orderings of image transformations of a user-selected transformation ordering;

calculating, by the computer system, computing costs based on the cost functions; and

selecting, by the computer system, an optimal transformation ordering from the possible transformation orderings based on the computing costs.

2. The computer implemented method of claim 1, further comprising swapping a first transformation and a second transformation of the user-selected transformation ordering.

3. The computer implemented method of claim 2, further comprising adjusting at least one of a first parameter associated with the first transformation and a second parameter associated with the second transformation.

4. The computer implemented method of claim 3, wherein the adjusting the at least one of the first parameter associated with the first transformation and the second parameter associated with the second transformation is based on at least one heuristic.

5. The computer implemented method of claim 2, wherein the swapping the first transformation and the second transformation of the user-selected transformation ordering comprises substituting an alternate technique for at least one of the first transformation and the second transformation.

6. The computer implemented method of claim 1, wherein at least one of the ordering cost functions is based on at least one of a per-pixel cost value and a function form.

7. The computer implemented method of claim 6, wherein at least one of the per-pixel cost value and the function form is based on hardware capabilities.

8. The computer implemented method of claim 1, wherein the ordering cost functions include transformation cost functions.

9. The computer implemented method of claim 1, further comprising identifying collapsing transformations from the image transformations.

10. The computer implemented method of claim 1, further comprising identifying combining transformations from the image transformations.

11. The computer implemented method of claim 1, further comprising identifying a cost savings feature based on parameters associated with at least one of the image transformations, wherein at least one of the ordering cost functions is based on the cost savings feature.

12. The computer implemented method of claim 11, wherein the cost savings feature is based on use of a technique for executing at least one of the image transformations.

13. The computer implemented method of claim 11, wherein the cost savings feature is based on use of a hardware component.

14. The computer implemented method of claim 1, further comprising determining a fidelity loss threshold representing an acceptable level of difference between a first image resulting from the optimal transformation ordering and a second image resulting from the user-selected transformation ordering.

15. The computer implemented method of claim 14, wherein the selecting the optimal ordering transformation is based on satisfaction of the fidelity loss threshold.

16. The computer implemented method of claim 1, wherein the image transformations comprise at least one of a crop, a rotate, and a shrink.

17. The computer implemented method of claim 1, wherein the calculating computing costs comprises:

calculating at least one sequence cost for at least one sequence of the possible transformation orderings; and

storing the at least one sequence cost.

18. The computer implemented method of claim 1, further comprising identifying at least one constraint associated with at least one of the image transformations of the user-selected transformation ordering, wherein the selecting an optimal transformation ordering is based on the at least one constraint.

19. A system comprising:

at least one processor; and

a memory storing instructions configured to instruct the at least one processor to perform;

applying ordering cost functions to possible transformation orderings of image transformations of a user-selected transformation ordering;

calculating computing costs based on the cost functions; and

selecting an optimal transformation ordering from the possible transformation orderings based on the computing costs.

20. A computer storage medium storing computer-executable instructions that, when executed, cause a computer system to perform a computer-implemented method comprising:

applying ordering cost functions to possible transformation orderings of image transformations of a user-selected transformation ordering;

calculating computing costs based on the cost functions; and

selecting an optimal transformation ordering from the possible transformation orderings based on the computing costs.