System and method for image upsampling using natural image statistics of first and second derivatives
First Claim
1. A system, comprising:
- one or more processors; and
a memory coupled to the one or more processors and storing program instructions executable by the one or more processors to implement;
accessing data representing an input image to be upsampled;
for each of a plurality of potential upsampling solutions;
evaluating the potential upsampling solution with respect to an objective function, wherein the objective function is dependent on a sparse derivative prior in which sparse derivative prior probabilities for one or more second derivatives of the potential upsampling solution are multiplied by sparse derivative prior probabilities for one or more first derivatives of the potential upsampling solution;
identifying one of the plurality of potential upsampling solutions as an acceptable solution, dependent on said evaluating;
storing the identified solution as a higher-resolution version of the input image.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for upsampling input images may evaluate potential upsampling solutions with respect to an objective function that is dependent on a sparse derivative prior on second derivative(s) of the potential upsampling solutions to identify an acceptable higher-resolution output image. The objective function may also be dependent on fidelity term(s) and/or sparse derivative prior(s) on first derivative(s) of potential upsampling solutions. The methods may include applying the iteratively re-weighted least squares procedure in minimizing the objective function and generating improved candidate solutions from an initial solution. The identified solution may be stored as a higher-resolution version of the input image in memory, and made available to subsequent operations in an image editing application or other graphics application. The methods may produce sharp results that are also smooth along edges. The methods may be implemented as program instructions stored on computer-readable storage media, executable by a CPU and/or GPU.
58 Citations
35 Claims
-
1. A system, comprising:
-
one or more processors; and a memory coupled to the one or more processors and storing program instructions executable by the one or more processors to implement; accessing data representing an input image to be upsampled; for each of a plurality of potential upsampling solutions; evaluating the potential upsampling solution with respect to an objective function, wherein the objective function is dependent on a sparse derivative prior in which sparse derivative prior probabilities for one or more second derivatives of the potential upsampling solution are multiplied by sparse derivative prior probabilities for one or more first derivatives of the potential upsampling solution; identifying one of the plurality of potential upsampling solutions as an acceptable solution, dependent on said evaluating; storing the identified solution as a higher-resolution version of the input image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer-readable storage medium, storing program instructions computer-executable to implement:
-
accessing data representing an input image to be upsampled; for each of a plurality of potential upsampling solutions; evaluating the potential upsampling solution with respect to an objective function, wherein the objective function is dependent on a sparse derivative prior in which sparse derivative prior probabilities for one or more second derivatives of the potential upsampling solution are multiplied by sparse derivative prior probabilities for one or more first derivatives of the potential upsampling solution; identifying one of the plurality of potential upsampling solutions as an acceptable solution, dependent on said evaluating; storing the identified solution as a higher-resolution version of the input image. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A method, comprising
performing, by a computer: -
accessing data representing an input image to be upsampled; for each of a plurality of potential upsampling solutions; evaluating the potential upsampling solution with respect to an objective function, wherein the objective function is dependent on a sparse derivative prior in which sparse derivative prior probabilities for one or more second derivatives of the potential upsampling solution are multiplied by sparse derivative prior probabilities for one or more first derivatives of the potential upsampling solution; identifying one of the plurality of potential upsampling solutions as an acceptable solution, dependent on said evaluating; and storing the identified solution as a higher-resolution version of the input image. - View Dependent Claims (28, 29, 30, 31, 32, 33, 34)
-
-
35. A computer-implemented method, comprising:
-
executing instructions on a specific apparatus so that binary digital electronic signals representing an input image to be upsampled are accessed in memory; executing instructions on said specific apparatus so that binary digital electronic signals representing each of a plurality of potential upsampling solutions are evaluated with respect to an objective function, wherein the objective function is dependent on a sparse derivative prior in which sparse derivative prior probabilities for one or more second derivatives of the potential upsampling solution are multiplied by sparse derivative prior probabilities for one or more first derivatives of the potential upsampling solution; executing instructions on said specific apparatus so that binary digital electronic signals representing one of the plurality of potential upsampling solutions is identified as an acceptable solution, dependent on said evaluating; and storing the binary digital electronic signals representing the identified solution as a higher-resolution version of the input image in a memory location of said specific apparatus for later use.
-
Specification