System, method and a computer readable medium for providing an output image

• US RE47,534 E1
• Filed: 03/15/2018
• Issued: 07/23/2019
• Est. Priority Date: 04/23/2007
• Status: Active Grant

• Current Assignee: Ramot at Tel Aviv University Limited (Tel Aviv University)
• Original Assignee: Ramot at Tel Aviv University Limited (Tel Aviv University)
• Inventors: Wolf, Lior, Guttman, Moshe, Cohen-or, Daniel
• Primary Examiner(s): LaRose, Colin M
• Application Number:
  US15/922,462
• Time in Patent Office: 495 Days
• CPC Class Codes: N/A

Abstract

A method for providing an output image, the method includes: determining an importance value for each input pixels out of multiple input pixels of an input image; applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image; wherein the input image differs from the output image.

Claims

1. A method for providing an output image, the method comprising:

determining an importance value for each input pixels out of multiple input pixels of an input image;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the determining is responsive to motion associated with each of the multiple input pixels.

2. The method according to claim 1 wherein the determining is responsive to a saliency score of the input pixels.

3. The method according to claim 1 wherein the determining is responsive to an inclusion of an input pixel within an input image area that represents a face of a person.

4. The method according to claim 1 wherein the determining is responsive to an inclusion of an input pixel within an input image area that represents an object of interest.

5. A method for providing an output image, the method comprising:

determining an importance value for each input pixels pixel out of multiple input pixels of an input image, wherein the importance value is at least based on a saliency score, the saliency score based on at least one of;

spatial constraints, object detection and/or motion detection for each of the multiple input pixels;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein a distance between output image representations of a pair of adjacent input pixels is responsive to an importance of at least one of pair of adjacent input pixels; and

outputting the output image.

16. The method of claim 5 wherein the saliency score is based on the spatial constraints, the object detection and the motion detection for each of the multiple input pixels.

6. A method for providing an output image, the method comprising:

determining an importance value for each input pixels out of multiple input pixels of an input image;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the applying is responsive to at least one of the following constraints;

each input pixel is mapped to an output pixel that is located at substantially a fixed distance from its left and right neighbors;

each input pixel is mapped to an output pixel located to substantially a similar location to which upper and lower input pixels are mapped;

an input pixel is mapped to an output pixel located substantially at a same location as an output pixel to which the same input pixel at a previous image was mapped; and

size and shape of the output image.

7. A method for providing an output image, the method comprising:

determining an importance value for each input pixels out of multiple input pixels of an input image;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the determining is responsive to a saliency score of the input pixels;

wherein the saliency score is computed by applying a wavelet decomposition process.

8. A method for providing an output image, the method comprising:

determining an importance value for each input pixels pixel out of multiple input pixels of an input image, wherein the importance value is at least based on a saliency score, the saliency score based on at least one of;

spatial constraints, object detection and/or motion detection for each of the multiple input pixels;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the determining is responsive to a saliency score of the input pixels;

wherein the saliency score is computed by locating the coarsest diagonal high frequency frame in which the percentage of wavelet coefficients having values below a first threshold is below a second threshold; and

outputting the output image.

17. The method of claim 8 wherein the saliency score is based on the spatial constraints, the object detection and the motion detection for each of the multiple input pixels.

9. A method for providing an output image, the method comprising:

determining an importance value for each input pixels pixel out of multiple input pixels of an input image, wherein the importance value is at least based on a saliency score, the saliency score based on at least one of;

spatial constraints, object detection and/or motion detection for each of the multiple input pixels;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the determining is responsive to a saliency score of the input pixels;

wherein the saliency score is computed by applying a wavelet decomposition process;

wherein the wavelet decomposition process is followed by thresholding a diagonal high frequency image to generate a binary frame;

re-scaling the binary frame; and

smoothing the re-scaled binary frame, and

outputting the output image.

18. The method of claim 9 wherein the saliency score is based on the spatial constraints, the object detection and the motion detection for each of the multiple input pixels.

10. A method for providing an output image, the method comprising:

determining an importance value for each input pixels out of multiple input pixels of an input image;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

wherein the applying is preceded by applying a data reduction stage; and

applying on each of the results of the data reduction stage a conversion process that is responsive to the importance value of the results to provide converted results.

11. A method for providing an output image, the method comprising:

determining an importance value for each input pixels out of multiple input pixels of an input image;

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image;

wherein the input image differs from the output image;

determining an importance value for each input pixels out of multiple input pixels of a group of input images; and

applying on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form group of output images;

wherein inputs image differs from output images.

12. A device for providing an output image, the device comprising:

a memory unit adapted to store an input image and a processor, adapted to;

determine an importance value for each input pixels pixel out of multiple input pixels of an input image and apply on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image, wherein the importance value is at least based on a saliency score, the saliency score based on at least one of;

spatial constraints, object detection and/or motion detection for each of the multiple input pixels;

wherein the input image differs from the output image;

wherein the processor is adapted to determine an importance of an one or the multiple input pixel pixels in response to motion associated with each of the multiple input pixels and output the output image.

13. The device according to claim 12 wherein the processor is adapted to determine an importance of an input pixel in response to a saliency score of the input pixels.

14. The device according to claim 12 wherein the processor is adapted to determine an importance of an input pixel in response to an inclusion of an input pixel within an input image that represents a face of a person.

19. The device of claim 12 wherein the saliency score is based on the spatial constraints, the object detection and the motion detection for each of the multiple input pixels.

15. A device for providing an output image, the device comprising:

a memory unit adapted to store an input image and a processor, adapted to;

determine an importance value for each input pixels pixel out of multiple input pixels of an input image and apply on each of the multiple input pixels a conversion process that is responsive to the importance value of the input pixel to provide multiple output pixels that form the output image, wherein the importance value is at least based on a saliency score, the saliency score based on at least one of;

spatial constraints, object detection and/or motion detection for each of the multiple input pixels;

wherein the input image differs from the output image;

wherein the processor is adapted to apply a conversion process in response to at least one of the following constraints;

each input pixel is mapped to an output pixel that is located at substantially a fixed distance from its left and right neighbors;

each input pixel is mapped to an output pixel located to substantially a similar location to which upper and lower input pixels are mapped;

an input pixel is mapped to an output pixel located substantially at a same location as an output pixel to which the same input pixel at a previous image was mapped; and

size and shape of the output image; and

output the output image.

20. The device of claim 15 wherein the saliency score is based on the spatial constraints, the object detection and the motion detection for each of the multiple input pixels.