Estimation of picture motion blurriness

• US 9,288,393 B2
• Filed: 04/30/2012
• Issued: 03/15/2016
• Est. Priority Date: 05/03/2011
• Status: Expired due to Fees

• Current Assignee: ST-Ericcson SA (Telefonaktiebolaget LM Ericsson)
• Original Assignee: ST-Ericcson SA (Telefonaktiebolaget LM Ericsson)
• Inventors: Chouly, Antoine, Lesellier, Estelle
• Primary Examiner(s): Hannett, James
• Application Number:
  US14/113,447
• Publication Number:
  US 20140132784A1
• Time in Patent Office: 1,415 Days
• Field of Search: 348/208.14
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20201 Motion blur correction
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/6811 based on the image signal

Abstract

The invention relates to a method for estimating a blurriness value based on a series of at least two frames acquired within a period of time greater than or equal to a given exposure time, the frames being grouped in at least one couple of frames, characterized in that it comprises determining, for each couple of frames of the series, first and second values corresponding to a displacement according to a first direction and a second direction, between the first frame and the second frame of a couple of frames, determining a first blur measure for one direction among the first and second directions by calculating a metric based on the displacement values for each couple of frames of at least a subset of the series, determining a second blur measure for the other direction among the first and second directions by calculating a metric applied to the displacement values for each couple of frames of the series of frames and determining a blurriness value based on the first and second blur measures.

Claims

1. A method for estimating a blurriness value, comprising

acquiring a series of at least two frames within a period of time greater than a given exposure time to be used for acquisition of a still picture being distinct from the at least two frames;

grouping said at least two frames in at least one couple of frames;

determining, for each of the at least one couple of frames of the series, first and second displacement values corresponding to a displacement according to a first direction and a second direction, between a first frame and a second frame of a couple of frames;

determining a first blur measure for one direction among said first and second directions by calculating a metric based on the first and second displacement values for each of the at least one couple of frames of at least a subset of said series;

determining a second blur measure for the other direction among the first and second directions by calculating a metric applied to said first and second displacement values for each of the at least one couple of frames of the series of frames; and

determining a blurriness value based on said first and second blur measures.

2. The method according to claim 1, wherein the blurriness value is determined as being one of:

a greatest value among the first blur measure and the second blur measure;

an average value of the first blur measure and the second blur measure;

a weighted average value of the first blur measure and the second blur measure; and

a weighted sum of a greatest value among the first blur measure and the second blur measure and an average value of the first blur measure and the second blur measure.

3. The method according to claim 1, wherein an inter-frame duration being associated to each of the at least one couple of frames of the series, the inter-frame duration being defined by the interval of time between the acquisitions of a first frame and a second frame of the couple of frames, the first and second displacement values for each of the at least one couple of frames of at least the subset of the series of frames are weighted in the metric by the inter-frame duration of the couple of frames to determine at least the first blur measure.

4. The method according to claim 3, further comprising selecting the subset of frames among the series of frames, the sum of the inter-frame durations of each of the at least one couple of frames of the subset being greater than or equal to the exposure time, said subset comprising the last acquired frame of the series of frames.

5. The method according to claim 1, further comprising:

acquiring at least one new frame in the series of frames and determining the first and second displacement values between said new frame and a last acquired frame of the series of frames, said new frame being added to the series of frames to obtain a new series of frames;

determining, first and second displacement values corresponding to a displacement according to a first direction and a second direction, between the last acquired frame of the series of frames and the new frame, said last acquired frame of the series of frames and said new frame forming a couple of frames of the new series;

determining at least a new first blur measure for one direction among said first and second directions by calculating a metric based on the first and second displacement values for each couple of frames of at least a subset of said new series; and

determining a new blurriness value based on at least said new first blur measure.

6. The method according to claim 5, wherein step of determining the new first blur measure for the new series of frames is processed on the basis of the first blur measure of the series of frames and on the basis of the first and second displacement values between said new frame and the last acquired frame of the series of frames.

7. The method according to claim 1, wherein the first and second displacement values are determined in video resolution, the method further comprising applying a scaling factor to the blurriness value to estimate a blur in photo resolution, said scaling factor being an increasing function of a photo and video resolution ratio.

13. A non-transitory computer readable storage medium, with a program stored thereon, said program comprising instructions for the implementation of the method according to claim 1.

8. A device for estimating a blurriness value, comprising:

a frame acquisition unit adapted to acquire a series of at least two frames within a period of time greater than or equal to a given exposure time to be used for the acquisition of a still picture being distinct from the at least two frames, said frames being grouped in at least one couple of frames;

a motion estimation unit adapted to determine for each of the at least one couple of frames of the series, first and second displacement values corresponding to a displacement according to a first direction and a second direction, between a first frame and a second frame of a couple of frames; and

a calculation unit adapted to determine a first blur measure for one direction among said first and second directions by calculating a metric applied to the first and second displacement values for each of the at least one couple of frames of at least a subset of said series, to determine a second blur measure for the other direction among the first and second directions by calculating a metric applied to said first and second displacement values for each of the at least one couple of frames of the series of frames and to determine a blurriness value based on said first and second blur measures.

9. The device according to claim 8, further comprising a timer unit adapted to associate an inter-frame duration to each of the at least one couple of frames of the series, the inter-frame duration being defined by the interval of time between the acquisitions of a first frame and a second frame of the couple of frames and wherein the first and second displacement values for each of the at least one couple of frames of at least the subset of the series of frames are weighted by the calculation unit in the metric by the inter-frame duration of the couple of frames to determine at least the first blur measure.

10. The device according to claim 8, wherein the motion estimation unit is adapted to determine the first and second displacement values in video resolution and the calculation unit is adapted to apply a scaling factor to the blurriness value to estimate a blur in photo resolution, said scaling factor being an increasing function of a photo and video resolutions ratio.

11. The device according to claim 8, further comprising:

a decision unit adapted to take a decision to acquire a picture based on the determined blurriness value;

a picture acquisition unit adapted to acquire said picture depending on said decision.

12. The device according to claim 11, wherein the picture acquisition unit is also adapted to acquire the series of at least two frames within the period of time greater than or equal to the given exposure time.

14. A method for estimating a blurriness value based on a series of at least two frames acquired within a period of time greater than or equal to a given exposure time, said frames being grouped in at least one couple of frames, wherein the method comprises:

determining, for each of the at least one couple of frames of the series, first and second displacement values corresponding to a displacement according to a first direction and a second direction, between a first frame and a second frame of a couple of frames;

determining a first blur measure for one direction among said first and second directions by calculating a metric based on the first and second displacement values for each of the at least one couple of frames of at least a subset of said series;

determining a second blur measure for the other direction among the first and second directions by calculating a metric applied to said first and second displacement values for each of the at least one couple of frames of the series of frames; and

determining a blurriness value based on said first and second blur measures;

taking a decision to acquire a picture based on the determined blurriness value;

acquiring said picture depending on said decision.

15. A device for estimating a blurriness value based on a series of at least two frames acquired within a period of time greater than or equal to a given exposure time, said frames being grouped in at least one couple of frames, wherein the device comprises:

a motion estimation unit adapted to determine for each of the at least one couple of frames of the series, first and second displacement values corresponding to a displacement according to a first direction and a second direction, between a first frame and a second frame of a couple of frames;

a calculation unit adapted to determine a first blur measure for one direction among said first and second directions by calculating a metric applied to the first and second displacement values for each of the at least one couple of frames of at least a subset of said series, to determine a second blur measure for the other direction among the first and second directions by calculating a metric applied to said first and second displacement values for each of the at least one couple of frames of the series of frames and to determine a blurriness value based on said first and second blur measures;

a decision unit adapted to take a decision to acquire a picture based on the determined blurriness value; and

a picture acquisition unit adapted to acquire said picture depending on said decision.