Multi-level spatial resolution increase of video

• US 10,157,447 B2
• Filed: 06/23/2014
• Issued: 12/18/2018
• Est. Priority Date: 06/25/2013
• Status: Active Grant

• Current Assignee: Numeri Ltd.
• Original Assignee: Numeri Ltd.
• Inventors: Bar-On, Ilan, Kostenko, Oleg
• Primary Examiner(s): Patel, Jayanti K
• Assistant Examiner(s): Haghani, Shadan E
• Application Number:
  US14/899,290
• Publication Number:
  US 20160148346A1
• Time in Patent Office: 1,639 Days
• CPC Class Codes: G06T 3/4053 based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
• CPC Class Codes: G06T 3/4076 using the original low-resolution images to iteratively correct the high-resolution images
• CPC Class Codes: H04N 19/31 in the temporal domain
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence
• CPC Class Codes: H04N 5/21 Circuitry for suppressing or minimising disturbance, e.g. moiré or halo
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

This invention relates to a method of increasing spatial/temporal resolution including the steps of (a) providing a current video having an initial temporal/spatial resolution; (b) repeatedly reducing the temporal/spatial resolution of the current video to produce a lowest temporal/spatial resolution current video; (c) increasing the spatial/temporal resolution of the lowest temporal/spatial resolution current video; (d) increasing the spatial/temporal resolution of the next higher temporal/spatial resolution current video; and (e) repeating step (d) up to the initial temporal/spatial resolution.

Claims

1. A method of increasing spatial resolution, comprising:

a. providing a current video having an initial temporal resolution and an initial spatial resolution;

b. repeatedly reducing the temporal resolution of the current video to produce a lower temporal resolution current video having a smaller number of frames than said current video, down to a lowest temporal resolution current video, said lowest temporal resolution current video having said initial spatial resolution;

c. increasing the spatial resolution of said lowest temporal resolution current video;

d. increasing the spatial resolution of the next higher temporal resolution current video; and

e. repeating step (d) up to the initial temporal resolution.

2. The method of claim 1, wherein said current video in step (a) comprises a spatially reduced video of an original video;

wherein said step (b) is performed on both said current video and said original video; and

wherein said steps (c) and (d) further comprise calculating enhancement data and using said enhancement data to enhance the increased spatial resolution of the current video, said calculating comprising using the respective reduced temporal resolution video.

3. A method of video compression, comprising the method of claim 2, wherein said current video comprises an already decoded spatially reduced video of the original video;

wherein said operations on the original video are performed in an encoder;

said calculating enhancement data is performed in the encoder;

said enhancement data is provided from said encoder to a decoder; and

said using the enhancement data is performed in both the encoder and the decoder.

4. The method of claim 3, wherein said calculating enhancement data comprises analyzing the temporal motion field and the spatial geometrical structure of said current and original videos.

5. The method of claim 3, further comprising, before reducing in step (b), blurring said current and original videos.

6. The method of claim 3, wherein said increasing the spatial resolution comprises analyzing the temporal motion field and the spatial geometrical structure of said current and original videos.

7. The method of claim 2, further comprising, before reducing in step (b), blurring said current and original videos.

8. The method of claim 2, wherein said increasing the spatial resolution in steps (c) and (d) comprises analyzing the temporal motion field and the spatial geometrical structure of said current and original videos.

9. The method of claim 2, wherein said calculating enhancement data comprises analyzing the temporal motion field and the spatial geometrical structure of said current and original videos.

10. The method of claim 1 wherein said increasing the spatial resolution in steps (c) and (d) comprises analyzing the temporal motion field and the spatial geometrical structure of said current video.

11. The method of claim 1, further comprising, before reducing in step (b), blurring the current video.