IMAGE UP-SAMPLING WITH RELATIVE EDGE GROWTH RATE PRIORS

• US 20160371818A1
• Filed: 02/10/2016
• Published: 12/22/2016
• Est. Priority Date: 05/15/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Su, Chang, Tao, Li
• Granted Patent: US 10,007,970 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/16 Determination of a pixel data signal depending on the signal applied in the previous frame
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats

Abstract

A display system is configured to convert Full-High Definition (FHD) image content into Ultra-High Definition (UHD) image content. The display system includes an interface configured to receive image content comprising a first resolution, such as FHD. The display system also includes a display device configured to display image content at a second resolution, such as UHD, the second resolution greater than the first resolution. The display system further includes one or more processors configured to: convert the image content from the first resolution to the second resolution; recover a spatial frequency of the converted image content as a function of a relative edge growth rate measured from the converted image content and an offline-determined relationship between the relative edge growth rates of the converted first image and its corresponding ground truth image; and provide the converted image content with the recovered spatial frequency to the display device.

Claims

1. An apparatus comprising:

an interface configured to receive image content comprising a first resolution;

a display device configured to display image content at a second resolution, the second resolution greater than the first resolution; and

one or more processors configured to;

convert the image content from the first resolution to the second resolution;

recover a spatial frequency of the converted image content as a function of a relative edge growth rate measured from the converted image content and an offline-determined relationship between the relative edge growth rates of the converted first image and an associated reference value; and

provide the converted image content with the recovered spatial frequency to the display device.

2. The apparatus according to claim 1, wherein the one or more processors is configured to recover of the spatial frequency by:

determining the relative edge growth rate of an edge transition unit of the converted first image;

adjusting the relative edge growth rate as a function of an offline adjustment factor; and

adjusting the edge transition unit of the converted first image based on the adjusted relative edge growth rate to perform image edge sharpening.

3. The apparatus according to claim 2, wherein the one or more processors is configured to adjust the relative edge growth rate by:

computing the in-line adjustment factor based on a gradient of the of the converted first image in accordance with the offline-determined relationship; and

determining the adjusted relative edge growth rate based on scaling the computed spatial growth rate by the in-line adjustment factor.

4. The apparatus according to claim 1, wherein the one or more processors are configured to execute a plurality of instructions for a prior-probability-based image super-resolution (SR) up-sampling for image enhancement that is deployed by an ultra-high definition display to convert standard or full high-definition video to ultra-high definition video in real-time.

5. The apparatus according to claim 1, wherein the second resolution comprises an ultra-high definition comprising a display format having a 16×

9 ratio with at least one digital input cable carrying a minimum resolution of 3,840×

2,160 pixels.

6. The apparatus according to claim 1, further comprising the display device and wherein the one or more processors are configured to control the display device to display the converted image.

7. The apparatus according to claim 6, wherein the display device comprises an ultra-high definition display for one of:

a television display or computer display.

8. A method for converting image content, the method comprising:

converting a first image from a first resolution to a second resolution that is greater than the first resolution;

recovering spatial frequency of the converted first image as a function of a relative edge growth rate measured from the converted first image and an offline-determined relationship between the relative edge growth rates of the converted first image and an associated reference value; and

providing the converted first image with the recovered spatial frequency for display on a display device.

9. The method according to claim 8, wherein recovering the spatial frequency comprises:

determining the relative edge growth rate of an edge transition unit of the converted first image;

adjusting the relative edge growth rate as a function of an in-line adjustment factor; and

adjusting the edge transition unit of the converted first image based on the adjusted relative edge growth rate to perform image edge sharpening.

10. The method according to claim 9, wherein adjusting the relative edge growth rate comprises:

computing the in-line adjustment factor based on a gradient of the of the converted first image in accordance with the offline-determined relationship; and

determining the adjusted relative edge growth rate based on scaling the computed spatial growth rate by the in-line adjustment factor.

11. The method according to claim 8, wherein converting a first image from the first resolution to the second resolution comprises employing a prior-probability-based image super-resolution (SR) up-sampling for image enhancement that is deployed by an ultra-high definition display to convert standard or full high-definition video to ultra-high definition video in real-time.

12. The method according to claim 8, wherein the second resolution comprises an ultra-high definition comprising a display format having a 16:

9 ratio with at least one digital input cable carrying a minimum resolution of 3,840×

2,160 pixels.

13. The method according to claim 8, further comprising displaying, on the display device, the converted image.

14. A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by a processor, causes the processor to:

convert a first image from a first resolution to a second resolution, the second resolution is greater than the first resolution;

recover a spatial frequency of the converted first image as a function of a relative edge growth rate measured from the converted first image and an offline-determined relationship between the relative edge growth rates of the converted first image and an associated reference value; and

provide the converted first image with the recovered spatial frequency for display on a display device.

15. The non-transitory computer readable medium according to claim 14, wherein recovering the spatial frequency comprises:

determining the relative edge growth rate of an edge transition unit of the converted first image;

adjusting the relative edge growth rate as a function of an offline adjustment factor; and

adjusting the edge transition unit of the converted first image based on the adjusted relative edge growth rate to perform image edge sharpening.

16. The non-transitory computer readable medium according to claim 15, wherein adjusting the relative edge growth rate comprises:

computing the offline adjustment factor based on a gradient of the of the converted first image in accordance with the offline-determined relationship; and

determining the adjusted relative edge growth rate based on scaling the computed spatial growth rate by the offline adjustment factor.

17. The non-transitory computer readable medium according to claim 14, wherein the computer program comprises a plurality of instructions for a prior-probability-based image super-resolution (SR) up-sampling for image enhancement that is deployed by an ultra-high definition display to convert standard or full high-definition video to ultra-high definition video in real-time.

18. The non-transitory computer readable medium according to claim 14, wherein the second resolution comprises an ultra-high definition comprising a display format having a 16:

9 ratio with at least one digital input cable carrying a minimum resolution of 3,840×

2,160 pixels.

19. The non-transitory computer readable medium according to claim 14, further comprising a plurality of instructions that, when executed by a processor, cause the processor control the display device to:

display the converted image.

20. The non-transitory computer readable medium according to claim 14, wherein the display device comprises an ultra-high definition display for one of:

a television or computer display.