Video super-resolution by fast video segmentation for boundary accuracy control
First Claim
Patent Images
1. A method comprising:
- generating, by a processor, a label map by labeling pixels in an image frame based on a closest color cluster center to the pixels;
determining a percentage of a first type of texture pixels and a percentage of a second type of texture pixels based on the label map to generate a texture map of the image frame;
updating the texture map by updating texture probability as a local average with an updating factor for a particular difference between the percentage of the first type of texture pixels and the percentage of the second type of texture pixels;
generating a directional edge map based on a data correlation analysis by removing a correlation response in texture regions based on the texture map and the label map;
generating a gain map with boundaries and smoothing using localized pixels based on information from one or more of the label map, the texture map, and the directional edge map; and
generating an enhancement controlled upscaled image frame based on using one or more of the label map, the texture map, the directional edge map and the gain map as a weight factor.
1 Assignment
0 Petitions
Accused Products
Abstract
A method includes generating, by a processor, a label map by labeling pixels in an image. A percentage of a first and second type of texture pixels is determined based on the label map to generate a texture map. The texture map is updated. A directional edge map is generated based on a data correlation analysis based on the texture map and the label map. A gain map with boundaries and smoothing is generated using localized pixels based on information from one or more of the label map, the texture map, and the directional edge map. An enhancement controlled upscaled image frame is generated using one or more of the label map, the texture map, the directional edge map and the gain map as a weight factor.
-
Citations
30 Claims
-
1. A method comprising:
-
generating, by a processor, a label map by labeling pixels in an image frame based on a closest color cluster center to the pixels; determining a percentage of a first type of texture pixels and a percentage of a second type of texture pixels based on the label map to generate a texture map of the image frame; updating the texture map by updating texture probability as a local average with an updating factor for a particular difference between the percentage of the first type of texture pixels and the percentage of the second type of texture pixels; generating a directional edge map based on a data correlation analysis by removing a correlation response in texture regions based on the texture map and the label map; generating a gain map with boundaries and smoothing using localized pixels based on information from one or more of the label map, the texture map, and the directional edge map; and generating an enhancement controlled upscaled image frame based on using one or more of the label map, the texture map, the directional edge map and the gain map as a weight factor. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An apparatus comprising:
-
a memory device configured to receive an image frame; and a processor configured to; generate a label map by labeling pixels in the image frame based on a closest color cluster center to the pixels; determine a percentage of a first type of texture pixels and a percentage of a second type of texture pixels based on the label map to generate a texture map of the image frame; update the texture map by updating texture probability as a local average with an updating factor for a particular difference between the percentage of the first type of texture pixels and the percentage of the second type of texture pixels; generate a directional edge map based on a data correlation analysis by removing a correlation response in texture regions based on the texture map and the label map; generate a gain map with boundaries and smoothing using localized pixels based on information from one or more of the label map, the texture map, and the directional edge map; and construct an enhancement controlled upscaled image frame based on using one or more of the label map, the texture map, the directional edge map and the gain map as a weight factor. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A non-transitory processor-readable medium that includes a program that when executed by a processor performs a method comprising:
-
generating, by the processor, a label map by labeling pixels in an image frame based on a closest color cluster center to the pixels; determining a percentage of a first type of texture pixels and a percentage of a second type of texture pixels based on the label map to generate a texture map of the image frame; updating the texture map by updating texture probability as a local average with an updating factor for a particular difference between the percentage of the first type of texture pixels and the percentage of the second type of texture pixels; generating a directional edge map based on a data correlation analysis by removing a correlation response in texture regions based on the texture map and the label map; generating a gain map with boundaries and smoothing using localized pixels based on information from one or more of the label map, the texture map, and the directional edge map; and generating an enhancement controlled upscaled image frame based on using one or more of the label map, the texture map, the directional edge map and the gain map as a weight factor. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30)
-
Specification