Blending images using mismatched source and display electro-optical transfer functions

• US 9,729,801 B2
• Filed: 09/24/2015
• Issued: 08/08/2017
• Est. Priority Date: 10/02/2014
• Status: Active Grant

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Inventors: Pytlarz, Jaclyn Anne, Atkins, Robin
• Primary Examiner(s): Tran, William
• Application Number:
  US14/863,621
• Publication Number:
  US 20160100108A1
• Time in Patent Office: 684 Days
• Field of Search: 386280, 386300
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G09G 2320/0673 for control of gamma adjustment, e.g. selecting another gamma curve
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2370/20 Details of the management of multiple sources of image data
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence
• CPC Class Codes: G09G 5/10 Intensity circuits
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 9/76 for mixing of colour signals H04N9/75 takes precedence

Abstract

Input video signals characterized by a source electro-optical transfer function (EOTF) are to be blended and displayed on a target display with a target EOTF which is different than the source EOTF. Given an input set of blending parameters, an output set of blending parameters is generated as follows. The input blending parameters are scaled by video signal metrics computed in the target EOTF to generate scaled blending parameters. The scaled blended parameters are mapped back to the source EOTF space to generate mapped blending parameters. Finally the mapped blending parameters are normalized to generate the output blending parameters. An output blended image is generating by blending the input video signals using the output blending parameters. Examples of generating the video signal metrics are also provided.

Claims

1. A method for blending video images, the method comprising:

accessing a first video signal (202), a second video signal (204), and input blending parameters (206), wherein the first and second video signals are coded using a source electro-optical transfer function (EOTF);

wherein the input blending parameters comprise a first input blending parameter for scaling the first video signal in a first blending operation that blends the first video signal and the second video signal;

wherein the input blending parameters comprise a second input blending parameter, distinct from the first input blending parameter, for scaling the second video signal in the first blending operation that blends the first video signal and the second video signal;

wherein the first blending operation is for a display associated with the source EOTF;

accessing video signal metrics (222), wherein the video signal metrics are coded using a target EOTF;

generating scaled blending parameters (232) in response to the video signal metrics and the input blending parameters; and

generating mapped blending parameters (242) in response to the scaled blending parameters, the source EOTF, and the target EOTF;

wherein the mapped blending parameters comprise a first mapped blending parameter for scaling the first video signal in a second blending operation that blends the first video signal and the second video signal;

wherein the mapped blending parameters comprise a second mapped blending parameter, distinct from the first mapped blending parameter, for scaling the second video signal in the second blending operation that blends the first video signal and the second video signal;

wherein the second blending operation is for a target display associated with the target EOTF for the target display associated with the target EOTF;

wherein the target EOTF with which the second blending operation is associated is different from the source EOTF with which the first blending operation is associated.

2. The method of claim 1, further comprising generating normalized blending parameters (252), by scaling the mapped blending parameters to be within a predefined range.

3. The method of claim 2, further comprising blending the first video signal and the second video signal by using the mapped blending parameters or the normalized blending parameters to generate a blended output video signal.

4. The method of claim 1, where accessing the video metrics further comprises:

generating a first transformed and a second transformed video signals (212, 214) in response to the target EOTF; and

generating the video signal metrics (222) in response to the transformed first and second video signals.

5. The method of claim 1, where accessing the video metrics further comprises:

generating preliminary video signal metrics in response to the first and second video signals; and

converting the preliminary video signal metrics to the video signal metrics in response to the target EOTF.

6. The method of claim 4, wherein a first video signal metric comprises a function of the luminance of pixel values in the first transformed video signal.

7. The method of claim 4, wherein a second video signal metric comprises a function of the luminance of pixel values in the second transformed video signal.

8. The method of claim 5, wherein generating a first preliminary video signal metric comprises computing a function of the luminance of pixel values in the first video signal.

9. The method of claim 5, wherein generating a second preliminary video signal metric comprises computing a function of the luminance of pixel values in the second video signal.

10. The method of claim 1, wherein generating the scaled blending parameters comprises computing

at=(a*(M2−

M1))+M1,

where M1 and M2 denote first and second video signal metrics, a denotes a vector of the input blending parameters, and at denotes a vector of the scaled blending parameters.

11. The method of claim 1, wherein generating a mapped blending parameter y given a scaled blending parameter x comprises computing

t=f_T⁻

1(x),

y=f_s(t),

wherein t denotes a temporary value, f_s denotes the source EOTF function and f_t<sup>−

1</sup> denotes a function of the target EOTF function.

12. The method of claim 1, wherein generating a mapped blending parameter vector as given a scaled blending parameter vector at comprises computing

as=f_TS(at),

where f_TS represents a function of input values in the target EOTF mapped into output values in the source EOTF.

13. The method of claim 12, wherein the f_TS function is implemented via a look-up table.

14. The method of claim 2, wherein the normalized blending parameters are within 0 and 1, with the 0 and 1 values included.

15. The method of claim 2, wherein blending the first video signal and the second video signal comprises computing

I_O=I₁*af+I₂*bf,

wherein I_O denotes the blended output video signal, I₁ denotes the first video signal, I₂ denotes the second video signal, and af and bf denote vectors of the mapped blending parameters or the normalized blending parameters.

16. The method of claim 1, wherein the source and the target EOTFs are different.

17. The method of claim 4, wherein generating the first transformed video signal comprises:

linearizing the first video signal using the source EOTF to generate a temporary signal; and

generating the first transformed video signal by applying the target EOTF to the temporary signal.

18. The method of claim 1, wherein accessing the video signal metrics further comprises computing the video signal metrics based on metadata received for the first and second video signals.

19. An apparatus comprising a processor and configured to perform the method recited in claim 1.

20. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions for executing a method with a processor in accordance with claim 1.