ADAPTIVE HIGH DYNAMIC RANGE (HDR) TONE MAPPING WITH OVERLAY INDICATION

• US 20190043233A1
• Filed: 06/11/2018
• Published: 02/07/2019
• Est. Priority Date: 08/01/2017
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Yeong-Taeg, Oh, Seongnam, Hyun, Soojung, Tao, Li
• Granted Patent: US 10,504,263 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20208 High dynamic range [HDR] image processing
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/90 Dynamic range modification of images or parts thereof
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement

Abstract

A method for video tone mapping includes receiving an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene. Based on the overlay indication, a hardware processor processes a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

Claims

1. A method for video tone mapping, comprising:

receiving an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene; and

based on the overlay indication, processing, by a hardware processor, a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

2. The method for video tone mapping of claim 1, wherein the first tone mapping function is used when the graphic is not being overlaid on the image data for the HDR scene, and the first tone mapping function uses tone mapping metadata for only the HDR scene.

3. The method for video tone mapping of claim 1, wherein the second tone mapping function is used when the graphic is being overlaid on the image data for the HDR scene, and the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic.

4. The method for video tone mapping of claim 3, wherein the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the input data stream that includes the graphic overlaid on the HDR scene.

5. The method for video tone mapping of claim 1, wherein the overlay indication comprises an overlay flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

6. The method for video tone mapping of claim 1, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.

7. The method for video tone mapping of claim 4, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the video stream.

8. An apparatus comprising:

a memory storing instructions; and

at least one processor executing the instructions including a process configured to;

receive an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene; and

based on the overlay indication, process a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

9. The apparatus of claim 8, wherein the first tone mapping function is used when the graphic is not being overlaid on the image data for the HDR scene, and the first tone mapping function uses tone mapping metadata for only the HDR scene.

10. The apparatus of claim 8, wherein the second tone mapping function is used when the graphic is being overlaid on the image data for the HDR scene, and the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic.

11. The apparatus of claim 10, wherein the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the input data stream that includes the graphic overlaid on the HDR scene.

12. The apparatus of claim 8, wherein the overlay indication comprises an overlay_flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

13. The apparatus of claim 8, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.

14. The apparatus of claim 11, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the video stream.

15. A non-transitory processor-readable medium that includes a program that when executed by a processor performs a method comprising:

receiving, by a hardware processor, an overlay indication from an input data stream indicating whether a graphic is being overlaid on image data for a High Dynamic Range (HDR) scene; and

based on the overlay indication, processing, by the hardware processor, a video stream using a first tone mapping function to generate a first tone mapped video, or a second tone mapping function to generate a second tone mapped video.

16. The non-transitory processor-readable medium of claim 15, wherein the first tone mapping function is used when the graphic is not being overlaid on the image data for the HDR scene, and the first tone mapping function uses tone mapping metadata for only the HDR scene.

17. The non-transitory processor-readable medium of claim 15, wherein:

the second tone mapping function is used when the graphic is being overlaid on the image data for the HDR scene;

the second tone mapping function uses tone mapping metadata for the HDR scene with the overlaid graphic; and

the tone mapping metadata for the HDR scene with the overlaid graphic is obtained by estimating a maximum luminance for all values of the input data stream that includes the graphic overlaid on the HDR scene.

18. The non-transitory processor-readable medium of claim 15, wherein the overlay indication comprises an overlay flag that specifies whether the graphic is being overlaid on the image data for the HDR scene.

19. The non-transitory processor-readable medium of claim 15, wherein the graphic being overlaid corresponds to image data for a picture-in-picture data stream.

20. The non-transitory processor-readable medium of claim 17, wherein the maximum luminance represents a maximum value of max(R,G,B) of pixels in the video stream.