Reception device, receiving method, transmission device, and transmitting method

• US 10,349,144 B2
• Filed: 04/20/2016
• Issued: 07/09/2019
• Est. Priority Date: 06/09/2015
• Status: Active Grant

• Current Assignee: Sony Group Corp.
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tsukagoshi, Ikuo
• Primary Examiner(s): Natnael, Paulos M
• Application Number:
  US15/572,313
• Publication Number:
  US 20180109850A1
• Time in Patent Office: 1,175 Days
• Field of Search: 348564, 348565, 348569, 348468
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 5/278 Subtitling
• CPC Class Codes: H04N 5/44504 Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
• CPC Class Codes: H04N 9/67 for matrixing camera processing pipelines for matrixing of colour signals H04N23/85

Abstract

The technology is directed to keeping high image quality when a subtitle is superimposed on a video. A reception device includes circuitry configured to receive a video stream and a subtitle stream. The circuitry processes the video stream to obtain video data of a video. The circuitry processes the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image. The circuitry adjusts a color gamut of the subtitle bitmap data to a color gamut of the video data. The color gamut of the subtitle bitmap data is adjusted based on color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data. The circuitry further superimposes, on the video, the color gamut adjusted subtitle bitmap image.

Claims

1. A reception device comprising:

circuitry configured to

receive a video stream and a subtitle stream;

process the video stream to obtain video data of a video;

process the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

obtain color gamut identification information of the subtitle bitmap data that is provided in the subtitle stream or a container that includes the video stream and the subtitle stream;

generate a color gamut adjusted subtitle bitmap image by adjusting a color gamut of the subtitle bitmap data to a color gamut of the video data, the color gamut of the subtitle bitmap data being adjusted based on the color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data; and

when a pixel of a region of the video on which the color gamut adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decrease an original luminance level of the pixel to become a decreased luminance level, and

superimpose, on the video with the pixel having the decreased luminance level, the color gamut adjusted subtitle bitmap image.

2. The reception device according to claim 1, wherein the circuitry is configured to adjust a maximum level of luminance of the subtitle bitmap data to a reference level or less of luminance of the video data, the maximum level of the luminance being adjusted based on dynamic range information of the subtitle bitmap data and dynamic range information of the video data.

3. The reception device according to claim 2, wherein the circuitry is configured to obtain the dynamic range information of the subtitle bitmap data from the subtitle stream or the container that includes the video stream and the subtitle stream.

4. The reception device according to claim 2, wherein the dynamic range of the subtitle bitmap data is set to a default range when the dynamic range information of the subtitle bitmap data is not available from the subtitle stream or the container that includes the video stream and the subtitle stream.

5. The reception device according to claim 1, wherein the circuitry is configured to, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimpose, on the video with the pixel having the original luminance level, the color gamut adjusted subtitle bitmap image.

6. A reception device comprising:

circuitry configured to

receive a video stream and a subtitle stream;

process the video stream to obtain video data of a video;

process the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

obtain dynamic range information of the subtitle bitmap data that is provided in the subtitle stream or a container that includes the video stream and the subtitle stream;

generate an luminance adjusted subtitle bitmap image by adjusting a maximum level of luminance of the subtitle bitmap data to a reference level or less of luminance of the video data, the maximum level of the luminance of the subtitle bitmap data being adjusted based on the dynamic range information of the subtitle bitmap data and dynamic range information of the video data; and

when a pixel of a region of the video on which the luminance adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decrease an original luminance level of the pixel to become a decreased luminance level, and

superimpose, on the video with the pixel having the decreased luminance level, the luminance adjusted subtitle bitmap image.

7. The reception device according to claim 6, wherein the circuitry is configured to adjust a color gamut of the subtitle bitmap data to a color gamut of the video data, the color gamut of the subtitle bitmap data being adjusted based on color gamut identification information of the subtitle bitmap data and color gamut identification information of the video data.

8. The reception device according to claim 7, wherein the circuitry is configured to obtain the color gamut identification information of the subtitle bitmap data from the subtitle stream or the container that includes the video stream and the subtitle stream.

9. The reception device according to claim 7, wherein the color gamut identification information of the subtitle bitmap data is set to a default range when the color gamut identification information of the subtitle bitmap data is not available from the subtitle stream or the container that includes the video stream and the subtitle stream.

10. The reception device according to claim 6, wherein the circuitry is configured to, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimpose, on the video with the pixel having the original luminance level, the luminance adjusted subtitle bitmap image.

11. A method of video processing, comprising:

receiving a video stream and a subtitle stream;

processing the video stream to obtain video data of a video;

processing the subtitle stream to obtain subtitle bitmap data of a subtitle bitmap image;

adjusting, by circuitry of a reception device, the subtitle bitmap data of the subtitle bitmap image to obtain an adjusted subtitle bitmap image based on one or a combination of a color gamut of the video data, a color gamut of the subtitle bitmap data, dynamic range information of the video data, and dynamic range information of the subtitle bitmap data;

when a pixel of a region of the video on which the adjusted subtitle bitmap image is to be superimposed corresponds to a high luminance portion and a mixing ratio of the video data exceeds a threshold value,

decreasing, by the circuitry of the reception device, an original luminance level of the pixel to become a decreased luminance level, and

superimposing, by the circuitry of the reception device, on the video with the pixel having the decreased luminance level, the adjusted subtitle bitmap image to obtain a superimposed video; and

outputting the superimposed video for display.

12. The method of video processing according to claim 11, further comprising, when the pixel of the region of the video does not correspond to the high luminance portion or the mixing ratio of the video data does not exceed the threshold value,

superimposing, on the video with the pixel having the original luminance level, the adjusted subtitle bitmap image to obtain the superimposed video.