TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEPTION DEVICE, AND RECEPTION METHOD

• US 20180310049A1
• Filed: 11/09/2015
• Published: 10/25/2018
• Est. Priority Date: 11/28/2014
• Status: Active Grant

• Current Assignee: Saturn Licensing LLC (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: TAKAHASHI, Kazuyuki, KITAZATO, Naohisa
• Granted Patent: US 10,880,597 B2
• Time in Patent Office: Days
• CPC Class Codes: G10L 19/008 Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04R 1/326 for microphones H04R1/34 and H04R1/40 take precedence
• CPC Class Codes: H04S 5/02 of the pseudo four-channel type, e.g. in which rear channel signals are derived from two-channel stereo signals

Abstract

A first video stream having video data of a first view, a second video stream having video data of a second view, and an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source are generated. A container of a predetermined format including the first video stream, the second video stream, the audio stream, and position correction information for correcting the positional information of the object sound source to positional information based on the second view is transmitted. Thereby, it is possible to accurately perform 3D audio rendering even in a case that view switching is performed at a reception side.

Claims

1. :

A transmission device comprising;

an encode unit configured to generate a first video stream having video data of a first view, a second video stream having video data of a second view, and an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source; and

a transmission unit configured to transmit a container of a predetermined format including the first video stream, the second video stream, the audio stream, and position correction information for correcting the positional information of the object sound source to positional information based on the second view.

2. :

The transmission device according to claim 1, wherein the position correction information indicates difference components of positions and orientations of the first view and the second view.

3. :

The transmission device according to claim 1, wherein the position correction information is inserted into a layer of the audio stream.

4. :

The transmission device according to claim 3, wherein the position correction information is inserted into a metadata region including the positional information.

5. :

The transmission device according to claim 3, wherein the position correction information is inserted into a user data region.

6. :

The transmission device according to claim 3, wherein

when a plurality of the second views is present, a plurality of pieces of the position correction information corresponding to the plurality of the second views is inserted into the layer of the audio stream, and

information indicating the second video streams to which the plurality of pieces of the position correction information respectively correspond is inserted into a layer of the container.

7. :

The transmission device according to claim 1, wherein the position correction information is inserted into a layer of the second video stream.

8. :

The transmission device according to claim 1, wherein the position correction information is inserted into a layer of the container.

9. :

The transmission device according to claim 8, wherein the position correction information is inserted as signaling information.

10. :

The transmission device according to claim 9, wherein

the container is MPEG2-TS, and

the position correction information is inserted into a video elementary stream loop corresponding to the second video stream of a program map table.

11. :

The transmission device according to claim 8, wherein an information stream including the position correction information is inserted.

12. :

A transmission method comprising;

an encode step of generating a first video stream having video data of a first view, a second video stream having video data of a second view, and an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source; and

a transmission step of transmitting, by a transmission unit, a container of a predetermined format including the first video stream, the second video stream, the audio stream, and position correction information for correcting the positional information of the object sound source to positional information based on the second view.

13. :

A reception device comprising;

a reception unit configured to receive a container of a predetermined format including a first video stream having video data of a first view, a second video stream having video data of a second view, an audio stream having audio data of an object sound source and positional information based on the first view of the object sound source, and position correction information for the correcting positional information of the object sound source to positional information based on the second view; and

a processing unit configured to process information included in the container.

14. :

The reception device according to claim 13, wherein

the processing unit includes

a decode unit configured to obtain the video data of the first view, the video data of the second view, the audio data and positional information of the object sound source from the first video stream, the second video stream, and the audio stream,

a selector configured to selectively output the video data of the first view or the video data of the second view,

a rendering unit configured to map the audio data of the object sound source to any speaker position on the basis of the positional information of the object sound source, and

the rendering unit uses the positional information corrected on the basis of the position correction information in such a way that the positional information is based on the second view, when the video data of the second view is selected by the selector.

15-19. -19. (canceled)