TRANSMITTING APPARATUS, RECEIVING APPARATUS, TRANSMITTING METHOD, RECEIVING METHOD AND TRANSPORT SYSTEM

• US 20120147954A1
• Filed: 07/07/2010
• Published: 06/14/2012
• Est. Priority Date: 07/16/2009
• Status: Abandoned Application

• Current Assignee: GNZO Incorporated
• Original Assignee: GNZO Incorporated
• Inventors: Kasai, Hiroyuki, Uchihara, Naofumi
• Application Number:
  US13/384,225
• Publication Number:
  US 20120147954A1
• Time in Patent Office: Days
• US Class Current: 375/240.03
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

The delivery of the high-definition image signal corresponding to an area a user desires to view can be achieved without increasing the load of processing in a transmitting apparatus. There are included an image area dividing unit (20) for dividing the image area of an input image signal into a given number of areas to generate area division image signals; and a coding unit (30) for coding the area division image signals to generate image bit streams. There are also included an image bit stream group accumulating unit (40) for accumulating a plurality of image bit streams; and a view point information receiving unit (60) for receiving view point information including the information of a view position transmitted from a receiving apparatus (2). Then, it has been arranged that an image bit stream corresponding to a first area defined by a view position and an image bit stream corresponding to a second area that is a peripheral area of the first area be extracted from the image bit stream group accumulating unit (40), thereby generating transport image bit streams to be transmitted to the receiving apparatus (2).

Claims

1. A transmission device comprising,

a video region division processing section for dividing a video region of an input video signal into a specified number of regions, and generating a plurality of region divided video signals corresponding to each of the divided regions;

an encoding processing section for generating a plurality of video bit streams by encoding the plurality of region divided video signals;

a video bit stream group storage section for storing a plurality of video bit streams that have been generated by the encoding processing section;

a viewpoint information receiving section for receiving viewpoint information, that is transmitted from a receiving device connected by a network to the transmission device, including information on viewing position that has been designated as a region desired to be viewed from among the video regions;

a transmission bit stream generating section, for extracting the video bit stream corresponding to a first region specified by the viewpoint position, and the video bit stream corresponding to a second region which is a peripheral region to the first region, from the video bit stream group storage section, based on the viewpoint information that has been received by the viewpoint information receiving section, and generating a transmission video bit stream; and

a video bit stream transmission section for transmitting the transmission video bit stream that was generated by the transmission bit stream generating section to the receiving device, wherein

the transmission bit stream generating section is configured to execute the following processing, for video bit streams corresponding to m^th and n^th divided regions that belong to the second region containing the first region, in order to generate the transmission video bit stream;

(1) processing to specify a video bit stream for one line, constituted by a plurality of macroblocks, of the m^th divided region, that has been extracted from the video bit stream group storage section;

(2) followed by processing to generate a single stream, being one bit stream, as a transmission bit stream, by specifying a video bit stream for one line constituted by a plurality of macroblocks, of an n^th divided region that is adjacent to the m^th divided region, and connecting to an end portion of a specified video bit stream for one line that was specified before, where m is an integer greater than or equal to 1, n≠

m, and n=m+1.

2. The transmission device of claim 1, wherein the viewpoint information contains information on the movement speed of the viewpoint position, and

the transmission bit stream generating section comprises

a re-encoding processing section for performing inverse quantization on the video bit stream and re-encoding at a lower quantization level;

and

a transmission bit stream reconstruction processing section for outputting either the video bit stream corresponding to the first region or the video bit stream corresponding to the second region to the re-encoding processes section depending on the magnitude of movement speed of the viewpoint position.

3. The transmission device of claim 2, wherein the transmission bit stream reconstruction processing section, when the movement speed of the viewpoint position is less than or equal to a previously set specified threshold value, and the video bit stream that is subject to processing corresponds to the first region, or corresponds to a fourth region, that is a peripheral region to the first region and is a region outside a third region having a narrower range than the second region, outputs the video bit stream corresponding to the fourth region to the re-encoding processing section, and when the movement speed of the viewpoint position exceeds the previously set specified threshold value outputs video bit streams corresponding to the first to fourth regions to the re-encoding processing section.

4. The transmission device of claim 1, wherein the video region division processing section generates a first region divided video signal having substantially the same resolution as the resolution of the input video signal, and a second region divided video signal that has been converted to a lower resolution than the video for the video region of the input video signal, in correspondence with each divided region into which the video region for the input video signal has been divided,

a first video bit stream generated from the first video region divided video signal, and a second video bit stream generated from the second video region divided video signal, are stored in the video bit stream group storage section,

the viewpoint information contains requested resolution information showing the size of a viewing region the user has requested, and

the transmission bit stream generating section extracts a video bit stream having a resolution corresponding to the resolution specified by the requested resolution information, from the video bit stream group storage section.

5. The transmission device of claim 4, wherein the second region divided video signal contains a low-resolution region divided video signal that has been converted to a low resolution without dividing the video of the video region of the input video signal, and a medium-resolution region divided video signals that has been converted to a resolution that is higher than the resolution of the low resolution region divided video signals after dividing the video of the video region of the input video signal.

7. The transmission device of claim 1, wherein the encoding processing section independently encodes the plurality of region divided video signals using a method in which there is no predictive relationship between regions.

8. The transmission device of claim 1, further comprising an audio encoding processing section for generating an audio bit stream by encoding an input audio signal;

an audio bit stream storage section for storing audio bit streams that have been generated by the audio encoding processing section in correspondence with information on position where the input audio signal was generated;

an audio bit stream extraction/combining processing section for extracting a plurality of audio bit streams, that have been generated from audio signals generated at a position corresponding to a video region specified by the viewpoint information, from the audio bit stream storage section, and combining the plurality of extracted audio bit streams; and

an audio bit stream transmission section for transmitting the audio bit stream that was combined by the audio bit stream extraction/combining processing section to the receiving device.

6. (canceled)

9-12. -12. (canceled)

13. A transmission method used in a transmission device for transmitting data to a receiving device that is connected by a network, comprising:

a step of dividing a video region of an input video signal into a specified number of regions, and generating a plurality of region divided video signals corresponding to each of the divided regions;

a step of generating a plurality of video bit streams by encoding the plurality of region divided video signals;

a step of storing a plurality of video bit streams that have been generated by the encoding processing section;

a step of receiving viewpoint information, that is transmitted from the receiving device, including information on viewing position that has been designated as a viewing region, from among the video regions;

a step of extracting the video bit stream corresponding to a first region specified by the viewing position, and the video bit stream corresponding to a second region which is a peripheral region to the first region, from the video bit stream group that has been stored, based on the viewpoint information, and generating a transmission bit stream; and

a step of transmitting the transmission bit stream to the receiving device,

wherein, in the step of generating the video bit stream, for video bit streams corresponding to m^th and n^th divided regions that belong to a second region containing the first region, the following processing is carried out;

(1) processing to specify a video bit stream for one line, constituted by a plurality of macroblocks, of the m^th divided region;

(2) followed by processing to generate a single stream, being one bit stream, as a transmission bit stream, by specifying a video bit stream for one line constituted by a plurality of macroblocks, of an n^th divided region that is adjacent to the m^th divided region, and connecting to an end portion of a specified video bit stream for one line that was specified before,

where m is an integer greater than or equal to 1, n≠

m, and n=m+1.

14-15. -15. (canceled)