MULTI-ANGLE VIEW PROCESSING APPARATUS

• US 20150172734A1
• Filed: 04/15/2014
• Published: 06/18/2015
• Est. Priority Date: 12/18/2013
• Status: Abandoned Application

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: HONG, Jin-Woo, KIM, Tae-Jung, JEON, Ju-Il, KIM, Chang-Ki, KIM, Jae-Ho, YOO, Jeong-Ju
• Application Number:
  US14/253,175
• Publication Number:
  US 20150172734A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/42607 for processing the incoming bitstream
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/64322 IP

Abstract

In a multi-angle view processing apparatus, main-view data and at least one multi-angle view datum are received and processed through via one identical apparatus, and the main-view data and the at least one multi-angle view datum are separated into main images and sub images to be separately provided to different apparatuses, and as a result, seamless multi-angle view images selected by a user may be viewed with optimal resolution.

Claims

1. A multi-angle view processing apparatus, comprising:

a main-view data receiver configured to receive main-view data of broadcast content through a broadcast network;

a multi-angle view data receiver configured to receive at least one multi-angle view datum of the broadcast content through Internet;

a multi-decoder configured to decode the main-view data and the at least one multi-angle view datum received by the main-view data receiver and the multi-angle view data receiver, respectively; and

a multi-renderer configured to perform rendering of the main-view data and the at least one multi-angle view datum decoded by the multi-decoder to separate the main-view data and the at least one multi-angle view datum into main images and sub images, and to reproduce the main images and the sub images.

2. The apparatus of claim 1, wherein the main-view data receiver receives service metadata in which information associated with a multi-angle view service and synchronization is recorded.

3. The apparatus of claim 2, wherein the service metadata comprises:

information about a uniform resource locator (URL) of a Metadata Point Descriptor (MPD) that indicates an MPD file storage location of the at least one multi-angle view datum;

synchronization information for synchronizing the main view data with the at least one multi-angle view datum; and

multi-angle view information that indicates multi-angle view numbers and respective multi-angle view names.

4. The apparatus of claim 3, wherein the synchronization information is time estimation synchronization information based on program clock reference (PCR).

5. The apparatus of claim 3, wherein the synchronization information is synchronization information based on a frame number.

6. The apparatus of claim 2, wherein a packetized elementary stream (PES) packet of a main view data frame of a digital broadcast specification comprises the service metadata.

7. The apparatus of claim 3, wherein the main view data receiver extracts the MPD URL information from the service metadata, and the extracted MPD URL information is provided to the multi-angle view data receiver.

8. The apparatus of claim 7, wherein the multi-angle view data receiver comprises:

an MPD controller configured to receive the MPD URL information from the main-view data receiver, to send a request for an MPD file to at least one MPD URL included in the received MPD URL information to receive the requested MPD file, and to interpret the received at least one MPD file to obtain a storage location of the at least one multi-angle view datum; and

a dynamic adaptive streaming over HTTP (DASH) client module configured to comprise at least one segment receiver that receives multi-angle view data from the storage location of the at least one multi-angle view datum, which is obtained by the MPD controller.

9. The apparatus of claim 8, wherein for multi-angle views selected by a user device, the DASH client module uses any one segment receiver to receive multi-angle view data with optimal resolution, and for other multi-angle views, the DASH client module uses other segment receivers to receive multi-angle view data with the lowest resolution.

10. The apparatus of claim 8, wherein the multi-angle view data storage location is a specific URL of a web server that provides a multi-angle view service.

11. The apparatus of claim 8, wherein each of the segment receivers delivers elementary stream (ES) packets to the multi-decoder by de-muxing transport stream (TS) packets of multi-angle view data frames of a digital broadcast specification.

12. The apparatus of claim 4, wherein the multi-renderer uses a system clock of the multi-decoder to reproduce the multi-angle view data at the same time as the PCR, which is a reference clock, of the multi-angle view data.

13. The apparatus of claim 5, wherein the multi-renderer reproduces the multi-angle view data with a multi-angle view frame number, which is a same number as a main-view frame number.