METHOD, SERVER AND TERMINAL FOR GENERATING A COMPOSITE VIEW FROM MULTIPLE CONTENT ITEMS

• US 20130185353A1
• Filed: 07/13/2011
• Published: 07/18/2013
• Est. Priority Date: 07/14/2010
• Status: Abandoned Application

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Macq, Jean-Francois, Rondao Alface, Patrice
• Application Number:
  US13/809,939
• Publication Number:
  US 20130185353A1
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

A method for generating a composite view (300) from multiple content items through interaction between a terminal (100) and a server (20), comprising the steps of: —transferring from the terminal (100) to the server (200) a terminal description (111) containing a capability profile of the terminal (100); —transferring from the server (200) to the terminal (100) information (212) indicative for available content items and interaction modes; and —transferring from the terminal (100) to the server (200) information indicative for selected content items and selected interaction modes, and an iterative process of: —streaming from the server (200) to the terminal (100) selected content items (113, 114; 213, 214) optimized according to the terminal description and the selected interaction modes; —fusing one or more of the content items in the terminal (100); —rendering the composite view (300) from fused content items; —transferring feedback from the terminal (100) to the server (200); and —adapting the streamed content items (113, 114; 213, 214) based on the feedback.

Claims

1. A method for generating a composite view from multiple content items through interaction between a terminal and a server, said method comprising:

transferring from said terminal to said server a terminal description containing a capability profile of said terminal;

transferring from said server to said terminal information indicative for available content items and interaction modes; and

transferring from said terminal to said server information indicative for selected content items and selected interaction modes,

wherein said method further comprises an iterative process of;

streaming from said server to said terminal selected content items optimized according to said terminal description and said selected interaction modes;

fusing one or more of said content items in said terminal;

rendering said composite view from fused content items;

transferring feedback from said terminal to said server; and

adapting said streamed content items based on said feedback.

2. A method for generating a composite view according to claim 1,

wherein said capability profile of said terminal represents a metadata file comprising one or more of:

memory capacity of said terminal;

display size of said terminal;

processing power of said terminal;

available video decoders in said terminal;

supported fusing functionality in said terminal;

supported interactivity commands in said terminal.

3. A method for generating a composite view according to claim 1,

wherein said information indicative for available content items comprises a television program menu.

4. A method for generating a composite view according to claim 1, wherein said interaction modes comprise:

navigating;

selecting a region of interest;

selecting a view angle.

5. A method for generating a composite view according to claim 1, wherein said fusing comprises one or more of:

warping one or more of said content items;

interpolating one or more of said content items;

stitching one or more of said content items;

overlaying some of said content items.

6. A method for generating a composite view according to claim 1, wherein adapting said streamed content items comprises adapting to network conditions, terminal conditions and usage of said content items in said terminal.

7. A method for generating a composite view according to claim 1, further comprising:

pre-fetching surrounding parts of one or more of said content items.

8. A server for generating a composite view from multiple content items through interaction with a terminal, said server comprising:

means for receiving and analyzing a terminal description containing a capability profile of said terminal;

means for transmitting to said terminal information indicative for available content items and interaction modes;

means for receiving from said terminal information indicative for selected content items and selected interaction modes,

wherein said server further comprises;

means for streaming to said terminal selected content items optimized according to said terminal description and said selected interaction modes;

means for receiving feedback from said terminal; and

means for adapting said streamed content items based on said feedback.

9. A terminal for generating a composite view from multiple content items through interaction with a server, said terminal comprising:

means for sending to said server a terminal description containing a capability profile of said terminal;

means for receiving from said server information indicative for available content items and interaction modes; and

means for sending to said server information indicative for selected content items and selected interaction modes,

wherein said terminal further comprises;

at least one video decoder for receiving from said server and decoding selected content items optimized according to said terminal description and said selected interaction modes;

a fusing processor for fusing one or more of said content items;

a rendering processor for rendering said composite view from fused content items;

means for transferring feedback to said server;

and in that;

said at least one video decoder is adapted for receiving from said server and decoding streamed content items adapted based on said feedback.