Experience or "sentio" codecs, and methods and systems for improving QoE and encoding based on QoE experiences

• US 20120039382A1
• Filed: 08/12/2011
• Published: 02/16/2012
• Est. Priority Date: 08/12/2010
• Status: Active Grant

• Current Assignee: Wickr Inc. (Amazon.com, Inc.)
• Original Assignee: Net Power & Light, Inc (Amazon.com, Inc.)
• Inventors: Vonog, Stanislav, Surin, Nikolay, Lemmey, Tara
• Granted Patent: US 9,172,979 B2
• Time in Patent Office: Days
• US Class Current: 375/240.01
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234345 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

Certain embodiments teach a variety of experience or “sentio” codecs, and methods and systems for enabling an experience platform, as well as a Quality of Experience (QoS) engine which allows the sentio codec to select a suitable encoding engine or device. The sentio codec is capable of encoding and transmitting data streams that correspond to participant experiences with a variety of different dimensions and features. As will be appreciated, the following description provides one paradigm for understanding the multi-dimensional experience available to the participants, and as implemented utilizing a sentio codec. There are many suitable ways of describing, characterizing and implementing the sentio codec and experience platform contemplated herein.

Claims

1. A sentio codec for encoding and decoding a plurality of multi-dimensional data streams for a multi-dimensional experience, the sensio codec comprising:

a plurality of codecs suitable for encoding and decoding multi-dimensional experience data streams related to a multi-dimensional experience;

a QoE decision engine;

a network engine;

wherein the sentio codec implements a low-latency transfer protocol suitable for enabling a multi-dimensional experience.

2. A sentio codec as recited in claim 1, wherein the plurality of codecs includes an audio codec and a video codec.

3. A sentio codec as recited in claim 2, wherein the plurality of codecs further includes a gesture command codec.

4. A sentio codec as recited in claim 2, wherein the plurality of codecs further includes a sensor data codec.

5. A sentio codec as recited in claim 2, wherein the plurality of codecs further includes an emotion data codec.

6. A sentio codec as recited in claim 1, wherein the sentio codec takes available network bandwidth into account when encoding data streams.

7. A sentio codec as recited in claim 1, wherein the sentio codec takes a characteristic of an intended recipient device into account when encoding data streams.

8. A sentio codec as recited in claim 1, wherein the sentio codec takes into account a characteristic of a transmission device into account when encoding data streams.

9. A sentio codec as recited in claim 1, wherein the sentio codec takes into account a characteristic of a participant experience into account when encoding data streams.