Communication between a server and a terminal

• US 9,185,159 B2
• Filed: 12/31/2009
• Issued: 11/10/2015
• Est. Priority Date: 12/31/2008
• Status: Active Grant

• Current Assignee: David Libault, Jacques Lewiner
• Original Assignee: Cy-Play
• Inventors: Libault, David, Gonzalez, Jerome
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): HOSSAIN, FM RASHED
• Application Number:
  US13/142,695
• Publication Number:
  US 20110269508A1
• Time in Patent Office: 2,140 Days
• Field of Search: 345/592
• US Class Current: 1/1
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2381 Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

In process for modeling a display coming from an application on a server, the display being destined for a remote terminal, the display is modeled to compose an image according to display information coming from the application by stacked layers, each layer consisting of pixels and being associated with a corresponding first alteration data set, each pixel being characterized by a transparency factor of the pixel; the first alteration data set indicating characteristics of the layer connected with the alterations performed by the application, the resulting image consisting of image pixels and being associated with a second alteration data set, the second alteration data set indicating whether the image was altered due to the modification of the layers by the application, the image pixels being composed of the superimposed corresponding pixels of the layers.

Claims

1. A method for modeling in a processor a display coming from an application on a server, the display being destined for a remote terminal, characterized in that the display is modeled to compose an image based on display information coming from the application, by means of stacked layers, each layer consisting of layer pixels, and being associated with a corresponding first alteration data set,

the layer pixels being grouped into layer pixel blocks, each layer pixel being characterized by a transparency factor T_tp of said pixel;

the first alteration data set comprising, for each layer, a motion vector of said layer and transparency data of said layer,

the resulting image consisting of image pixels and being associated with a second alteration data set,

the image pixels being grouped into macroblocks,

the second alteration data set indicating whether the macroblocks of the image were altered due to alteration of the layers by the application,

the image pixels being made up of the corresponding stacked pixels of the layers;

the method comprising the following steps;

alteration of the content of the layer pixels of at least one layer by at least one primitive according to the display information received from the application;

alteration of the first alteration data set for at least one layer according to alteration performed by the primitive(s);

alteration of the second alteration data set according to the first data set;

composition of an image based on the layer pixels, the transparency data corresponding to a block of a layer affecting a macroblock of the composite image being used to determine whether said image macroblock was altered from the macroblock of the preceding image, and transmission to an encoder of the image to be encoded and of encoding information in compliance with the second alteration data set.

2. A method according to claim 1 wherein the transparency data of a layer include a transparency factor of said layer and a transparency indication for each block of said layer, the transparency indication indicating whether said block is completely transparent, completely opaque or neither.

3. A method according to claim 1 wherein the first alteration data set also comprises alteration data indicating for each pixel block of said layer whether said block was altered by the application.

4. A method according to claim 3 wherein, if the first alteration data set indicates that a layer block affecting a macroblock of the composite image was altered by the application, or if said layer block is not totally transparent and the layer to which it belongs is undergoing movement, or if the transparency factor of said layer indicates that the layer is undergoing a change in transparency, then the image macroblock is recomposed.

5. A method according to claim 1, characterized in that the step of altering the second alteration data set comprises, for each pixel macroblock of the image to be encoded, a search within the first data set for layer pixel blocks affecting the macroblock which have been altered by the application, in order to determine whether the pixel macroblock of the image to be encoded has been altered.

6. A method according to claim 1 wherein the second alteration data set includes a motion vector for each pixel macroblock of the image for use in a differential encoding, the motion vector being determined based on displacement vectors of the layers of which at least one block has induced an alteration in said macroblock.

7. A method according to claim 6 characterized in that, if several layers used to compose the image have undergone simultaneous translation, the displacement vector Vd for encoding is selected from among the displacement vectors of the layers which have undergone translation, according to a predetermined criterion.

8. A method according to claim 1 characterized in that the second alteration data set indicates, for each pixel macroblock, whether said macroblock was altered from the preceding image, and wherein only the altered macroblocks are then encoded by the encoder.

9. A method for encoding an image in a processor, the method comprising reception of an image and encoding information for encoding the image, the image and the encoding information being generated by the method according to claim 1 encoding the information using the encoding information.

10. A method according to claim 9 characterized in that each macroblock is encoded in the regular way in intracall mode for transmission to the terminal.

12. A non-transitory computer-readable storage medium containing a software program for implementing the method according to claim 1, downloadable via a telecommunication network and/or stored in a memory of a processing device and/or stored in a memory medium designed to cooperate with a processing device.

13. An encoder designed to receive an image generated by the method according to claim 1 and encoding information generated by the method according to claim 1, the encoder being designed so as to encode the image using the encoding information.

14. An encoder according to claim 13 designed to encode each image macroblock in the regular way in intracall mode for transmission to the terminal.

11. A modeling device for a display coming from an application on a server, the display being destined for a remote terminal, characterized in that

the display is modeled for composing an image based on display information coming from the application, by means of stacked layers,

each layer consisting of layer pixels and being associated with a corresponding first alteration data set,

the layer pixels being grouped into layer pixel blocks, each layer pixel being characterized by a transparency factor T_tp of said pixel;

the first alteration data set comprising for each layer a motion vector of said layer and of the transparency data of said layer,

the resulting image consisting of image pixels and being associated with a second alteration data set,

the second alteration data set indicating whether the image macroblocks were altered due to the alteration of the layers by the application,

the image pixels consisting of the superimposed corresponding pixels of the layers;

the method comprising the following steps;

means for altering the content of at least one layer by at least one primitive according to the display information received from the application;

means for altering the content of the first alteration data set for at least one layer according to the alterations carried out by the primitive(s);

means for altering the second data set according to the first data set;

means for composing an image according to the content of the layers, the transparency data corresponding to a block of a layer affecting a macroblock of the composite image being used for determining whether said macroblock of the image was altered with respect to the macroblock of the preceding image; and

means for transmitting to an encoder the image to be encoded and encoding information in compliance with the second alteration data set.