Methods for sending and receiving an animation, and associated devices

• US 7,426,305 B2
• Filed: 02/04/2005
• Issued: 09/16/2008
• Est. Priority Date: 02/09/2004
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Henocq, Xavier, Denoual, Franck
• Primary Examiner(s): Alavi; Amir
• Application Number:
  US11/049,978
• Publication Number:
  US 20050180646A1
• Time in Patent Office: 1,320 Days
• Field of Search: 382/232, 382/233, 382/254, 382/284, 382288-300, 375/240.01, 375/240.11, 375/240.12, 375/E7.078, 375/E7.09, 375/E7.011, 709/223.231, 711/141, 725/86, 725/87, 348/E7.063
• US Class Current: 382/233
• CPC Class Codes: H04N 19/127 Prioritisation of hardware or computational resources
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities

Abstract

The invention has a sending device and a decoding device, where the sending device sends via a transmission channel to the decoding device at least one key image during a first time interval and a secondary image calculated using the at least one key image during a second time interval. The at least one key image is defined at least partly by base data and the secondary image is defined by secondary data. The sending device sends the base data to the decoding device during the first time interval, determines enhancement data for the at least one key image according to an available bandwidth of the transmission channel and the amount of secondary data to be transmitted, and sends the secondary data and the enhancement data for the at least one key image to the decoding device during the second time interval.

Claims

1. A method for sending, between a first device and a second device over a transmission channel, at least one key image to be transmitted via the transmission channel during a first time interval and a secondary image calculated using said at least one key image and to be transmitted via transmission channel during a second time interval, said at least one key image being defined at least partly by base data and the secondary image being defined by secondary data, comprising the steps of:

sending the base data from the first device to the second device via the transmission channel during the first time interval;

determining enhancement data for said at least one key image according to an available bandwidth of the transmission channel and the amount of secondary data to be transmitted; and

sending the secondary data and the enhancement data for said at least one key image from the first device to the second device via the transmission channel during the second time interval.

2. A method according to claim 1, further comprising the steps of:

estimating the available bandwidth of the transmission channel during the first time interval in order to determine a first amount of data to be transmitted; and

extracting the base data of the at least one key image so that the size of the base data is less than or equal to said first amount.

3. A method according to claim 2, wherein said extraction step comprises the following steps:

selecting, by means of a table containing the size of the base data as a function of at least one parameter, at least one value of the parameter such that the size associated by the table is less than or equal to said first amount; and

extracting the base data using at least said value.

4. A method according to claim 1, further comprising the steps of:

estimating the available bandwidth of the transmission channel during the second time interval in order to determine a second amount of data to be transmitted;

determining the available data budget by subtracting the size of the secondary data from said second amount; and

extracting the enhancement data for said at least one key image so that the size of the enhancement data is less than or equal to the available budget.

5. A method according to claim 1, wherein the secondary data are interpolation parameters.

6. A method according to claim 1, wherein a first key image and a second key image are transmitted during the first time interval.

7. A method according to claim 6, wherein the first key image is intended to be displayed at a first instant, the second key image is intended to be displayed at a second instant separated from the first instant by a first time duration, the secondary image is intended to be displayed at a third instant separated from the first instant by a second time duration smaller than the first time duration, and first enhancement data relating to the first key image and second enhancement data relating to the second key image are determined so that the size ratio between the first and second enhancement data depends on the ratio of the second time duration to the first time duration.

8. A method according to claim 1, wherein the at least one key image and the secondary image define an animation.

9. A method according to claim 8, wherein the animation comprises several secondary images between a first key image and a second key image.

10. A method according to claim 1, wherein the at least one key image and the secondary image are multi-resolution images with several quality levels.

11. A computer readable storage medium on which is stored a computer program that, when executed by a computer, performs the method according to claim 1.

12. A method for a device for decoding at least one key image and a secondary image, comprising the steps of:

during a first time interval, receiving, from an apparatus, base data defining said at least one key image;

decoding the base data so as to generate a first version of said at least one key image;

during a second time interval, receiving, from the apparatus, enhancement data for said at least one key image and secondary data defining the secondary image using said at least one key image; and

verifying if enhancement data for said at least one key image has been received during the second time interval,

wherein, in a case of a positive verification;

combining the base data and the enhancement data into enhanced data; and

decoding the secondary data so as to generate said secondary image using the enhanced data;

and wherein, in a case of a negative verification;

decoding the secondary data so as to generate said secondary image using the first version of said at least one key image.

13. A decoding method according to claim 12, further comprising, between the steps of decoding the base data to generate the first version of the at least one key image and combining the base data and the enhancement data into enhanced data, performing a step of displaying said first version of the at least one key image.

14. A decoding method according to claim 12, further comprising a step of decoding the enhanced data so as to generate a second version of said at least one key image, and in that the decoding of the secondary data so as to generate said secondary image is based on said second version.

15. A computer readable storage medium on which is stored a computer program that, when executed by a computer, performs the method according to claim 12.

16. A device for sending to an apparatus via a transmission channel at least one key image to be transmitted via the transmission channel during a first time interval and a secondary image calculated using said at least one key image and to be transmitted via the transmission channel during a second time interval, said at least one key image being defined at least partly by base data and the secondary image being defined by secondary data, comprising:

first sending means for sending the base data to the apparatus via the transmission channel during the first time interval;

determining means for determining enhancement data for said at least one key image according to an available bandwidth of the transmission channel and the amount of secondary data to be transmitted; and

second sending means for sending the secondary data and the enhancement data for said at least one key image from the device to the apparatus via the transmission channel during the second time interval.

17. A device for decoding at least one key image and a secondary image, comprising:

first receiving means for receiving, from an apparatus via a transmission channel, during a first time interval, base data defining said at least one key image;

first decoding means for decoding the base data so as to generate a first version of said at least one key image;

second receiving means for receiving, from the apparatus via the transmission channel, during a second time interval, enhancement data for said at least one key image and secondary data defining the secondary image using said at least one key image; and

verifying means for verifying if enhancement data for said at least one key image has been received during the second time interval,

wherein, in a case of a positive verification by the verifying means;

a combining means combines the base data and the enhancement data into enhanced data; and

a second decoding means decodes the secondary data so as to generate said secondary image using the enhanced data,

and wherein in a case of a negative verification by the verifying means;

a third decoding means decodes the secondary data so as to generate said secondary image using the first version of said at least one key image.

18. A system comprised of a sending device and a decoding device,

said sending device being a device for sending via a transmission channel to said decoding device at least one key image to be transmitted via the transmission channel during a first time interval and a secondary image calculated using said at least one key image and to be transmitted via the transmission channel during a second time interval, said at least one key image being defined at least partly by base data and the secondary image being defined by secondary data,

said sending device comprising:

first sending means for sending the base data to the decoding device via the transmission channel during the first time interval;

determining means for determining enhancement data for said at least one key image according to an available bandwidth of the transmission channel and the amount of secondary data to be transmitted; and

second sending means for sending the secondary data and the enhancement data for said at least one key image to the decoding device via the transmission channel during the second time interval,

and said decoding device being a device for decoding at least one key image and a secondary image, said decoding device comprising;

first receiving means for receiving, from the sending device via the transmission channel, during the first time interval, the base data defining said at least one key image;

first decoding means for decoding the base data so as to generate a first version of said at least one key image;

second receiving means for receiving, from the sending device via the transmission channel, during the second time interval, the enhancement data for said at least one key image and the secondary data defining the secondary image using said at least one key image; and

verifying means for verifying if enhancement data for said at least one key image has been received during the second time interval,

wherein, in a case of a positive verification by the verifying means;

a combining means combines the base data and the enhancement data into enhanced data; and

a second decoding means decodes the secondary data so as to generate said secondary image using the enhanced data,

and wherein in a case of a negative verification by the verifying means;

a third decoding means decodes the secondary data so as to generate said secondary image using the first version of said at least one key image.

19. A method in a system comprised of a sending device and a decoding device,

said sending device for sending via a transmission channel to said decoding device at least one key image to be transmitted via the transmission channel during a first time interval and a secondary image calculated using said at least one key image and to be transmitted via the transmission channel during a second time interval, said at least one key image being defined at least partly by base data and the secondary image being defined by secondary data,

said sending device performing the steps of:

sending the base data to the decoding device via the transmission channel during the first time interval;

determining enhancement data for said at least one key image according to an available bandwidth of the transmission channel and the amount of secondary data to be transmitted; and

sending the secondary data and the enhancement data for said at least one key image to the decoding device via the transmission channel during the second time interval,

and said decoding device for decoding at least one key image and a secondary image, said decoding device performing the steps of;

during the first time interval, receiving, from the sending device via the transmission channel, the base data defining said at least one key image;

decoding the base data so as to generate a first version of said at least one key image;

during the second time interval, receiving, from the sending device via the transmission channel, the enhancement data for said at least one key image and the secondary data defining the secondary image using said at least one key image; and

verifying if enhancement data for said at least one key image has been received during the second time interval,

wherein, in a case of a positive verification by the verifying step;

combining the base data and the enhancement data into enhanced data; and

decoding the secondary data so as to generate said secondary image using the enhanced data,

and wherein in a case of a negative verification by the verifying step;

decoding the secondary data so as to generate said secondary image using the first version of said at least one key image.