Method for encoding signals, related systems and program product therefor

• US 20070047650A1
• Filed: 08/29/2005
• Published: 03/01/2007
• Est. Priority Date: 08/29/2005
• Status: Active Grant

• Current Assignee: STMicroelectronics SRL (STMicroelectronics NV)
• Original Assignee: STMicroelectronics SRL (STMicroelectronics NV)
• Inventors: Convertino, Gabriella, Vilei, Antonio
• Granted Patent: US 8,139,642 B2
• Time in Patent Office: Days
• US Class Current: 375/240.160
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/39 involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution

Abstract

A method for encoding video signals subjects the signals to unbalanced multiple description coding. The unbalanced multiple description coding codes a video signal in a first high resolution packet and a second low resolution packet and represents, respectively a first high resolution description and a second low resolution description. The unbalanced multiple description coding step includes using different intra refresh periods for the first and second high resolution descriptions, with an intra refresh period for the second low resolution description shorter than the intra refresh period of the first high resolution description.

Claims

1. A method for encoding video signals comprising the step of:

subjecting video signals to unbalanced multiple description coding, said unbalanced multiple description coding comprising;

coding a video signal in a first high resolution packet and a second low resolution packet, said first high resolution packet representing a first high resolution description and said second low resolution packet representing a second low resolution description; and

using a first intra refresh period for said first high resolution description and a second intra refresh period for said second low resolution description, wherein the said second intra refresh period for said second low resolution description being shorter than said first intra refresh period for said first high resolution description.

2. The method of claim 1, wherein said unbalanced multiple description coding further comprises aggregating said first high resolution description and said second low resolution description into a single packet for transmission.

3. The method of claim 2, wherein aggregating comprises aggregating a low resolution packet belonging to a first frame with index n and a high resolution packet belonging to a second frame with index k, said index k being equal to index n minus an offset value.

4. The method of claim 2, wherein said first high resolution description and said second low resolution description are obtained by a joint encoding operation.

5. The method of claim 4, wherein said joint encoding operation comprises exchanging coding information between said first high resolution packet and said second low resolution packet, said exchange of coding information controlling an adjustment of packet size and/or of a quantization parameter in the joint encoding so that aggregation of said first high resolution packet and said second low resolution packet is equal in size to a network maximum transfer unit value

6. The method of claim 5, wherein aggregating said first high resolution description and said second low resolution description into a single packet for transmission comprises keeping constant a frame offset between said first high resolution packet and said second low resolution packet aggregated into a single unbalanced multiple description packet by means of said exchange of coding information.

7. The method of claim 4, wherein a low resolution bandwidth allocated for said second low resolution packet is a pre-defined small fraction of a high resolution bandwidth allocated for said first high resolution packet.

8. The method of claim 4, wherein a high resolution stream and a low resolution stream have similar number of total packets.

9. The method of claim 5 wherein said step of exchanging coding information comprises exchanging information of motion vectors originated by encoding said first high resolution packet so that encoding a first low resolution packet uses a rescaled version of said motion vectors.

10. A system for encoding video signals, said system comprising:

one or more encoders configured for unbalanced multiple description coding of video signals, wherein a first encoder is configured for coding an input signal in a first high resolution packet representing a first high resolution description and a second encoder is configured for coding said input signal in a second low resolution packet representing a second low resolution description, wherein said first encoder is further configured for applying a first intra refresh period for said first high resolution description and said second encoder is further configured for applying a second intra refresh period for said second low resolution description, the intra refresh period for said second low resolution description being shorter than the intra refresh period for the first high resolution description.

11. The system of claim 10, further comprising a packetizer module configured for aggregating said first high resolution description and second low resolution description into a single packet for transmission.

12. The system of claim 11, wherein said first encoder and said second encoder operate by a joint encoding operation.

13. The system of claim 12, wherein said first encoder and said second encoder are configured for operating with a same codec, said same codec having different encoding parameters.

14. The system of claim 12, wherein said first encoder and said second encoder in said joint encoding operation are each configured for exchanging coding information and are each further configured for using exchanged coding information for controlling an adjustment of packet size and/or of a quantization parameter in the encoding operation so that aggregation of said first high resolution packet and said second low resolution packet is equal in size to a maximum transfer unit value pertaining the network.

15. The system of claim 14, wherein said first encoder and said second encoder in said joint encoding operation are each configured for exchanging information for allowing said packetizer module, said packetizer module configured for aggregating said first high resolution description and second low resolution description into said single packet for transmission, to keep constant a frame offset between said first high resolution packet and said second low resolution packet aggregated into a single unbalanced multiple description packet.

16. The system of claim 12 wherein said first encoder and said second encoder in said joint encoding operation are each configured for exchanging coding information in order to set low resolution bandwidth of low resolution packets to a pre-defined small fraction of high resolution bandwidth of high resolution packets.

17. The system of claim 12 wherein said first encoder and said second encoder in said joint encoding operation are each configured for exchanging information in order to produce a high resolution stream and a low resolution stream, the high resolution stream and the low resolution steam having similar number of total packets.

18. The system of claim 12 wherein said first encoder and said second encoder in said joint encoding operation are each configured for exchanging information comprising information of a set of motion vectors originated by said first encoder and wherein said second encoder is configured for using a rescaled version of said set of motion vectors supplied by a rescaler module.

19. The system of claim 10 further comprising a video streaming server associated to a WLAN access point.

20. The system of claim 10 further comprising a video streaming server configured for generating Unbalanced Multiple Descriptions packets capable of being sent in broadcast via a 3G base station.

21. A system for receiving and decoding, to macroblocks of frames, a signal comprising a single packet aggregate of a high resolution packet and a low resolution packet, said signal produced by unbalanced multiple description coding of video signals using different intra refresh periods, an intra refresh period for said low resolution packet being shorter than the intra refresh period for said high resolution packet, said system comprising:

a de-packetizer module configured for extracting said high resolution packet and said low resolution packet from said single packet, said de-packetizer module sending said extracted high resolution packet and said low resolution packet to a respective first decoder and a second decoder, said first decoder and said second decoder supplying respectively a high resolution and a low resolution frame to a postprocessor, said postprocessor configured for performing an error concealment operation.

22. The system of claim 21 wherein the postprocessor is further configured for recovering from a low resolution frame macro-block when a given a high resolution frame macro-block has been lost.

23. The system of claim 21 wherein the postprocessor is further configured for performing error concealment operations by operating on said high resolution frames and said low resolution frames with a same sequence number, producing a playback frame that is sent to a playback unit, said playback frame being also sent back to said first decoder and said second decoder.

24. The system of claim 21 further comprising an upscaler module configured for receiving said low resolution frames from said low second decoder, said upscaler further configured for upscaling said low resolution frames for input to the postprocessor.

25. A computer-readable medium containing a computer programming product for causing a computing device to encode video signals for transmission, the computer programming product comprising:

program code for subjecting video signals to unbalanced multiple description coding, said unbalanced multiple description coding comprising coding a video signal in a first high resolution packet and coding said video signal in a second low resolution packet, representing respectively a first high resolution description and a second low resolution description, said unbalanced multiple description coding further comprising using a first intra refresh period for said first high resolution description and a second intra refresh period for said second low resolution description, the second intra refresh period for said second low resolution description being shorter than the first intra refresh period of the first high resolution description.

26. The computer program product of claim 25 wherein the computer program product comprises a memory of a computing device.

27. The computer program product of claim 25 further comprising program code for transmitting a generated data signal containing the contents of a data transmission medium.

28. The computer program product of claim 25, wherein the program code for subjecting video signals to unbalanced multiple description coding further comprises program code for aggregating said first high resolution description and said second low resolution description into a single packet for transmission.

29. The computer program product of claim 25, further comprising program code for obtaining said first high resolution description and second low resolution description by a joint encoding operation.