SYSTEM AND METHOD FOR VIDEO CODING USING VARIABLE COMPRESSION AND OBJECT MOTION TRACKING

• US 20090096927A1
• Filed: 10/26/2007
• Published: 04/16/2009
• Est. Priority Date: 10/15/2007
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Inventors: Camp, William O. JR., Marcinkiewicz, Walter M., Bowen, Toby J., Kokes, Mark G.
• Application Number:
  US11/925,196
• Publication Number:
  US 20090096927A1
• Time in Patent Office: Days
• US Class Current: 348/613
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/20 using video object coding
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/67 involving unequal error protection [UEP], i.e. providing protection according to the importance of the data
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764

Abstract

A video coding technique and system employ variable compression for different portions of an imaged scene and motion tracking of an object. The object is coded to have higher fidelity than a remainder of the scene. The higher fidelity facilitates tracking of the object that, in turn, assists in maintaining quality coding of the object.

Claims

1. A method of coding a video signal that contains video data corresponding to an imaged scene, comprising:

identifying an object that corresponds to a visual element from the scene, a portion of the scene other than the visual element being a remainder of the scene;

compressing video data corresponding to the object and compressing a remainder of the video data using an amount of compression that is greater than an amount of compression used to compress the video data for the object so as to produce a high fidelity video component corresponding to the visual element and a low fidelity video component corresponding to the remainder of the scene; and

tracking the object using the high fidelity video component and using tracking information regarding a predicted position of the object in a future frame of the video signal to compress the video data when the future frame arrives.

2. The method of claim 1, wherein the object is identified using pattern recognition.

3. The method of claim 2, wherein the pattern recognition is used to identify a face of a person.

4. The method of claim 1, wherein the object is identified by proximity of the visual element to a predetermined location within the scene.

5. The method of claim 1, wherein the object is identified by receiving input from a user that specifies the visual element.

6. The method of claim 1, wherein the data is broken into blocks of pixels and blocks containing pixels corresponding to the object are compressed to generate the high fidelity video component and remaining blocks are compressed to generate the low fidelity video component.

7. The method of claim 1, further comprising transmitting an output video signal that includes the high fidelity video component and low fidelity video component, and wherein higher error coding is applied to the high fidelity video component than error coding that is applied to low fidelity video component.

8. The method of claim 1, wherein a reference frame is maintained for the object and a separate reference frame is maintained for the remainder of the scene.

9. The method of claim 1, wherein the video coding is carried out by an electronic device that includes a camera assembly that images the scene to generate the video signal.

10. The method of claim 9, wherein the electronic device is a mobile telephone.

11. A video signal encoder that encodes a video signal that contains video data corresponding to an imaged scene, comprising:

an object identification module that identifies an object that corresponds to a visual element from the scene, a portion of the scene other than the visual element being a remainder of the scene;

an image compression module that compresses video data corresponding to the object and compresses a remainder of the video data using an amount of compression that is greater than an amount of compression used to compress the video data for the object so as to produce a high fidelity video component corresponding to the visual element and a low fidelity video component corresponding to the remainder of the scene; and

a motion tracking module that tracks the object using the high fidelity video component and generates tracking information regarding a predicted position of the object in a future frame of the video signal, the tracking information used by the image compression module to compress the video data when the future frame arrives.

12. The encoder of claim 11, wherein the object identification module uses pattern recognition to identify the object.

13. The encoder of claim 12, wherein the pattern recognition is used to identify a face of a person.

14. The encoder of claim 11, wherein the object identification module uses proximity of the visual element to a predetermined location within the scene to identify the object.

15. The encoder of claim 11, wherein the object identification module uses user input to identify the object.

16. The encoder of claim 11, wherein the video data is broken into blocks of pixels and blocks containing pixels corresponding to the object are compressed to generate the high fidelity video component and remaining blocks are compressed to generate the low fidelity video component.

17. The encoder of claim 11, further comprising a transmission module to transmit an output video signal that includes the high fidelity video component and low fidelity video component to a destination, wherein the transmission module applies higher error coding to the high fidelity video component than error coding that the transmission module applies to the low fidelity video component.

18. The encoder of claim 11, wherein a reference frame is maintained for the object and a separate reference frame is maintained for the remainder of the scene.

19. The encoder of claim 11, wherein the encoder is part of an electronic device that includes a camera assembly that images the scene to generate the video.

20. The encoder of claim 19, wherein the electronic device is a mobile telephone and includes call circuitry to establish a call over a network.

21. A method of coding a video signal that contains video data corresponding to an imaged scene, comprising:

compressing video data corresponding to an identified portion of the scene;

compressing a remainder of the video data using an amount of compression that is greater than an amount of compression used to compress the video data for the identified portion of the scene; and

outputting a high fidelity video component corresponding to the identified portion of the scene and a low fidelity video component corresponding to the remainder of the video data.

22. The method of claim 21, wherein the identified portion of the scene corresponds to a fixed region of a video image that is represented by the video signal.