Low bit rate video encoder and decoder

• US 5,635,929 A
• Filed: 02/13/1995
• Issued: 06/03/1997
• Est. Priority Date: 02/13/1995
• Status: Expired due to Term

• Current Assignee: Hughes Electronics Corporation (AT&T, Inc.)
• Original Assignee: Hughes Aircraft Company (Rtx Corporation)
• Inventors: Rabowsky, Irving, Mead, Donald C.
• Primary Examiner(s): Young, Brian K.
• Application Number:
  US08/387,992
• Time in Patent Office: 841 Days
• Field of Search: 341/50, 341/67, 348/405, 348/408, 348/419
• US Class Current: 341/50
• CPC Class Codes: H04N 19/94 Vector quantisation

Abstract

Methods and systems for encoding a video signal into a bit stream, and for reconstructing the video signal from the bit stream are disclosed. In an embodiment of an encoder, an object encoder (22) assigns a symbolic code to an object contained in at least one video frame, wherein the symbolic code identifies a corresponding generic object from a set of generic objects. A difference processor (32), coupled to the object encoder (22), computes a difference signal in dependence upon a difference between the object and the corresponding generic object. A multiplexer (30) provides the bit stream based upon the difference signal and the symbolic code. In an embodiment of a decoder, a demultiplexer (82) extracts a symbolic code and a difference signal from the encoded video signal. The symbolic code identifies a corresponding generic object from a set of generic objects, and the difference signal represents a difference between an object and the corresponding generic object. An object generator (84) forms the video signal by generating the corresponding generic object identified by the symbolic code, and modifying the corresponding one of the generic objects in dependence upon the difference signal.

Claims

1. A system for encoding a video signal into a bit stream, the video signal representative of a sequence of at least one video image frame, the system comprising:

an object encoder which assigns a symbolic code to an object contained in the at least one video frame, wherein the symbolic code identifies a corresponding generic object from a set of generic objects;

a difference processor, coupled to the object encoder, which computes a difference signal in dependence upon a difference between the object and the corresponding generic object; and

a multiplexer which provides the bit stream based upon the difference signal and the symbolic code.

2. The system of claim 1 wherein the object encoder includes a first storage device which contains the set of generic objects.

3. The system of claim 2 wherein the object encoder stores an unrecognized object in the first storage device.

4. The system of claim 1 wherein the difference processor includes a second storage device in which a representation of the difference signal is stored.

5. The system of claim 1 wherein the object encoder includes an image segmenter which segments the at least one video image frame into at least one object.

6. The system of claim 1 wherein the object encoder includes a feature extractor which forms at least one feature quantity for the object.

7. The system of claim 6 wherein the difference signal is based upon a difference between the at least one feature for the object and at least one feature from the corresponding generic object.

8. The system of claim 6 wherein the object encoder includes a classifier, coupled to the feature extractor, which determines the corresponding generic object based upon the at least one feature quantity.

9. The system of claim 1 further comprising a mapper which forms a transformed signal in dependence upon the video signal, and provides the transformed signal to the object encoder.

10. The system of claim 1 further comprising a variable length coder, coupled to the multiplexer, which provides a variable length coding of the bit stream.

11. The system of claim 1 further comprising a motion estimator which performs a comparison of a first video frame to a second video frame, and provides a representation of the comparison to the multiplexer.

12. The system of claim 11 wherein the motion detector provides a motion compensation signal to the multiplexer based upon the motion of the object from the first frame to the second frame.

13. A system for encoding a video signal into a bit stream, the video signal representative of a sequence of at least one video image frame, the system comprising:

an image segmenter which segments the at least one video image frame into a plurality of objects;

a feature extractor, coupled to the image segmenter, which forms at least one feature quantity for each of the objects;

a first storage device which contains a set of generic objects;

a classifier, coupled to the feature extractor and to the first storage device, which recognizes at least one of the objects as a corresponding generic object based upon the at least one feature quantity;

a difference processor, coupled to the classifier, which computes a difference signal in dependence upon a difference between the at least one of the objects and the corresponding generic object, the difference processor including a second storage device in which a representation of the difference signal is stored;

a motion estimator which provides a motion compensation signal based upon the motion of at least one of the objects from a first frame to a second frame; and

a multiplexer which provides the bit stream based upon the symbolic code, the difference signal, and the motion compensation signal.

14. A method of encoding a video signal representative of a sequence of at least one video image frame into a bit stream, the method comprising the steps of:

assigning a symbolic code to an object contained in the at least one video frame, wherein the symbolic code identifies a corresponding generic object from a set of generic objects;

computing a difference signal in dependence upon a difference between the object and the corresponding generic object; and

multiplexing the difference signal and the symbolic code to form the bit stream.

15. The method of claim 14 further comprising the step of storing an unrecognized object in the set of generic objects.

16. The method of claim 14 wherein the step of assigning includes the step of extracting at least one object from the at least one video image frame.

17. The method of claim 14 wherein the step of assigning includes a step of computing at least one feature quantity for the object.

18. The method of claim 17 further comprising the step of comparing the at least one feature quantity of the object to at least one feature of the generic objects.

19. The method of claim 14 further comprising the steps of:

forming a motion compensation signal based upon the motion of the object from a first frame to a second frame; and

multiplexing the motion compensation signal into the bit stream.

20. A system for reconstructing a video image from a bit stream representative of an encoded video signal, the system comprising:

a demultiplexer which extracts a symbolic code and a difference signal from the encoded video signal, wherein the symbolic code identifies a corresponding generic object from a set of generic objects, and wherein the difference signal is representative of a difference between an object and the corresponding generic object; and

an object generator, coupled to the demultiplexer, which forms the video image by generating the corresponding generic object identified by the symbolic code, and modifying the corresponding generic object in dependence upon the difference signal.

21. The system of claim 20 wherein the object generator includes a first storage device which contains the set of generic objects.

22. The system of claim 20 wherein the demultiplexer further extracts a motion compensation signal, and wherein the object generator includes a motion compensator which modifies a location of the corresponding generic object in dependence upon the motion compensation signal.

23. A method of reconstructing a video image from a bit stream representative of an encoded video signal, the method comprising the steps of:

extracting a symbolic code from the encoded video signal, wherein the symbolic code identifies a corresponding generic object from a set of generic objects;

extracting a difference signal from the encoded video signal, wherein the difference signal is representative of a difference between an object and the corresponding generic object;

modifying the corresponding generic object in dependence upon the difference signal; and

generating the modified corresponding generic object.

24. The method of claim 23 further comprising the steps of:

extracting a motion compensation signal from the encoded video signal; and

modifying a location of the corresponding generic object in dependence upon the motion compensation signal.