Decoder having digital image stabilization function and digital image stabilization method

• US 7,010,045 B2
• Filed: 06/25/2001
• Issued: 03/07/2006
• Est. Priority Date: 06/28/2000
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Lee, Sung-Hee
• Primary Examiner(s): VO, TUNG T
• Application Number:
  US09/887,535
• Publication Number:
  US 20020118761A1
• Time in Patent Office: 1,716 Days
• Field of Search: 37524001-24029, 382/236, 382/238, 348/208.4
• US Class Current: 375/240.25
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

A decoder and a method for preventing and correcting a fluctuated image which occurs due to a user'"'"'s fluctuated hand when recording using a mobile image communication system by adapting a digital image stabilization technique in a video decoder are provided. When decoding an encoded bit stream by the macro block unit, a motion information is extracted, and one global motion vector is determined using the extracted information. The global motion vector is directed to a motion of a mobile image communication system, and it is possible to obtain a stabilized image by correcting the decoded image data stored in a frame memory using the global motion vector. Since only the motion information is used in the encoded bit stream, a hardware construction is simplified. Therefore, the decoder is well adapted to compute a large amount of data.

Claims

1. A video decoder having a digital image stabilization function, the decoder comprising:

a VLD for separating an image information and an additional information from an encoded bit stream;

a global motion computation unit for extracting a motion vector of a macro block unit from the additional information applied from the VLD, and computing a global motion vector using a local motion vector with respect to a background region in an additional information from the VLD;

a time-based integration unit for extracting a frame type from the additional information, judging whether the global motion vector is integrated according to the extracted frame type to generate a judgment, and integrating a global motion vector from the global motion computation unit based on the judgment; and

a global motion compensation unit for motion-compensating and stabilizing a recovery image using a global motion vector integrated by the time-based integration unit.

2. The decoder of claim 1, wherein said global motion computation unit classifies local motion vectors of the macro block unit contained in the additional information into a local motion vector with respect to the motion of the background region using a clustering technique, and detects a global motion vector through the classified local motion vectors of the background region.

3. The decoder of claim 2, wherein said global motion computation unit includes:

a local motion vector detector for receiving an additional information from the VLD and extracting the local motion vectors by the macro block unit;

a motion separating processor for separating the local motion vectors extracted by the local motion vector detector and separating a local motion vector concerning the motion of the background region; and

a global motion vector detector for detecting one global motion vector based on the local motion vector of the background region separated by the motion separation processor.

4. The decoder of claim 3, wherein said motion separation processor includes:

a similar motion estimation unit for separating the local motion vectors extracted from the local motion vector detector into a certain number of clusters; and

a background motion selector for selecting a cluster which has a motion of the background region among the clusters separated by the similar motion estimation unit.

5. The decoder of claim 1, wherein said time-based integration unit includes:

a frame type extraction unit for extracting a frame type from the additional information from the VLD; and

a global motion vector integration unit for integrating the global motion vector based on the frame type extracted by the frame type extraction processor.

6. The decoder of claim 5, wherein said time-based integration unit directly integrates the global motion vector in the case that the frame type is “

I” and

“

P” and

integrates the global motion vector when correcting the B-frame in the case of B-frame.

12. The decoder of claim 1, wherein said global motion compensation unit compensates a fluctuated image inputted from a frame memory using said integrated global motion vector to stabilize said fluctuated image.

13. The decoder of claim 12, wherein a fluctuation of said fluctuated image is caused by one or more unsteady movements of a camera.

7. A digital image stabilization method using a video decoder, comprising the steps of:

a separation step for receiving an encoded bit stream and separating into an image information and an additional information;

a computation step for extracting a motion vector of a macro block unit from the additional information applied from the VLD, and computing a global motion vector using a local motion vector concerning the motion of a background region in the additional information separated in the separation step;

an integration step for extracting a frame type from the additional information, judging whether the global motion vector is integrated according to the extracted frame type to generate a judgment, and integrating a global motion vector from the global motion computation unit based on the judgment; and

a stabilization step for motion-compensating and stabilizing a recovery image using the global motion vector integrated in the integration step.

8. The method of claim 7, wherein said computation step includes:

a first step for receiving the additional information and classifying local motion vectors of the macro block unit contained in the additional information into a local motion vector with respect to the motion of the background region using a clustering technique;

a second step for separating the local motion vector classified in the first step and separating the local motion vector concerning the motion of the background region; and

a third step for detecting one global motion vector based on the local motion vector of the background region separated in the second step.

9. The method of claim 8, wherein said second step comprises the steps of:

2 a for separating the local motion vector extracted in the first step into a certain number of the clusters; and

2 b for selecting a certain cluster which has a motion of the background region among the clusters separated in the step 2a.

10. The method of claim 7, wherein said integration step includes:

a first step for extracting a frame type from the additional information; and

a second step for integrating the global motion vector based on the frame type extracted in the first step.

11. The method of claim 10, wherein in said integration step, the global motion vector is directly integrated in the case that the frame type is “

I” and

“

P”

, and the global motion vector is integrated when correcting the B-frame in the case of the B-frame.

14. The method of claim 7, wherein in said stabilization step, a fluctuated image inputted from a frame memory is compensated using said integrated global motion vector to stabilize said fluctuated image.

15. The method of claim 14, wherein in said stabilization step, a fluctuation of said fluctuated image is caused by one or more unsteady movements of a camera.