System and method for motion detection and the use thereof in video coding

• US 7,995,800 B2
• Filed: 02/28/2008
• Issued: 08/09/2011
• Est. Priority Date: 02/28/2007
• Status: Active Grant

• Current Assignee: IMEC International, Katholieke Universiteit Leuven, Katholieke Universiteit Leuven KU Leuven R&D
• Original Assignee: IMEC International, Katholieke Universiteit Leuven
• Inventors: Lu, Jiangbo
• Primary Examiner(s): Lu; Tom Y
• Application Number:
  US12/039,639
• Publication Number:
  US 20080219573A1
• Time in Patent Office: 1,258 Days
• Field of Search: 382/107, 382/166, 382/232, 382/244
• US Class Current: 382/107
• CPC Class Codes: H04N 19/53 Multi-resolution motion estimation; Hierarchical motion estimation
• CPC Class Codes: H04N 19/543 using regions
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/80 Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation H04N19/635, H04N19/86 take precedence

Abstract

A system and method for motion detection and the use thereof in video coding are disclosed. In one aspect, a method of defining a region of motion within a video frame in a sequence of video frames comprises loading a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame. The method further comprises applying filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame. The method further comprises determining for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame. The method further comprises combining the video-frame like representations of different scales. The method further comprises determining one or more regions of motion from the combination.

Claims

1. A method of defining a region of motion within a video frame in a sequence of video frames, the method comprising:

loading a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame;

applying filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame;

determining for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame;

combining the video-frame like representations of different scales; and

determining one or more regions of motion from the combination.

2. The method of claim 1, wherein at least one of the current and reference video frames is pre-filtered to reduce noise.

3. The method of claim 1, wherein at least one of the at least two scales of representation is obtained by applying down-sampling operations.

4. The method of claim 1, wherein at least one of the at least two scales of representations is filtered to suppress first order illumination changes.

5. The method of claim 1, wherein the video-frame like representation of structural changes is obtained by performing a difference operation between said at least two scale representations.

6. The method of claim 1, wherein the combining of the video-frame like representations is obtained by performing a summing operation of the representations of different scales.

7. A video processing apparatus adapted for carrying out a method of claim 1.

8. A non-transitory computer-readable medium having stored therein a computer program that, when executed, is configured to perform the method of claim 1.

9. A method of coding a sequence of video frames, comprising:

performing a method of defining a region of motion within a video frame in the sequence, the method comprising;

loading a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame;

applying filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame;

determining for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame;

combining the video-frame like representations of different scales; and

determining one or more regions of motion from the combination;

and

performing motion estimation/compensation based encoding, wherein the motion estimation/motion compensation is used only on the determined regions of motion.

10. A video encoder adapted for carrying out the method of claim 9.

11. A non-transitory computer-readable medium having stored therein a computer program that, when executed, is configured to perform the method of claim 9.

12. A device for defining a region of motion within a video frame in a sequence of video frames, the device comprising:

a loading module configured to load a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame;

a filtering module configured to apply filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame;

a first determining module configured to determine for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame;

a combining module configured to combine the video-frame like representations of different scales; and

a second determining module configured to determine one or more regions of motion from the combination.

13. A device for coding a sequence of video frames, the device comprising:

a defining device configured to define a region of motion within a video frame in a sequence of video frames, the defining device comprising;

a loading module configured to load a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame;

a filtering module configured to apply filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame;

a first determining module configured to determine for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame;

a combining module configured to combine the video-frame like representations of different scales; and

a second determining module configured to determine one or more regions of motion from the combination;

and

an encoding module configured to perform motion estimation/compensation based encoding, wherein the motion estimation/motion compensation is used only on the regions of motion determined by the defining device.

14. A device for defining a region of motion within a video frame in a sequence of video frames, the device comprising:

means for loading a current video frame and at least one reference video frame from the sequence, the reference video frame being different from the current video frame;

means for applying filtering operations on the current and the reference video frame in order to obtain at least two scales of representation of the current and the reference video frame;

means for determining for each of the scale representations a video-frame like representation of the structural changes between the current and the reference video frame;

means for combining the video-frame like representations of different scales; and

means for determining one or more regions of motion from the combination.