System for moving object detection in moving picture

• US 6,025,879 A
• Filed: 08/11/1997
• Issued: 02/15/2000
• Est. Priority Date: 08/29/1996
• Status: Expired due to Term

• Current Assignee: KDDI Corporation
• Original Assignee: Kokusai Densin Denwa Kabushiki Kaisha
• Inventors: Nakajima, Yasuyuki, Yoneyama, Akio, Ujihara, Kiyono
• Primary Examiner(s): LEE, RICHARD J
• Application Number:
  US08/909,344
• Time in Patent Office: 918 Days
• Field of Search: 348/27, 348/390, 348/400-403, 348/407, 348/409-413, 348/415, 348/416, 348/420, 348/699, 382/190, 382/232, 382/233, 382/236, 382/238, 382/243, 382/248-250
• US Class Current: 375/240.24
• CPC Class Codes: H04N 19/503 involving temporal prediction adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109
• CPC Class Codes: H04N 5/145 Movement estimation for video coding H04N19/51

Abstract

A system for detecting a moving object in a moving picture, which can detect a moving object by block directly with a highly-accurate, simple process without completely decoding the compressed moving picture data. The picture block coding mode, the motion compensation mode and the motion vector information (information b) decoded in a variable-length decoder 1 and the texture information d detected by a texture information detector 7 are applied to a moving object detection processor 8. The moving object detection processor 8 judges whether the particular block is a moving object or not using the information b or the combined information b and the texture information d. This judgement is effected by a motion vector, a spatial similarity judgement and a temporal similarity judgement. The moving object detection information e resulting from the judgement is sent to a picture image processor 5 for processing the picture information f. A picture display unit 10 can display a non-moving object and a moving object with different brightness and in different colors.

Claims

1. A system for detecting a moving object in a moving picture by decoding a compressed data of an input moving picture and by adding moving object information to the decoded picture data, comprising:

compressed picture information extraction means for partially decoding the compressed data of a moving picture input for each block and extracting the picture information constituting a part of the data from said partially decoded data;

adaptive detection scheme selection means for classifying the moving object detecting by a coding mode for each frame and a motion compensation mode for each block obtained by said compressed picture information extraction means;

moving object detection prediction means for estimating the presence or absence of a moving object in a block using a motion vector of a spatio-temporally adjacent block selected by the adaptive detection scheme selection means in the case where said block is an intra-coded block and for outputting the moving object information; and

basic moving object detection means for not detecting said block as a moving object area when the size of a motion vector of said block obtained from said compressed picture information extraction means is at least lower than a threshold level selected by the adaptive detection scheme selection means in the case where said block is not an intra-coded block and for outputting the moving object information.

2. A system for detecting a moving object in a moving picture according to claim 1, wherein said moving object detection prediction means estimates the presence or absence of a moving object for said block using the moving object detection information of a spatially adjacent block.

3. A system for detecting a moving object in a moving picture according to claim 1, wherein said moving object detection prediction means estimates the presence or absence of a moving object for said block using the moving object detection information of a temporally adjacent frame.

4. A system for detecting a moving object in a moving picture according to claim 1, further comprising bidirectional motion vector judgement means for improving the accuracy of moving object detection for said block using forward predictive motion vector information and backward motion vector information in the case where the predictive coding scheme for a frame associated with said block is bidirectional.

5. A system for detecting a moving object in a moving picture according to claim 1, further comprising spatial similarity judgement means for improving the moving object detection accuracy for said block using the motion vector information of a block spatially adjacent to said block.

6. A system for detecting a moving object in a moving picture according to claim 1, further comprising temporal similarity judgement means for improving the moving object detection accuracy for said block using the motion vector information of a block in a reference frame temporally adjacent to said block.

7. A system for detecting a moving object in a moving picture according to claim 1, further comprising:

texture information detection means for judging the presence or absence of a texture in the picture of said block from the low-frequency component and the high-frequency component of pixel frequency conversion data obtained from said compressed picture information extraction means; and

means for reflecting the result of texture detection by said texture information detection means in the moving object detection for said block.

8. A system for detecting a moving object in a moving picture according to claim 4, further comprising:

texture information detection means for judging the presence or absence of a texture in the picture of said block from the low-frequency component and the high-frequency component of pixel frequency conversion data obtained from said compressed picture information extraction means; and

means for reflecting the result of texture detection by said texture information detection means in the moving object detection for said block.

9. A system for detecting a moving object in a moving picture according to claim 5, further comprising:

texture information detection means for judging the presence or absence of a texture in the picture of said block from the low-frequency component and the high-frequency component of pixel frequency conversion data obtained from said compressed picture information extraction means; and

means for reflecting the result of texture detection by said texture information detection means in the moving object detection for said block.

10. A system for detecting a moving object in a moving picture according to claim 6, further comprising:

texture information detection means for judging the presence or absence of a texture in the picture of said block from the low-frequency component and the high-frequency component of pixel frequency conversion data obtained from said compressed picture information extraction means; and

means for reflecting the result of texture detection by said texture information detection means in the moving object detection for said block.

11. A system for detecting a moving object in a moving picture according to claim 1, further comprising a picture display means for displaying an area not detected as a moving object as distinguished from an area detected as a moving object according to the adding moving object information.