Moving picture scene detection system

• US 5,459,517 A
• Filed: 12/14/1993
• Issued: 10/17/1995
• Est. Priority Date: 12/15/1992
• Status: Expired due to Term

• Current Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Kunitake, Setsu, Kamizawa, Koh
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): LEE, RICHARD J
• Application Number:
  US08/166,047
• Time in Patent Office: 672 Days
• Field of Search: 348/150, 348/700, 348/701, 348/416, 348/579, 348/409, 358/311, 360/14.1, 360/14.2, 360/14.3
• US Class Current: 375/240.13
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/142 Detection of scene cut or scene change
• CPC Class Codes: H04N 19/179 the unit being a scene or a shot
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/87 involving scene cut or scene change detection in combination with video compression
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

A moving picture scene detection system for detecting a distinctive scene from moving picture data. In the system, the attribute data of the coded data stored in a data storing unit is decoded by a attribute data decoding unit, to produce the decoded attribute data. A distinctive candidate scene in the moving pictures is detected by a candidate scene detecting unit on the basis of the decoded attribute data. The candidate scene and the image data for several frames preceding and subsequent to the candidate scene are decoded by an image data decoding unit, and displayed by an image data display unit. The type of the candidate scene and the position thereof in the moving pictures are stored in the data storing unit as edit data.

Claims

1. A moving picture scene detection system comprising:

data storing means for storing coded data including moving picture data, as coded image data having successive frames, and attribute data, indicative of attributes of each of the frames of the moving picture data;

attribute data decoding means for decoding the attribute data of the coded data;

candidate scene detecting means for detecting a candidate for a distinctive scene using the decoded attribute data output from said attribute data decoding means;

image data decoding means for decoding the image data of the coded data from said data storing means in response to an output of said candidate scene detection means; and

image data display means for displaying the decoded image data output from said image data decoding means.

2. The moving picture scene detection system according to claim 1, further comprising:

difference means for determining a difference between attribute data of different frames;

intraframe coding means for coding the image data when the difference exceeds a threshold value in accordance with intraframe data; and

interframe coding means for coding the image data when the difference is smaller than the threshold value in accordance with interframe data.

3. The moving picture scene detection system according to claim 1, further comprising

coding means for coding the image data in accordance with a coding technique in which a code quantity is not controlled every frame, and said attribute data represents a code quantity of each frame.

4. The moving picture scene detection system according to claim 1, further comprising

coding means for coding the image data in accordance with compensating for motion between frames, said frames having motion vectors, and said attribute data represents a number of nonzero motion vectors of each frame.

5. The moving picture scene detection system according to claim 1, further comprising

coding means for coding the image data into image blocks, each image block including a preset number of pixels and representing a difference between a previous frame and a current frame, and

when an interframe difference between an image block in the previous frame and a corresponding image block in the current frame is smaller than a threshold value, the corresponding image block in the current frame is determined to be an insignificant image block and is not coded, and

when the interframe difference exceeds the threshold value, the corresponding image block in the current frame is determined to be a significant image block, and is coded, and

said attribute data of said coded image data represents a number of the significant image blocks in the current frame.

6. The moving picture scene detection system according to claim 1, further comprising

coding means for coding the image data into image blocks, each image block including a preset number of pixels and data representing a difference between a previous frame and a current frame, and

when an interframe difference between an image block in the previous frame and a corresponding image block in the current frame is smaller than a first threshold value, the corresponding image block in the current frame is determined to be an insignificant image block and is not coded,

when the interframe difference exceeds the first threshold value, the corresponding image block in the current frame is determined to be a significant image block and is coded, and

when an interframe difference data between corresponding significant image blocks in the previous frame and the current frame is smaller than a second threshold value, an interframe predictive coding technique is used for coding the image block, and

when the interframe difference data between corresponding significant image blocks exceeds the second threshold value, an intraframe coding technique is used for coding the image block,

said attribute data of said coded image data represents a ratio of a number of the intraframe coded image blocks to a number of significant image blocks in the current frame.

7. The moving picture scene detection system according to claim 1, wherein said candidate scene detecting means further comprises

frame comparison means for comparing two or more attribute data between different frames from the attribute data selected from a list consisting essentially of data for identifying an intraframe coding and an interframe coding, data representing a code quantity of each frame, data representing a number of nonzero motion vectors of each frame, data representing a number of significant blocks in the frame, and data representing a ratio of a number of intraframe coded image blocks to a number of significant blocks of the frame.

8. A moving picture scene detection system comprising:

data storing means for storing coded data including moving picture data, as coded image data having successive frames, attribute data, indicative of attributes of each of the frames of the moving picture data, and edit data of said coded image data;

attribute data decoding means for decoding the attribute data of the coded data;

candidate scene detecting means for detecting a candidate for a distinctive scene using the decoded attribute data output from said attribute data decoding means;

image data decoding means for decoding the image data of the coded data from said data storing means in response to an output of said candidate scene detecting means; and

image data display means for displaying the decoded image data output from said image data decoding means,

said edit data being the coded data of the candidate for a distinctive scene detected by said candidate scene detecting means.

9. The moving picture scene detection system according to claim 8, further comprising:

difference means for determining a difference between attribute data of different frames;

intraframe coding means for coding the image data when the difference exceeds a threshold value in accordance with intraframe data; and

interframe coding means for coding the image data when the difference is smaller than the threshold value in accordance with interframe data.

10. The moving picture scene detection system according to claim 8, further comprising

coding means for coding the image data in accordance with a coding technique in which a code quantity is not controlled every frame, and said attribute data represents a code quantity of each frame.

11. The moving picture scene detection system according to claim 8, further comprising

coding means for coding the image data in accordance with compensating for motion between frames, said frames having motion vectors, and said attribute data represents a number of nonzero motion vectors of each frame.

12. The moving picture scene detection system according to claim 8, further comprising

coding means for coding the image data into image blocks, each image block including a preset number of pixels and data representing a difference between a previous frame and a current frame, and

when an interframe difference between an image block in the previous frame and a corresponding image block in the current frame is smaller than a threshold value, the corresponding image block in the current frame is determined to be an insignificant image block and is not coded, and

when the interframe difference exceeds the threshold value, the corresponding image block in the current frame is determined to be a significant image block and is coded, and

said attribute data of said coded image data represents a number of the significant image blocks in the current frame.

13. The moving picture scene detection system according to claim 8, further comprising

coding means for coding the image data into image blocks, each image block consisting of a preset number of pixels and data representing a difference between a previous frame and a current frame, and

when an interframe difference between an image block in the previous frame and a corresponding image block in the current frame is smaller than a first threshold value, the corresponding image block in the current frame is determined to be an insignificant image block and is not coded,

when the interframe difference exceeds the first threshold value, the corresponding image block in the current frame is determined to be a significant image block and is coded, and

when an interframe difference data between corresponding significant image blocks in the previous frame and the current frame is smaller than a second threshold value, an interframe predictive coding technique is used for coding the image block, and

when the interframe difference data between corresponding significant image blocks exceeds the second threshold value, an intraframe coding technique is used for coding the image block,

said attribute data of said coded image data represents a ratio of a number of the intraframe coded image blocks to a number of significant image blocks in the current frame.

14. The moving picture scene detection system according to claim 8, wherein said candidate scene detecting means further comprises

frame comparison means for comparing two or more attribute data between different frames from the attribute data selected from a list consisting essentially of data for identifying an intraframe coding and an interframe coding, data representing a code quantity of each frame, data representing a number of nonzero motion vectors of each frame, data representing a number of significant blocks in the frame, and data representing a ratio of a number of intraframe coded image blocks to a number of significant blocks of the frame.