Method and apparatus for locating a caption-added frame in a moving picture signal

• US 6,219,382 B1
• Filed: 11/21/1997
• Issued: 04/17/2001
• Est. Priority Date: 11/25/1996
• Status: Expired due to Term

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Tanaka, Akiyoshi, Kikuchi, Yasuhiro, Yamada, Shin
• Primary Examiner(s): Le, Vu
• Application Number:
  US08/976,013
• Time in Patent Office: 1,243 Days
• Field of Search: 348/402, 348/407, 348/413, 348/416, 348/699, 348/420, 348/589, 348/700, 348/416.1, 348/417.1, 348/418.1, 348/422.1, 348/425.1, 348/431.1, 382/165, 382/190, 382/194, 382/170, 382/176, 382/181, 382/189, 382/192, 375/240.16, 386/109, 386/111
• US Class Current: 375/240.16
• CPC Class Codes: G06V 20/635 Overlay text, e.g. embedded captions in a TV program
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/90 Tape-like record carriers
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/107 of operating tapes
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

Every frame represented by a moving picture signal is divided into blocks. Calculation is made as to a number of pixels forming portions of a caption in each of the blocks. The calculated number of pixels is compared with a threshold value. When the calculated number of pixels is equal to or greater than the threshold value, it is decided that the related block is a caption-containing block. Detection is made as to a time interval related to the moving picture signal during which every frame represented by the moving picture signal has a caption-containing block. A 1-frame-corresponding segment of the moving picture signal is selected which represents a caption-added frame present in the detected time interval.

Claims

1. A moving picture search apparatus comprising:

first means for dividing every frame represented by a moving picture signal into blocks;

second means for calculating a number of pixels forming portions of a caption in each of the blocks;

third means for comparing the number of pixels which is calculated by the second means with a threshold value;

fourth means for, when the calculated number of pixels is equal to or greater than the threshold value, deciding that the related block is a caption-containing block;

fifth means for detecting a time interval related to the moving picture signal during which every frame represented by the moving picture signal has a caption-containing block decided by the fourth means; and

sixth means for selecting a 1-frame-corresponding segment of the moving picture signal which represents a caption-added frame present in the time interval detected by the fifth means.

2. A moving picture search apparatus as recited in claim 1, wherein the second means comprises means for detecting a luminance level of each of pixels composing a block, means for comparing the detected luminance level with a threshold level, and means for, when the detected luminance level is equal to or greater than the threshold level, deciding that the related pixel forms a portion of a caption.

3. A moving picture search apparatus as recited in claim 1, wherein the second means comprises means for detecting a luminance level of each of pixels composing a block, means for comparing the detected luminance level with a threshold level, means for calculating a difference between the detected luminance level of each of pixels and the detected luminance level of a neighboring pixel, means for comparing the calculated difference with a threshold difference, and means for, when the detected luminance level is equal to or greater than the threshold level and the calculated difference is equal to or greater than the threshold difference, deciding that the related pixel forms a portion of a caption.

4. A moving picture search apparatus as recited in claim 1, wherein the second means comprises means for detecting a color of each of pixels composing a block, means for comparing the detected color with a reference color range, and means for, when the detected color is in the reference color range, deciding that the related pixel forms a portion of a caption.

5. A moving picture search apparatus as recited in claim 1, wherein the second means comprises means for detecting a color of each of pixels composing a block, means for comparing the detected color with a reference color range, means for calculating a difference between the detected color of each of pixels and the detected color of a neighboring pixel, means for comparing the calculated difference with a reference difference, and means for, when the detected color is in the reference color range and the calculated difference is in the reference difference, deciding that the related pixel forms a portion of a caption.

6. A moving picture search apparatus as recited in claim 1, wherein the fourth means comprises means for comparing the calculated number of pixels in a block in a present frame with a second threshold value, means for comparing the calculated number of pixels in the block in a previous frame with the second threshold value, means for calculating an absolute value of a difference between the calculated number of pixels in the block in the present frame and the calculated number of pixels in the block in the previous frame, means for comparing the calculated absolute value of the difference with a third threshold value, and means for, when both the calculated number of pixels in the block in the present frame and the calculated number of pixels in the block in the previous frame are equal to or greater than the second threshold value and the calculated absolute value of the difference is equal to or smaller than the third threshold value, deciding that the related block is a caption-containing block.

7. A moving picture search apparatus as recited in claim 6, further comprising:

means for deciding whether or not caption-containing blocks decided by the fourth means are successive along one of a horizontal direction and a vertical direction in a predetermined range;

means for deciding whether or not caption-containing blocks of a same position which are decided by the fourth means are successive in at least a given number of frames;

means for, when the caption-containing blocks decided by the fourth means are successive along one of the horizontal direction and the vertical direction in the predetermined range and the caption-containing blocks of the same position which are decided by the fourth means are successive in at least the given number of frames, deciding that the related area is a caption area;

means for detecting a second time interval during which every frame represented by the moving picture signal has a caption area; and

means for selecting a 1-frame-corresponding segment of the moving picture signal which represents a caption-containing frame present in the second time interval.

8. A moving picture search apparatus as recited in claim 7, further comprising:

means for dividing every frame represented by the moving picture signal into zones;

means for calculating a number of frames having caption areas for each of the zones related to all the selected 1-frame-corresponding segments of the moving picture signal;

means for detecting a maximum number among the calculated numbers for the respective zones; and

means for selecting one of the 1-frame-corresponding segments of the moving picture signal which relates to the maximum number as a typical frame.

9. A moving picture search apparatus as recited in claim 7, further comprising:

means for designating one of the zones; and

means for selecting one of the 1-frame-corresponding segments of the moving picture signal which represents a caption-added frame having a caption area in the designed zone as a typical frame.

10. A method comprising the steps of:

a) dividing every frame represented by a moving picture signal into blocks;

b) calculating a number of pixels forming portions of a caption in each of the blocks;

c) comparing the number of pixels which is calculated by the step b) with a threshold value;

d) when the calculated number of pixels is equal to or greater than the threshold value, deciding that the related block is a caption-containing block;

e) detecting a time interval related to the moving picture signal during which every frame represented by the moving picture signal has a caption-containing block decided by the step d); and

f) selecting a 1-frame-corresponding segment of the moving picture signal which represents a caption-added frame present in the time interval detected by the step e).