Apparatus and method for detecting key caption from moving picture to provide customized broadcast service

• US 20070201764A1
• Filed: 07/19/2006
• Published: 08/30/2007
• Est. Priority Date: 02/27/2006
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jeong, Jin, Liu, Qifeng, Jung, Cheol, Moon, Young, Kim, Ji
• Application Number:
  US11/488,757
• Publication Number:
  US 20070201764A1
• Time in Patent Office: Days
• US Class Current: 382/292
• CPC Class Codes: G06V 20/635 Overlay text, e.g. embedded captions in a TV program

Abstract

An apparatus for detecting a caption from a moving picture, including: a caption domain detector selecting a candidate frame based on input genre information from an input moving picture and determining expectation caption domains from the selected candidate frame set; a target caption detector selecting target caption candidate domains based on repetition of a position or color pattern of the expectation caption domains and determining target caption domains based on a rate of change in a character or number domain from the selected target caption candidate domains; and a key caption detector detecting a key character or number information domain by analyzing the target caption domains.

Claims

1. An apparatus for detecting a caption from a moving picture, comprising:

a caption domain detector selecting a candidate frame set from the moving picture based on a genre information and determining expectation caption domains from the selected candidate frame set;

a target caption detector selecting target caption candidate domains based on color pattern of the expectation caption domains and determining target caption domains based on a rate of change in a character and/or number domain from the selected target caption candidate domains; and

a key caption detector detecting a key character and/or number information domain by analyzing the target caption domains.

2. The apparatus of claim 1, the target caption detector selecting target caption candidate domains based on a position of the expectation caption domains.

3. The apparatus of claim 1, further comprising:

a detailed information database storing detailed information of genre of the moving picture.

4. The apparatus of claim 3, wherein the key caption detector detecting the number information and/or character information based on the detailed information from the detailed information database.

5. The apparatus of claim 1, wherein the genre information is received from any of a PVR (Personal Video Recorder), an WiBro device, a DMB phone, and a web server coupled with a personal home server.

6. The apparatus of claim 1, wherein the caption domain detector comprises:

a candidate frame selection unit selecting a relevant candidate frame set according to a genre indicated by the genre information; and

a caption domain determination unit determining the expectation caption domains which include a caption from the selected candidate frame set.

7. The apparatus of claim 6, wherein the candidate frame selection unit selects any one of an anchor shot of news, a pitch view of baseball field, and a long-distance view image of soccer or golf field, as the candidate frame set.

8. The apparatus of claim 1, wherein the target caption detector comprises:

a target caption candidate selection unit accumulating the detected expectation caption domains and selecting the accumulated expectation caption domains whose repeatability of the color pattern is larger than a threshold value, to be the target caption candidate domains; and

a target caption determination unit determining the target caption domains by analyzing the rate of change in the character or number domain from the selected target caption candidate domains.

9. The apparatus of claim 8, wherein the target caption candidate selection unit obtains representative color values of the accumulated expectation caption domains by using a predetermined color identification algorithm, and selects the domains corresponding to clusters having a representative color value larger than the threshold value as target caption candidate domains using pattern-modeling according to a clustering of the representative color values.

10. The apparatus of claim 9, wherein the pattern-modeling comprises:

determining whether the representative color value is corresponding to an affiliate cluster in a predetermined range;

clustering representative color values corresponding to the affiliate cluster to a same group and updating a relevant center point;

clustering representative color values which are not corresponding to the affiliate cluster, to another group, and calculating and storing the relevant center point.

11. The apparatus of claim 9, wherein the clusters based on a number of the groups of the representative color values are selected, and the selected clusters are compared with the threshold value.

12. The apparatus of claim 8, wherein the target caption determination unit extracts the character or number domain from the selected target caption candidate domains by using dual binarization, determines the number domain by analyzing the rate of change of the extracted character or number domain by using a predetermined character recognition algorithm, and determines the target caption domains according to a rate of change in brightness of the determined number domain.

13. The apparatus of claim 1, wherein the key caption detector detects the number information domain by using number information included in the target caption domains and detects the character information domain by comparing character information included in the target caption domains with predetermined information with respect to the input moving picture from a predetermined database or web server.

14. The apparatus of claim 13, wherein the key caption detector extracts a number domain by using dual binarization for each of the detected number information domains when a target caption exists in the character information domain and recognizes a number by analyzing the rate of change in the extracted number domain by using the predetermined character recognition algorithm.

15. The apparatus of claim 14, wherein the key caption detector compensates for the recognized number by using continuity and detects a relevant key number by determining a key number information domain using the compensated number.

16. The apparatus of claim 14, wherein the dual binarization comprises:

generating two binarized images by binarizing an input image to black and white colors inverted with each other according to each of two predetermined threshold values;

removing noise from the two binarized images according to a predetermined algorithm;

determining predetermined domains by compositing the two binarized images from which the noise is removed; and

obtaining a corresponding information domain by enlarging the determined domains to a predetermined size.

17. An apparatus for detecting a caption from a moving picture, comprising:

a target caption candidate selection unit obtaining representative color values of input moving picture patterns by using a predetermined color identification algorithm, and selecting domains corresponding to clusters having the representative color value larger than a predetermined threshold value as target caption candidate domains using pattern-modeling according to a clustering of the representative color values; and

a target caption determination unit determining target caption domains by analyzing a rate of change in a key character or number domain from the selected target caption candidate domains,

wherein character or number information domain is detected by analyzing the determined target caption domains.

18. The apparatus of claim 17, wherein the pattern-modeling comprises:

determining whether the representative color value is corresponding to an affiliate cluster in a predetermined range;

clustering representative color values corresponding to the affiliate cluster to a same group and updating a relevant center point;

clustering representative color values which are not corresponding to the affiliate cluster, to another group, and calculating and storing the relevant center point.

19. A method of detecting a caption from a moving picture, comprising:

selecting a candidate frame set from the moving picture based on a genre information;

determining expectation caption domains from the selected candidate frame set;

selecting target caption candidate domains based on repetition of color pattern of the expectation caption domains;

determining target caption domains based on a rate of change in a character or number domain from the selected target caption candidate domains; and

detecting a key character or number information domain by analyzing the target caption domains.

20. The method of claim 19, wherein the candidate frame set is any one of an anchor shot of news, a pitch view of baseball field, and a long-distance image of soccer or golf field.

21. The method of claim 19, wherein the expectation caption domains are accumulated and the accumulated expectation caption domains whose repeatability of the color pattern is greater than a threshold value are selected to be the target caption candidate domains.

22. The method of claim 21, further comprising:

obtaining representative color values of the accumulated expectation caption domains by using a predetermined color identification algorithm;

pattern-modeling according to a clustering of the representative color values; and

selecting domains corresponding to clusters having the representative color value greater than the predetermined threshold value as target caption candidate domains from results of the pattern-modeling.

23. The method of claim 22, wherein the pattern-modeling comprises:

determining whether the representative color value is corresponding to an affiliate cluster in a predetermined range;

clustering representative color values corresponding to the affiliate cluster to a same group and updating a relevant center point;

clustering representative color values which are not corresponding to the affiliate cluster to another group, and calculating and storing the relevant center point.

24. The method of claim 22, wherein the clusters based on a number of the groups of the representative color values are selected and the selected clusters are compared with the threshold value.

25. The method of claim 19, further comprising:

extracting the character or number domain from the selected target caption candidate domains by using dual binarization;

determining the number domain by analyzing the rate of change of the extracted character or number domain by using a predetermined character recognition algorithm; and

determining the target caption domains according to rate of change in brightness of the determined number domain.

26. The method of claim 19, further comprising:

detecting the number information domain by using number information included in the target caption domains; and

detecting the character information domain by comparing character information included in the target caption domains with predetermined information with respect to the input moving picture from a predetermined database or web server.

27. The method of claim 26, further comprising:

performing dual binarization for each of the detected number information domains when a target caption exists in the character information domain;

extracting the number domain from the dual binarization; and

recognizing a number by analyzing the rate of change in the extracted number domain by using the predetermined character recognition algorithm.

28. The method of claim 27, further comprising:

compensating for the recognized number by using continuity; and

detecting a relevant key number by determining a key number information domain using the compensated number.

29. The method of claim 27, the dual binarization comprises:

generating two binarized images by binarizing an input image to black and white colors inverted with each other according to each of two predetermined threshold values;

removing noise from the two binarized images according to a predetermined algorithm;

determining predetermined domains by compositing the two binarized images from which the noise is removed; and

obtaining a corresponding information domain by enlarging the determined domains to a predetermined size.

30. A method of detecting a caption from a moving picture, comprising:

obtaining representative color values of input moving picture patterns by using a predetermined color identification algorithm;

pattern-modeling according to a clustering of the representative color values;

selecting domains corresponding to clusters having the representative color value greater than a predetermined threshold value as target caption candidate domains from results of the pattern-modeling;

determining target caption domains by analyzing a rate of change in a key character or number domain from the selected target caption candidate domains; and

detecting a character or number information domain by analyzing the determined target caption domains.

31. The method of claim 30, wherein the pattern-modeling comprises:

determining whether the representative color value is corresponding to an affiliate cluster in a predetermined range;

clustering representative color values corresponding to the affiliate cluster to a same group and updating a relevant center point;

clustering representative color values not corresponding to the affiliate cluster to another group, and calculating and storing the relevant center point.

32. A method of detecting a caption from a moving picture, comprising:

selecting a candidate frame set from the moving picture based on information;

determining expectation caption domains from the selected candidate frame set;

selecting target caption candidate domains based on repetition of color pattern of the expectation caption domains;

determining target caption domains based on a rate of change in a character and/or number domain from the selected target caption candidate domains; and

detecting a key character and/or number information domain by analyzing the target caption domains.

33. The method of claim 32, wherein the information is genre information.