Method of using transcript information to identify and learn commercial portions of a program

• US 7,089,575 B2
• Filed: 09/04/2001
• Issued: 08/08/2006
• Est. Priority Date: 09/04/2001
• Status: Expired due to Fees

• Current Assignee: Fox Digital, Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Dimitrova, Nevenka, McGee, Thomas Francis, Agnihotri, Lalitha
• Primary Examiner(s): Grant, Christopher
• Assistant Examiner(s): PARRY, CHRISTOPHER L
• Application Number:
  US09/945,871
• Publication Number:
  US 20030050926A1
• Time in Patent Office: 1,799 Days
• Field of Search: 725 18- 20, 725/22, 725/32, 725 34- 35
• US Class Current: 725/20
• CPC Class Codes: H04H 60/48 for recognising items expressed in broadcast information
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04H 60/65 for using the result on users' side
• CPC Class Codes: H04H 60/72 using electronic programme guides [EPG] focusing on identifying broadcast space time H04H60/39 ; menu type display of EPG in television receivers H04N21/47

Abstract

Advertisers want to deliver their message in a relatively short period of time. This leads to the product name, company name and other identifying features being repeated frequently during a commercial broadcast. Transcript information can be used to detect commercials by detecting frequently occurring words in the commercials. This can also be used to identify an individual commercial from other commercials. Once the individual commercials have been identified, the transcript information corresponding to each commercial can be stored in a database to identify the commercial in subsequent broadcasts, or to provide a search mechanism for searching a particular commercial in the database.

Claims

1. A method of identifying commercial segments during a program comprising:

a. receiving an audio/data/video signal which includes at least one of transcript information and electronic programming guide (EPG) data and using the transcript information associated with the program;

b. detecting “

non-stop”

words in the transcript information during a first time period which occur more than a predetermined number of times;

c. detecting “

non-stop”

words in the transcript information during a second time period which occur more than a predetermined number of times;

d. comparing the “

non-stop”

words detected during the first time period and the “

non-stop”

words detected during the second time period; and

e. analyzing the transcript information and the electronic programming guide (EPG) data to determine a type of program being broadcast and whether the type of program being broadcast includes “

going into commercial” and

“

going out of commercial”

cues.

2. The method of identifying commercial segments according to claim 1 wherein the second time period overlaps in time with respect to the first time period.

3. The method of identifying commercial segments according to claim 1, wherein if the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period is indicative of a first commercial segment and the second time period is indicative of a second commercial segment; and

wherein if at least one of the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times is the same as at least one of the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period and second time period are indicative of a common commercial segment.

4. The method of identifying commercial segments according to claim 3 further comprising the steps of:

detecting “

non-stop”

words in the transcript information during a third time period which occur more than a predetermined number of times,

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period and the first time period, the third time period is indicative of a commercial segment which is not associated with the commercial segment of either of the first or second time periods, and

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are the same as the “

non-stop”

words detected during at least one of the second time period and the first time period, the third time period is indicative of a commercial segment which is associated with the commercial segment of the corresponding first or second time period.

5. The method of identifying commercial segments according to claim 4 wherein the third time period overlaps in time with respect to at least the second time period.

6. The method of identifying commercial segments according to claim 1, further comprising:

continuously monitoring the program for a beginning of a commercial segment, wherein steps b–

d are performed only after the beginning of a commercial segment has been identified.

7. The method of identifying commercial segments according to claim 6 wherein the step of continuously monitoring the program comprises the step of monitoring the transcript information associated with the program.

8. The method of identifying commercial segments according to claim 6 wherein if the transcript information is being monitored, a beginning of a commercial segment is detected if a number of occurrences of “

non-stop”

words during a predetermined time period is at least equal to a predetermined value.

9. The method of identifying commercial segments according to claim 1, wherein if the type of program does not include “

going into commercial”

cues, the method further comprises;

continuously monitoring the transcript information for a beginning of a commercial segment by searching for the occurrence of “

non-stop”

words above a predetermined value in a predetermined time period.

10. The method of identifying commercial segments according to claim 1, wherein if the type of program does not include “

going into commercial”

cues, continuously monitoring the audio/data/video signal for a portion which does not include transcript information and designating the corresponding portion of the program as a commercial segment.

11. The method of identifying commercial segments according to claim 1, wherein if the type of program does not include “

going into commercial” and

“

going out of commercial”

cues, continuously monitoring the audio/data/video signal and designating the corresponding portion of the program as a commercial segment.

12. The method of identifying commercial segments according to claim 1 further comprising the steps of:

continuously searching the transcript information for an end of a commercial segment,

wherein when a beginning and end of a commercial segment have been identified, storing at least one of the “

non-stop”

words and the transcript information interposed between the beginning and end of the commercial segment.

13. The method of identifying commercial segments according to claim 1 wherein if the “

non-stop”

words detected during the first time period occur more than the pre-determined number of times, the first time period is marked as a commercial area.

14. The method of identifying commercial segments according to claim 1 wherein the program is one of a broadcast television program, a broadcast radio program, internet or video/audio streaming, which can be multicast or unicast.

15. A method of learning and storing commercial segments which occur during a program comprising:

a. identifying a possible commercial segment which occurs during the program;

b. comparing “

non-stop”

words of the possible commercial segment with “

non-stop”

words of each of a list of probable commercial segments previously identified to determine at least one matching probable commercial segment having at least one common “

non-stop”

word with the possible commercial segment;

c. comparing transcript text of the possible commercial segment with transcript text of the at least one matching probable commercial segment;

d. storing the transcript text which is common to both the possible commercial segment and the at least one matching probable commercial segment;

e. automatically removing the at least one matching stored probable commercial segment from the list of probable commercial segments when the comparison of the transcript text of the possible commercial segment and the transcript text of the at least one matching probable commercial segment indicates they are substantially identical; and

f. automatically adding the at least one matching probable commercial segment to a list of candidate commercial segments when the comparison of the transcript text of the possible commercial segment and the transcript text of the at least one matching probable commercial segment indicates they are substantially identical.

16. The method of learning and storing commercial segments according to claim 15 wherein step a comprises at least one of monitoring transcript information to identify “

non-stop”

words which occur more than a predetermined number of times.

17. The method of learning and storing commercial segments according to claim 15 wherein if the “

non-stop”

words of at least one of the probable commercial segments are not identified as matching the “

non-stop”

words of the possible commercial segment, the method further comprises the step of;

adding the possible commercial segment to the list of probable commercial segments.

18. The method of learning and storing commercial segments according to claim 15, wherein step a comprises:

1. using transcript information associated with the program;

2. detecting “

non-stop”

words in the transcript information during a first time period which occur more than a predetermined number of times;

3. detecting “

non-stop”

words in the transcript information during a second time period which occur more than a predetermined number of times; and

4. comparing the “

non-stop”

words detected during the first time period and the “

non-stop”

words detected during the second time period.

19. The method of learning and storing commercial segments according to claim 18 wherein the second time period overlaps in time with respect to the first time period.

20. The method of learning and storing commercial segments according to claim 18, the method further comprising the steps of:

receiving an audio/data/video signal which includes at least one of transcript information and electronic programming guide (EPG) data; and

continuously monitoring the program for a beginning of a commercial segment, wherein steps 1–

4 are performed after the beginning of a commercial segment has been identified.

21. The method of learning and storing commercial segments according to claim 18, wherein if the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period is indicative of a first commercial segment and the second time period is indicative of a second commercial segment; and

wherein if at least one of the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times is the same as at least one of the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period and second time period are indicative of a common program segment.

22. The method of learning and storing commercial segments according to claim 21 further comprising the steps of:

detecting “

non-stop”

words in the transcript information during a third time period which occur more than a predetermined number of times,

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period and the first time period, the third time period is indicative of a commercial segment which is not associated with the commercial segment of either of the first and second time periods, and

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are the same as the “

non-stop”

words detected during at least one of the second time period and first time period, the third time period is indicative of a commercial segment which is associated with the commercial segment of either of the corresponding first and second time periods.

23. The method of learning and storing commercial segments according to claim 22 wherein the third time period overlaps in time with respect to at least the second time period.

24. The method of learning and storing commercial segments according to claim 15, further comprising automatically creating the list of probable commercial segments by analyzing a plurality of possible commercial segments identified over time.

25. A method of learning and storing commercial segments which occur during a program comprising:

a. identifying a possible commercial segment which occurs during the program;

b. comparing “

non-stop”

words of the possible commercial segment with “

non-stop”

words of each of a list of candidate commercial segments previously identified to determine at least one matching candidate commercial segment having at least one common “

non-stop”

word with the possible commercial segment;

c. comparing transcript text of the possible commercial segment with transcript text of the at least one matching candidate commercial segment;

d. storing the transcript text which is common to both the possible commercial segment and the at least one matching candidate commercial segment;

e. automatically removing the at least one matching candidate commercial segment from the list of candidate commercial segments when the comparison of the transcript text of the possible commercial segment and the transcript text of the at least one matching candidate commercial segment indicates they are substantially identical; and

f. automatically adding the at least one matching candidate commercial segment to a list of found commercial segments when the comparison of the transcript text of the possible commercial segment and the transcript text of the at least one matching candidate commercial segment indicates they are substantially identical.

26. The method of learning and storing commercial segments according to claim 25 wherein step a comprises at least one of monitoring transcript information to identify “

nonstop”

words which occur more than a predetermined number of times, and monitoring EPG data.

27. The method of learning and storing commercial segments according to claim 25 wherein if the “

non-stop”

words of at least one of the candidate commercial segments is not identified as matching the “

non-stop”

words of the possible commercial segment, the method further comprises;

comparing the possible commercial segment to a list of probable commercial segments.

28. The method of learning and storing commercial segments according to claim 25, wherein step a comprises:

1. using transcript information associated with the program;

2. detecting “

non-stop”

words in the transcript information during a first time period which occur more than a predetermined number of times;

3. detecting “

non-stop”

words in the transcript information during a second time period which occur more than a predetermined number of times; and

4. comparing the “

non-stop”

words detected during the first time period and the “

non-stop”

words detected during the second time period.

29. The method of identifying commercial segments according to claim 28 wherein the second time period overlaps in time with respect to the first time period.

30. The method of learning and storing commercial segments according to claim 28, the method further comprises the steps of:

receiving an audio/data/video signal which includes at least one of transcript information and electronic programming guide (EPG) data; and

continuously monitoring the program for a beginning of a commercial segment, wherein steps 1–

4 are performed only after the beginning of a commercial segment has been identified.

31. The method of learning and storing commercial segments according to claim 28, wherein if the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period is indicative of a first commercial segment and the second time period is indicative of a second commercial segment; and

wherein if at least one of the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times is the same as at least one of the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period and second time period are indicative of a common program segment.

32. The method of learning and storing commercial segments according to claim 31 further comprising the steps of:

detecting “

non-stop”

words in the transcript information during a third time period which occur more than a predetermined number of times,

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period and the first time period, the third time period is indicative of a commercial segment which is not associated with the commercial segment of either of the first and second time period, and

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are the same as the “

non-stop”

words detected during at least one of the second time period and first time period, this indicative of a commercial segment which is not associated with the commercial segment of either of the first and second time period, the third time period is indicative of a commercial segment which is associated with the commercial segment of either of the corresponding first and second time periods.

33. The method of learning and storing commercial segments according to claim 32 wherein the third time period overlaps in time with respect to at least the second time period.

34. A method of learning and storing commercial segments which occur during a program comprising:

a. identifying a possible commercial segment which occurs during the program;

b. comparing “

non-stop”

words of the possible commercial segment with “

non-stop”

words of each of a list of found commercial segments previously identified to determine at least one matching found commercial segment having at least one common “

non-stop”

word with the possible commercial segment;

c. comparing transcript text of the possible commercial segment with transcript text of the at least one matching found commercial segment;

d. storing the transcript text which is common to both the possible commercial segment and the at least one matching found commercial segment;

e. associating a counter with each found commercial segment which indicates the frequency of occurrence of the found commercial segment;

f. incrementing the counter for the at least one matching found commercial segment when the comparison of the transcript text of the possible commercial segment and the transcript text of the at least one matching found commercial segment indicates they are substantially identical; and

g. periodically determining whether the counter for any of the found commercial segments has not been incremented for a predetermined period of time and if so, removing the found commercial segment from the list of found commercial segments.

35. A method of learning and storing commercial segments according to claim 34 wherein if the “

non-stop”

words of at least one of the found commercial segments is not identified as matching the “

non-stop”

words of the possible commercial segment, comparing the “

non-stop”

words of the possible commercial segment to “

non-stop”

words of a list of candidate commercial segments.

36. A method of learning and storing commercial segments according to claim 35 wherein if the “

non-stop”

words of at least one of the stored candidate commercial segments is not identified as matching the “

non-stop”

words of the possible commercial segment, adding the possible commercial segment to the list of probable commercial segments.

37. The method of learning and storing commercial segments according to claim 34, wherein step a comprises:

1. using transcript information associated with the program;

2. detecting “

non-stop”

words in the transcript information during a first time period which occur more than a predetermined number of times;

3. detecting “

non-stop”

words in the transcript information during a second time period which occur more than a predetermined number of times; and

4. comparing the “

non-stop”

words detected during the first time period and the “

non-stop”

words detected during the second time period.

38. The method of learning and storing commercial segments according to claim 37 wherein the second time period overlaps in time with respect to the first time period.

39. The method of learning and storing commercial segments according to claim 37, the method further comprising the steps of:

receiving an audio/data/video signal which includes at least one of transcript information and electronic programming guide (EPG) data; and

continuously monitoring the program for a beginning of a commercial segment, wherein steps 1–

4 are performed only after the beginning of a commercial segment has been identified.

40. The method of learning and storing commercial segments according to claim 37, wherein if the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period is indicative of a first commercial segment and the second time period is indicative of a second commercial segment; and

wherein if at least one of the “

non-stop”

words detected during the first time period which occur more than the predetermined number of times is the same as at least one of the “

non-stop”

words detected during the second time period which occur more than the predetermined number of times, the first time period and second time period are indicative of a common program segment.

41. The method of learning and storing commercial segments according to claim 40 further comprising the steps of:

detecting “

non-stop”

words in the transcript information during a third time period which occur more than a predetermined number of times,

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are different from the “

non-stop”

words detected during the second time period and the first time period, the third time period is indicative of a commercial segment which is not associated with the commercial segment of either of the first and second time periods, and

wherein if the “

non-stop”

words detected during the third time period which occur more than the predetermined number of times are the same as the “

non-stop”

words detected during at least one of the second time period and the first time period, the third time period is indicative of a commercial segment which is associated with the commercial segment of either of the corresponding at least one of the first and second time periods.

42. The method of learning and storing commercial segments according to claim 41 wherein the third time period overlaps in time with respect to at least the second time period.

43. A method of storing commercial segments and retrieving a stored commercial segment comprising:

a. storing commercial segments in a plurality of lists based on frequency of previous appearance of the commercial segments such that commercial segments appearing several times are in a different list than commercial segments appearing only once;

b. identifying at least one “

non-stop”

word indicative of a desired commercial segment;

c. identifying stored commercial segments which contain the identified “

nonstop”

word by analyzing all of the plurality of lists to determine whether any of the commercial segments in the lists contain the identified “

non-stop”

word; and

d. outputting the identified stored commercial segments which contain the identified “

non-stop”

word.

44. The method of retrieving a stored commercial segment according to claim 43 further comprising the step of marking the identified stored commercial segment as a commercial area.

45. A method of learning and storing commercial segments which occur during a program comprising:

identifying a possible commercial segment which occurs during the program;

comparing “

non-stop”

words of the possible commercial segment with “

non-stop”

words of each of a list of found commercial segments previously identified to determine at least one matching found commercial segment having at least one common “

non-stop”

word with the possible commercial segment;

comparing the transcript text of the possible commercial segment with transcript text of the at least one matching found commercial segment;

storing the transcript text which is common to both the possible commercial segment and the at least one matching found commercial segment;

incrementing a counter which indicates the frequency of occurrence of the at least one matching found commercial segment; and

wherein if the “

non-stop”

words of at least one of the found commercial segments is not identified as matching the “

non-stop”

words of the possible commercial segment, comparing the “

non-stop”

words of the possible commercial segment to “

non-stop”

words of a list of candidate commercial segments.