Musical composition recognition method and system, storage medium where musical composition program is stored, commercial recognition method and system, and storage medium where commercial recognition program is stored

• US 20040055445A1
• Filed: 04/23/2003
• Published: 03/25/2004
• Est. Priority Date: 10/23/2000
• Status: Active Grant

• Current Assignee: NTT Communications Corporation (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Communications Corporation (Nippon Telegraph and Telephone Corporation)
• Inventors: Kobayashi, Tatsuhiro, Iyoku, Miwako
• Granted Patent: US 7,277,852 B2
• Time in Patent Office: Days
• US Class Current: 84/609
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2240/141 Library retrieval matching, i.e. any of the steps of matching an inputted segment or phrase with musical database contents, e.g. query by humming, singing or playing; the steps may include, e.g. musical analysis of the input, musical feature extraction, query formulation, or details of the retrieval process
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A playlist generating method for generating a playlist of content from received broadcasted data is provided. The playlist generating method includes the steps of: extracting features of broadcast content beforehand, storing the features in a content feature file, and storing information relating to the broadcast content in a content information DB; extracting features from the received data, and storing the features in a data feature file; searching for broadcast content of a predetermined kind by comparing data in the content feature file and data in the data feature file; when a name of the predetermined kind of content is determined, storing data corresponding to the broadcast content of the predetermined kind in a search result file; generating a playlist for the broadcast content of the predetermined kind from the search result file and the content information DB.

Claims

1. A playlist generating method for generating a playlist of content from received data, the playlist generating method comprising the steps of:

extracting features of content beforehand, storing the feature in a content feature file, and storing information relating to the content in a content information DB;

extracting features from the received data, and storing the features in a data feature file;

searching for content by comparing data in the content feature file and data in the data feature file;

when the data in the content feature file matches the data in the data feature file, data corresponding to the matched data is stored in a search result file; and

generating a playlist for the content from the search result file and the content information DB.

2. The playlist generating method as claimed in claim 1, the method further comprising the step of, when data in the data feature file is not included in the content feature file, registering the data in the content feature file.

3. The playlist generating method as claimed in claim 2, the method further comprising the steps of:

making content corresponding to the data that is not included in the content feature file to be watched or listened to by a person; and

registering information relating to the content in the content information DB.

4. The playlist generating method as claimed in claim 1, the method further comprising the steps of:

when data in the data feature file is not included in the content feature file, making content corresponding to the data to be watched or listened to by a person;

adding the content to the playlist with information related to the content.

5. A music recognizing method for recognizing music from received data, the method comprising the steps of:

extracting features of music content beforehand, storing the features in a content feature file;

extracting features from the received data, and storing the features in a broadcast feature file;

searching for music by comparing data in the content feature file and data in the broadcast feature file;

when a music name is determined, the music name is stored in a search result file; and

generating a playlist of music from the search result file.

6. The music recognizing method as claimed in claim 5, the method further comprising the steps of:

determining whether the received data is music or not;

if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

if a music name for data in the broadcast feature file is not determined in the step of searching for music, storing the data in a music name not-extracted file; and

generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

7. The music recognizing method as claimed in claim 6, the method further comprising the steps of:

making the music stored in the music not-detected file to be listened to by a person;

adding a music name and time of the music stored in the music not-detected file in the playlist.

8. The music recognizing method as claimed in claim 5, the method comprising the step of generating the time-series playlist by using the search result file and the content information DB including information associated with the music name,

wherein the time-series playlist includes time, a name of music broadcasted at the time and information related to the name.

9. The music recognizing method as claimed in claim 5, the method comprising the steps of:

receiving broadcasted data in a plurality of areas;

sending data received in each area to a center system;

generating the time-series playlist by using the music recognizing method in the center system.

11. The music recognizing method as claimed in claim 8, wherein each of the content information DB and the information related to the music name includes information related to a CM, and the information related to the CM in the content information DB is registered in the content information DB beforehand by the CM recognizing method, the CM recognizing method further comprising the steps of:

detecting CM data from the received data;

extracting features of the CM data, and storing the features in the broadcast feature file;

performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file included in the content information DB as a new CM.

10. A music recognizing method for recognizing music from received data, the method comprising the steps of:

extracting features of music content beforehand, storing the features in a content feature file;

receiving broadcasted data in a plurality of areas;

extracting features from the received data, and sending the features as data of a broadcast feature file to a center system in each area;

in the center system, searching for music by comparing data in the content feature file and data in the broadcast feature file;

if a music name is determined, the music name is stored in a search result file; and

generating a playlist of music from the search result file.

12. A CM recognizing method for recognizing a CM from received data, and storing recognized CM data, the method comprising the steps of:

detecting CM data from the received data;

extracting features of the CM data, and storing the features in a broadcast feature file;

performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM.

13. The CM recognizing method as claimed in claim 12, the step of detecting the CM data from the received data comprising the step of detecting a start point and an end point of the CM data,

wherein, when the features of the CM data are extracted, a part of the CM data is cut out to a predetermined length, such that a length from the center of the CM data to an end is the same as a length from the center to another end.

14. The CM recognizing method as claimed in claim 12, the method further comprising the steps of:

displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.

15. A playlist generating system for generating a playlist of content from received data, the playlist generating system comprising:

means for obtaining data in a content feature file that stores features of content beforehand, and data in a content information DB that stores information related to the content;

means for extracting features from the received data, and storing the features in a data feature file;

means for searching for content by comparing data in the content feature file and data in the data feature file;

means for, if the data in the content feature file matches the data in the data feature file, storing data corresponding to the data in a search result file; and

means for generating a playlist for the content from the search result file and the content information DB.

16. The playlist generating system as claimed in claim 15, the playlist generating system further comprising means for, if data in the data feature file is not included in the content feature file, registering the data of the data feature file in the content feature file.

17. The playlist generating system as claimed in claim 16, the system further comprising:

means for making content corresponding to the data that is not included in the content feature file to be watched or listened to by a person; and

means for registering information corresponding to the content in the content information DB.

18. The playlist generating system as claimed in claim 15, the system further comprising:

means for, if data in the data feature file is not included in the content feature file, making content corresponding to the data that is not included in the content feature file to be watched or listened to by a person;

adding the content to the playlist with information related to the content.

19. A music recognizing system for recognizing music from received data, the system comprising:

means for obtaining data of a content feature file in which features of music content are stored;

means for extracting features from the received data, and storing the features in a broadcast feature file;

means for searching for music by comparing data in the content feature file and data in the broadcast feature file;

means for, if a music name is determined, storing the music name in a search result file; and

means for generating a playlist of music from the search result file.

20. The music recognizing system as claimed in claim 19, the system further comprising:

means for determining whether the received data is music or not;

means for, if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

means for, if a music name of data in the broadcast feature file is not determined, storing the data in a music name not-extracted file; and

means for generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

21. The music recognizing system as claimed in claim 20, the system further comprising:

means for making the music stored in the music not-detected file to be listened to by a person;

means for adding a music name and time on the music stored in the music not-detected file in the playlist.

22. The music recognizing system as claimed in claim 19, the system comprising:

means for obtaining data from a content information DB including information associated with the music name;

means for generating the time-series playlist by using the search result file and the content information DB,

wherein the time-series playlist includes time, a name of music broadcasted at the time and information related to the name.

23. A music recognizing system for recognizing music from received data, the system comprising:

a plurality of apparatuses for receiving broadcasted data in a plurality of areas;

a center system for receiving data received in each area from each apparatus, the center system comprising;

means for obtaining data of a content feature file in which features of music content is stored;

means for extracting features from the received data, and storing the features in a broadcast feature file;

means for searching for music by comparing data in the content feature file and data in the broadcast feature file;

means for, if a music name is determined, storing the music name in a search result file; and

means for generating a playlist of music from the search result file.

24. A music recognizing system for recognizing music from received data, the system comprising:

a plurality of apparatuses for receiving broadcasted data and extracting features of the broadcasted data in a plurality of areas;

a center system for receiving the features of data received in each area from each apparatus, the center system comprising;

means for obtaining data of a content feature file in which features of music content is stored;

means for searching for music by comparing data in the content feature file and data in the broadcast feature file;

means for, if a music name is determined, storing the music name in a search result file; and

means for generating a playlist of music from the search result file.

25. A CM recognizing system for recognizing a CM from received data, and storing recognized CM data, the system comprising:

means for detecting CM data from the received data;

means for extracting features of the CM data, and storing the features in a broadcast feature file;

means for performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

means for, if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM.

26. The CM recognizing system as claimed in claim 25, the means for detecting the CM data from the received data comprising means for detecting a start point and an end point of the CM data,

wherein, when the features of the CM data are extracted, a part of the CM data is cut out to a predetermined length, such that a length from the center of the CM data to an end is the same as a length from the center to another end.

27. The CM recognizing system as claimed in claim 25, the system further comprising:

means for displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

means for registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.

28. A computer readable medium recording program code for causing a computer to perform processes for generating a playlist of content from received data, the computer readable medium comprising:

program code means for extracting features from the received data, and storing the features in a data feature file;

program code means for obtaining data of a content feature file in which features of the content are stored beforehand, and searching for content by comparing data in the content feature file and data in the data feature file;

program code means for, if the data in the content feature file matches the data in the data. feature file, storing data corresponding to the data in a search result file; and

program code means for generating a playlist for the content from the search result file and the content information DB.

29. The computer readable medium as claimed in claim 28, the computer readable medium further comprising program code means for, if data in the data feature file is not included in the content feature file, registering the data of the data feature file in the content feature file.

30. The computer readable medium as claimed in claim 29, the computer readable medium further comprising:

program code means for making content corresponding to the data that is not included in the content feature file to be watched or listened to by a person; and

program code means for registering information corresponding to the content in the content information DB.

31. The computer readable medium as claimed in claim 28, the computer readable medium further comprising:

program code means for, if data in the data feature file is not included in the content feature file, making content corresponding to the data that is not included in the content feature file to be watched or listened to by a person;

program code means for adding the content to the playlist with information related to the content.

32. A computer readable medium recording program code for causing a computer to perform processes for recognizing music from received data, the computer readable medium comprising:

program code means for extracting features from the received data, and storing the features in a broadcast feature file;

program code means for searching for music by comparing data in a content feature file in which features of music content are stored and data in the broadcast feature file;

program code means for, if a music name is determined, storing the music name in a search result file; and

program code means for generating a playlist of music from the search result file.

33. The computer readable medium as claimed in claim 32, the computer readable medium further comprising:

program code means for determining whether the received data is music or not;

program code means for, if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

program code means for, if a music name of the data in the broadcast feature file is not determined, storing the data in a music name not-extracted file; and

program code means for generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

34. The computer readable medium as claimed in claim 33, the computer readable medium further comprising:

program code means for making the music stored in the music not-detected file to be listened to by a person;

program code means for adding a music name and time on the music stored in the music not-detected file in the playlist.

35. The computer readable medium as claimed in claim 32, the computer readable medium comprising:

program code means for obtaining data from a content information DB including information associated with the music name;

program code means for generating the time-series playlist by using the search result file and the content information DB,

wherein the time-series playlist includes time, a name of music broadcasted at the time and information related to the name.

36. A computer readable medium recording program code for causing a computer to perform processes for recognizing music from received data, the computer readable medium comprising:

program code means for receiving features of broadcasted data received in each area as a broadcast feature file from each apparatus;

program code means for searching for music by comparing data in a content feature file in which features of music content are stored and data in the broadcast feature file;

program code means for, if a music name is determined, storing the music name in a search result file; and

program code means for generating a time-series playlist of music from the search result file.

37. A computer readable medium recording program code for causing a computer to perform processes for recognizing a CM from received data, and storing recognized CM data, the computer readable medium comprising:

program code means for detecting CM data from the received data;

program code means for extracting features of the CM data, and storing the features in a broadcast feature file;

program code means for performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

program code means for, if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM.

38. The computer readable medium as claimed in claim 37, the program code means for detecting the CM data from the received data comprising program code means for detecting a start point and an end point of the CM data,

wherein, when the features of the CM data are extracted, a part of the CM data is cut out to a predetermined length, such that a length from the center of the CM data to an end is the same as a length from the center to another end.

39. The computer readable medium as claimed in claim 37, the computer readable medium further comprising:

program code means for displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

program code means for registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.