Method, system and storage medium for commercial and musical composition recognition and storage

• US 7,277,852 B2
• Filed: 10/22/2001
• Issued: 10/02/2007
• Est. Priority Date: 10/23/2000
• Status: Expired due to Fees

• Current Assignee: NTT Communications Corporation (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Communications Corporation (Nippon Telegraph and Telephone Corporation)
• Inventors: Kobayashi, Tatsuhiro, Iyoku, Miwako
• Primary Examiner(s): Hudspeth; David
• Assistant Examiner(s): Rider; Justin W
• Application Number:
  US10/399,406
• Publication Number:
  US 20040055445A1
• Time in Patent Office: 2,171 Days
• Field of Search: 704/231, 704/232, 704/236
• US Class Current: 704/236
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/638 Presentation of query results
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2240/141 Library retrieval matching, i.e. any of the steps of matching an inputted segment or phrase with musical database contents, e.g. query by humming, singing or playing; the steps may include, e.g. musical analysis of the input, musical feature extraction, query formulation, or details of the retrieval process
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

A playlist generating method for generating a playlist of content from received broadcasted data is provided. The playlist generating method includes the steps of: extracting features of broadcast content beforehand, storing the features in a content feature file, and storing information relating to the broadcast content in a content information DB; extracting features from the received data, and storing the features in a data feature file; searching for broadcast content of a predetermined kind by comparing data in the content feature file and data in the data feature file; when a name of the predetermined kind of content is determined, storing data corresponding to the broadcast content of the predetermined kind in a search result file; generating a playlist for the broadcast content of the predetermined kind from the search result file and the content information DB.

Claims

1. A music recognizing method for recognizing music from received data, the method comprising the steps of:

extracting features of music content beforehand, storing the features and corresponding music names in a content feature file;

extracting a feature from the received data, and storing the feature and a time in a broadcast feature file;

searching for a music name of the feature in the broadcast feature file by comparing data in the content feature file and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

when the music name is determined, the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name are stored in a search result file; and

generating a time-series playlist of music using the search result file and a content information database (DB) including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information associated with the music name.

2. The music recognizing method as claimed in claim 1, the method further comprising the steps of:

determining whether the received data is music or not;

if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

if a music name for data in the broadcast feature file is not determined in the step of searching for music, storing the data in a music name not-extracted file; and

generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

3. The music recognizing method as claimed in claim 2, the method further comprising the steps of:

making the music stored in the music not-detected file to be listened to by a person;

adding a music name and a time of the music stored in the music not-detected file in the playlist.

4. The music recognizing method as claimed in claim 1, the method comprising the steps of:

receiving broadcasted data in a plurality of areas;

sending data received in each area to a center system;

generating the time-series playlist by using the music recognizing method in the center system.

5. The music recognizing method as claimed in claim 1, wherein each of the content information DB and the information related to the music name includes information related to a commercial (CM), and the information related to the CM in the content information DB is registered in the content information DB beforehand by the CM recognizing method, the CM recognizing method further comprising the steps of:

detecting CM data from the received data;

extracting features of the CM data, and storing the features in the broadcast feature file;

performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file included in the content information DB as a new CM.

6. A music recognizing method for recognizing music from received data, the method comprising the steps of:

extracting features of music content beforehand, storing the features and corresponding music names in a content feature file;

receiving broadcasted data in a plurality of areas;

extracting a feature from the received data, and sending the feature and a time as data of a broadcast feature file to a center system in each area;

in the center system, searching for music name of the feature in the broadcast feature file by comparing data in the content feature file and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

when the music name is determined, the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name are stored in a search result file; and

generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information associated with the music name.

7. A commercial (CM) recognizing method for recognizing CM data from received data, and storing the recognized CM data, the method comprising the steps of:

detecting the CM data from the received data;

extracting features of the CM data, and storing features in a broadcast feature file;

performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM,

the step of detecting the CM data from the received data comprising the steps of;

detecting a start point and an end point of the CM data, by using a CM detecting module for detecting cut points in images; and

cutting out a part of the CM data to obtain a predetermined length such that a length from the center of the CM data to an end is the same as a length from the center to another end so as to extract the features of the CM data from the part of the predetermined length in the extracting step.

8. The CM recognizing method as claimed in claim 7, the method further comprising the steps of:

displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.

9. A music recognizing system for recognizing music from received data, the system comprising:

means for obtaining data of a content feature file in which features and corresponding music names of music content are stored;

means for extracting a feature from the received data, and storing the feature and a time in a broadcast feature file;

means for searching for a music name of the feature in the broadcast feature file by comparing data in the content feature file and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

means for, when the music name is determined, storing the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name in a search result file; and

means for generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information associated with the music name.

10. The music recognizing system as claimed in claim 9, the system further comprising:

means for determining whether the received data is music or not;

means for, if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

means for, if a music name of data in the broadcast feature file is not determined, storing the data in a music name not-extracted file; and

means for generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

11. The music recognizing system as claimed in claim 10, the system further comprising:

means for making the music stored in the music not-detected file to be listened to by a person;

means for adding a music name and a time on the music stored in the music not-detected file in the playlist.

12. A music recognizing system for recognizing music from received data, the system comprising:

a plurality of apparatuses for receiving broadcasted data in a plurality of areas;

a center system for receiving data received in each area from each apparatus, the center system comprising;

means for obtaining data of a content feature file in which features and corresponding music names of music content are stored;

means for extracting feature from the received data, and storing the feature and a time in a broadcast feature file;

means for searching for a music name of the feature in the broadcast feature file by comparing data in the content feature file and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

means for, when the music name is determined, storing the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name in a search result file; and

means for generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information with the music name.

13. A music recognizing system for recognizing music from received data, the system comprising:

a plurality of apparatuses for receiving broadcasted data and extracting features of the broadcasted data in a plurality of areas;

a center system for receiving the features of data received in each area from each apparatus, the center system comprising;

means for obtaining data of a content feature file in which features and corresponding music names of music content are stored;

means for extracting a feature from the received data, and storing the feature and a time in a broadcast feature file;

means for searching for a music name of the feature in the broadcast feature file by comparing data in the content feature file and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

means for, when the music name is determined, storing the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name in a search result file; and

means for generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information with the music name.

14. A commercial (CM) recognizing system for recognizing CM data from received data, and storing the recognized CM data, the system comprising:

means for detecting the CM data from the received data;

means for extracting features of the CM data, and storing the features in a broadcast feature file;

means for performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

means for, if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM;

the means for detecting the CM data from the received data comprising means for detecting a start point and an end point of the CM data by using a CM detection module for detecting cut points in images; and

cutting out a part of the CM data to obtain a predetermined length such that a length from the center of the CM data to an end is the same as a length from the center to another end so as to extract the features of the CM data from the part of the predetermined length in the extracting step.

15. The CM recognizing system as claimed in claim 14, the system further comprising:

means for displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

means for registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.

16. A computer readable medium recording program code for causing a computer to perform processes for recognizing music from received data, the computer readable medium comprising:

program code means for extracting a feature and a time from the received data, and storing the feature and a time in a broadcast feature file;

program code means for searching for a music name of the feature in the broadcast

feature file by comparing data in a content feature file, in which features and corresponding music names of music content are stored, and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

program code means for, when the music name is determined, storing the music name and the time corresponding to the feature, in the broadcaste feature file, that corresponds to the music name in a search result file; and

program code means for generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information with the music name.

17. The computer readable medium as claimed in claim 16, the computer readable medium further comprising:

program code means for determining whether the received data is music or not;

program code means for, if the data is music, storing information indicating that the data is music and the time when the data is received in a music extracted file;

program code means for, if a music name of the data in the broadcast feature file is not determined, storing the data in a music name not-extracted file; and

program code means for generating a music not-detected file from the broadcast feature file, the music extracted file and the music name not-extracted file.

18. The computer readable medium as claimed in claim 17, the computer readable medium further comprising:

program code means for making the music stored in the music not-detected file to be listened to by a person;

program code means for adding a music name and a time on the music stored in the music not-detected file in the playlist.

19. A computer readable medium recording program code for causing a computer to perform processes for recognizing music from received data, the computer readable medium comprising:

program code means for receiving a feature and a time of broadcasted data received in each area as a broadcast feature file from each apparatus;

program code means for searching for a music name by comparing data in a content feature file, in which features and corresponding music names of music content are stored, and data in the broadcast feature file, wherein the music name corresponds to a feature, in the content feature file, the same as the feature in the broadcast feature file;

program code means for, when the music name is determined, storing the music name and the time corresponding to the feature, in the broadcast feature file, that corresponds to the music name in a search result file; and

program code means for generating a time-series playlist of music using the search result file and a content information database including information associated with the music name, wherein the time-series playlist includes the time, the music name of music broadcasted at the time and information with the music name.

20. A computer readable medium recording program code for causing a computer to perform processes for recognizing commercial (CM) data from received data, and storing the recognized CM data, the computer readable medium comprising:

program code means for detecting the CM data from the received data;

program code means for extracting features of the CM data, and storing the features in a broadcast feature file;

program code means for performing data comparison between the broadcast feature file and a master CM content feature file in which features of CM content are stored beforehand; and

program code means for, if data in the broadcast feature file does not exist in the master CM content feature file, registering the data in the master CM content feature file as a new CM;

the program code means for detecting the CM data from the received data comprising;

program code means for detecting a start point and an end point of the CM data by using a CM detection module for detecting cut points in images; and

cutting out a part of the CM data to obtain a predetermined length such that a length from the center of the CM data to an end is the same as a length from the center to another end so as to extract the features of the CM data from the part of the predetermined length in the extracting step.

21. The computer readable medium as claimed in claim 20, the computer readable medium further comprising:

program code means for displaying CM data that does not exist in the master CM content feature file as a result of the data comparison; and

program code means for registering information relating to the CM data in each database in a CM management database group including the master CM content feature file.