System for selling a product utilizing audio content identification

• US 6,748,360 B2
• Filed: 02/21/2002
• Issued: 06/08/2004
• Est. Priority Date: 11/03/2000
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Pitman, Michael C., Fitch, Blake G., Germain, Robert S., Abrams, Steven
• Primary Examiner(s): Knepper, David D.
• Application Number:
  US10/080,097
• Publication Number:
  US 20020116195A1
• Time in Patent Office: 838 Days
• Field of Search: 704/236, 704/246, 704/270, 704/275, 704/231, 704/270.1, 380/200, 700/234, 702/73, 709/219
• US Class Current: 704/270
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G11B 20/00086 Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10546 specifically adapted for audio data
• CPC Class Codes: H04H 20/14 for monitoring programmes
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08

Abstract

It is determined whether audio identifying information generated for an audio content image matches audio identifying information in an audio content database. If the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, at least one product containing or relating to audio content that corresponds to the matching audio identifying information is identified. In one embodiment, the audio content image is received, and the audio identifying information is generated for the audio content image. In another embodiment, the audio identifying information for the audio content image is received. Also provided is a system for selling products.

Claims

1. A method for selling products containing or relating to audio content, said method comprising the steps of:

receiving a recorded audio content image;

generating audio identifying information for the audio content image based on detected events in the audio content image;

determining whether the audio identifying information generated for the audio content image matches audio identifying information in an audio content database; and

if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, charging a fee for at least one product containing or relating to audio content that corresponds to the matching audio identifying information,

wherein the generating step includes the sub-step of;

detecting a plurality of events in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

wherein the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

2. The method according to claim 1,

wherein the receiving step includes the sub-step of receiving a transmitted audio content image of at least a portion of a song, and

the charging step includes the sub-step of transmitting a recording of at least a song that corresponds to the matching audio identifying information.

3. A method for selling products containing audio content, said method comprising the steps of:

receiving a recorded audio content image;

generating audio identifying information for the audio content image based on detected events in the audio content image;

determining whether the audio identifying information generated for the audio content image matches audio identifying information in an audio content database; and

if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, generating a product containing audio content that corresponds to the matching audio identifying information,

wherein the generating step includes the sub-step of;

detecting a plurality of events in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

wherein the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

4. The method according to claim 3, further comprising the step of charging a fee for the generated product.

5. A method for selling products containing or relating to audio content, said method comprising the steps of:

determining whether audio identifying information generated for an audio content image matches audio identifying information in an audio content database; and

if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, identifying at least one product containing or relating to audio content that corresponds to the matching audio identifying information,

wherein the audio identifying information for the audio content image was generated based on a plurality of events detected in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

6. The method according to claim 5, further comprising the steps of:

receiving the audio content image; and

generating the audio identifying information for the audio content image based on the events detected in the audio content image.

7. The method according to claim 6, wherein the generating step includes the sub-steps of:

obtaining an audio signal characterized by a time dependent power spectrum;

analyzing the spectrum to obtain the time dependent frequency components;

detecting a plurality of the events in the time dependent frequency components; and

producing the audio identifying information for the audio content image based on the events detected.

8. The method according to claim 7 wherein the sub-step of analyzing the spectrum includes:

sampling the audio signal to obtain a plurality of audio signal samples;

taking a plurality of subsets from the plurality of audio signal samples; and

performing a Fourier transform on each of the plurality of subsets to obtain a set of Fourier frequency components.

9. The method according to claim 6, wherein the generating step includes the sub-steps of:

performing a Fourier transformation of an audio signal into a time series of audio power dissipated over a first plurality of frequencies;

grouping the frequencies into a smaller second plurality of bands that each include a range of neighboring frequencies;

detecting power dissipation events in each of the bands; and

grouping together the power dissipation events from mutually adjacent bands at a selected moment so as to form the audio identifying information.

10. The method according to claim 5, further comprising the step of receiving the audio identifying information for the audio content image.

11. The method according to claim 5, further comprising the step of charging a fee for the identified product.

12. The method according to claim 5, wherein the audio identifying information is an audio feature signature that is based on the events detected in the audio content image.

13. The method according to claim 12, wherein the determining step includes the of comparing the audio feature signature generated for the audio content image with the audio feature signatures stored in the audio content database.

14. The method according to claim 5, further comprising the steps of:

generating audio identifying information corresponding to predetermined audio content; and

storing the audio identifying information corresponding to the predetermined audio content in the audio content database.

15. The method according to claim 5, further comprising the step of charging a fee for identifying the audio content that corresponds to the matching audio identifying information.

16. A computer-readable medium encoded with a program for selling products containing audio content, said program containing instructions for performing the steps of:

receiving a recorded audio content image;

generating audio identifying information for the audio content image based on detected events in the audio content image;

determining whether the audio identifying information generated for the audio content image matches audio identifying information in an audio content database; and

if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, generating a product containing audio content that corresponds to the matching audio identifying information,

wherein the generating step includes the sub-step of;

detecting a plurality of events in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

wherein the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

17. The computer-readable medium according to claim 16, wherein said program further contains instructions for performing the step of charging a fee for the generated product.

18. A computer-readable medium encoded with a program for selling products containing or relating to audio content, said program containing instructions for performing the steps of:

determining whether audio identifying information generated for an audio content image matches audio identifying information in an audio content database; and

if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database, identifying at least one product containing or relating to audio content that corresponds to the matching audio identifying information,

wherein the audio identifying information for the audio content image was generated based on a plurality of events detected in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

19. The computer-readable medium according to claim 18, wherein said program further contains instructions for performing the steps of:

receiving the audio content image; and

generating the audio identifying information for the audio content image based on the events detected in the audio content image.

20. The computer-readable medium according to claim 19, wherein said program further contains instructions for performing the steps of:

generating audio identifying information corresponding to predetermined audio content; and

storing the audio identifying information corresponding to the predetermined audio content in the audio content database.

21. The computer-readable medium according to claim 19, wherein the generating step includes the sub-steps of:

obtaining an audio signal characterized by a time dependent power spectrum;

analyzing the spectrum to obtain the time dependent frequency components;

detecting a plurality of the events in the time dependent frequency components; and

producing the audio identifying information for the audio content image based on the events detected.

22. The computer-readable medium according to claim 21, wherein the sub-step of analyzing the spectrum includes:

sampling the audio signal to obtain a plurality of audio signal samples;

taking a plurality of subsets from the plurality of audio signal samples; and

performing a Fourier transform on each of the plurality of subsets to obtain a set of Fourier frequency components.

23. The computer-readable medium according to claim 19, wherein the generating step includes the sub-steps of:

performing a Fourier transformation of an audio signal into a time series of audio power dissipated over a first plurality of frequencies;

grouping the frequencies into a smaller second plurality of bands that each include a range of neighboring frequencies;

detecting power dissipation events in each of the bands; and

grouping together the power dissipation events from mutually adjacent bands at a selected moment so as to form the audio identifying information.

24. The computer-readable medium according to claim 18, wherein said program further contains instructions for performing the step of receiving the audio identifying information for the audio content image.

25. The computer-readable medium according to claim 18, further comprising:

receiving a transmitted audio content image of at least a portion of a song; and

transmitting a recording of at least a song that corresponds to the matching audio identifying information.

26. The computer-readable medium according to claim 18,

wherein the audio identifying information is an audio feature signature that is based on the events detected in the audio content image, and

the determining step includes the sub-step of comparing the audio feature signature generated for the audio content image with the audio feature signatures stored in the audio content database.

27. A system comprising:

an input interface for receiving a recorded audio content image;

an identifying information generator for generating audio identifying information for the audio content image based on detected events in the audio content image;

a match detector for determining whether the audio identifying information generated for the audio content image matches audio identifying information in an audio content database; and

a product generator for generating a product containing audio content that corresponds to the matching audio identifying information, if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database,

wherein the identifying information generator detects a plurality of events in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

28. A system comprising:

a match detector for determining whether audio identifying information generated for an audio content image matches audio identifying information in an audio content database; and

a product identifier for identifying at least one product containing or relating to audio content that corresponds to the matching audio identifying information, if the audio identifying information generated for the audio content image matches audio identifying information in the audio content database,

wherein the audio identifying information for the audio content image was generated based on a plurality of events detected in the audio content image, each of the events being a crossing of the value of a first running average and the value of a second running average,

the first running average is an average over a first averaging period of a plurality of time dependent frequency components of the audio content image, and

the second running average is an average over a second averaging period, which is different than the first averaging period, of the time dependent frequency components of the audio content image.

29. The system according to claim 28, further comprising:

an input interface for receiving the audio content image; and

an identifying information generator for generating the audio identifying information for the audio content image based on the events detected in the audio content image.

30. The system according to claim 28, further comprising an input interface for receiving the audio identifying information for the audio content image.

31. The system according to claim 28, further comprising:

an output interface for transmitting a recording of at least a song that corresponds to the matching audio identifying information,

wherein the input interface is adapted for receiving a transmitted audio content image of at least a portion of a song.

32. The system according to claim 28, wherein the audio identifying information is an audio feature signature that is based on the events detected in the audio content image.

33. The system according to claim 32, wherein the match detector compares the audio feature signature generated for the audio content image with the audio feature signatures stored in the audio content database.

34. The system according to claim 28, wherein the audio content database stores audio identifying information for predetermined audio content.