Method and apparatus for identifying media content presented on a media playing device

• US 7,917,645 B2
• Filed: 10/14/2008
• Issued: 03/29/2011
• Est. Priority Date: 02/17/2000
• Status: Expired due to Term

• Current Assignee: Audible Magic Corporation
• Original Assignee: Audible Magic Corporation
• Inventors: Ikezoye, Vance E., Schrempp, James B.
• Primary Examiner(s): Nguyen; Phuoc
• Application Number:
  US12/251,404
• Publication Number:
  US 20090043870A1
• Time in Patent Office: 896 Days
• Field of Search: 709/203, 709/217, 709/229, 709/231
• US Class Current: 709/231
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/367 involving electronic purses or money safes
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system and method for identifying media content presented over a media playing device. The media content, such as audio and/or video, is either available digitally or digitally sampled. The media content is sampled to generate a media sample or analytical representation of the media content. The media sample is compared to a collection of sampled (or represented) media content to identify it and to ascertain information related to the sample. This media content-related information is then presented to the user via a display means on the media player. The media player then presents the user specific and related actions that are based upon the information presented and allows the user to directly execute their choice of actions.

Claims

1. A method for identifying a work from media content on a media device comprising:

creating an analytical representation from a segment of media content of said work on said media device, the work being a single rendering, and the segment being a portion of said media content that is less than an entirety of the work, wherein said analytical representation is a digital fingerprint of perceptual features of said segment;

transmitting said analytical representation to a lookup server for comparison to a collection of analytical representations of reference sampled media content of known works, each analytical representation being associated with content-related data of a known work;

receiving content-related data of said work from said server, wherein the content-related data was identified based on the comparison; and

presenting said content-related data on said media device.

2. The method of claim 1, further comprising:

receiving a user-initiated command to identify said media content before creating an analytical representation of a segment of said media content.

3. The method of claim 1, further comprising:

generating a log of user activity based on the content-related data; and

offering for purchase at least one of a product or a service related to said content-related data based on said log.

4. The method of claim 1, wherein said media device is at least one of a portable media player or a mobile phone.

5. The method of claim 1, further comprising:

receiving the media content via at least one of a microphone or a video camera.

6. The method of claim 1, wherein the single rendering is at least one of an audio rendering or a video rendering.

7. The method of claim 6, wherein said audio rendering is one of a song, a musical audio track or a nonmusical audio track, and wherein said video rendering is one of an animation sequence or a video sequence.

8. The method of claim 1, wherein the perceptual features include acoustical features.

9. The method of claim 1, further comprising:

receiving a media stream that includes the media content.

10. A non-transitory machine-readable medium including instructions that, when executed by a processing system, cause the processing system to perform a method of identifying a work from media content on a media device, comprising:

creating an analytical representation from a segment of media content of said work on said media device, the work being a single rendering, and the segment being a portion of the media content that is less than an entirety of the work, wherein said analytical representation is a digital fingerprint of perceptual features of said segment;

transmitting said analytical representation to a server for comparison to a collection of analytical representations of reference sampled media content of known works, each analytical representation being associated with content-related data of a known work;

receiving content-related data of said work from said server, wherein the content-related data was identified based on the comparison; and

presenting said content-related data of said work on said media device.

11. The non-transitory machine-readable medium of claim 10, wherein the perceptual features include acoustical features.

12. The non-transitory machine-readable medium of claim 10, the method further comprising:

receiving a media stream that includes the media content.

13. The non-transitory machine-readable medium of claim 10, the method further comprising:

generating a log of user activity based on the content-related data; and

offering for purchase at least one of a product or a service related to said content-related data based on said log.

14. The non-transitory machine-readable medium of claim 10, wherein said media device is at least one of a portable media player or a mobile phone.

15. The non-transitory machine-readable medium of claim 10, the method further comprising:

receiving the media content via at least one of a microphone or a video camera.

16. A media device comprising:

an interrupt unit configured to monitor the media device for media content of a work presented thereon, wherein said work is a single rendering;

a sampling unit configured to generate an analytical representation from a segment of media content of said work presented on said media device and to transmit said analytical representation to a lookup server, wherein said segment is a portion of said media content that is less than an entirety of the work, and the analytical representation is a digital fingerprint of perceptual features of said segment; and

a user interface configured to receive content information related to said work from said lookup server and present said content information.

17. The media device of claim 16, wherein said user interface is further configured to receive user-requests from a user of said media device, said sampling unit further configured to generate said analytical representation upon receipt of said user request.

18. The media device of claim 16, wherein said media device receives a media stream that includes said media content, wherein said media content includes at least one of audio content or video content.

19. The media device of claim 16, further comprising:

a log generating unit to generate a log of user activity based on the content-related data;

wherein the user interface is further configured to offer for purchase at least one of a product or a service related to said content-related data based on said log.

20. The media device of claim 16, wherein said media device is at least one of a portable media player or a mobile phone.

21. The media device of claim 16, wherein the interrupt unit is configured to monitor at least one of a microphone or a video camera for media content.

22. A lookup server comprising:

a collection of stored analytical representations of reference sampled media content of known works, each stored analytical representation being associated with corresponding content-specific information, wherein each stored analytical representation is a digital fingerprint of perceptual features of data of one of said known works; and

a lookup unit coupled to said collection of stored analytical representations of reference sampled media content of known works, said lookup unit configured to receive an analytical representation created from a segment of media content of said presented work, the presented work being a single rendering, and the segment being a portion of said media content that is less than an entirety of the presented work, and compare said received analytical representation with said collection of stored analytical representations to ascertain content information related to said received analytical representation, said lookup unit further configured to transmit said content information to said media device.

23. The lookup server of claim 22, wherein the single rendering is at least one of an audio rendering or a video rendering, and wherein the single rendering was received by the media device via a media stream.

24. The lookup server of claim 22, further comprising:

an advertising unit to receive from the media device a log of user activity that is based on the content-related data, and to transmit to the media device an offer for purchase of at least one of a product or a service related to said content-related data based on said log.

25. A method for identifying a work from media content comprising:

receiving, from a media device, an analytical representation created from a segment of media content of said work on said media device, the work being a single rendering, and the segment being a portion of said media content that is less than an entirety of the work, wherein said analytical representation is a digital fingerprint of perceptual features of said segment;

comparing said analytical representation to a collection of analytical representations of reference sampled media content of known works to obtain content-related data of said work from said collection of analytical representations of reference sampled media content; and

transmitting said content-related data of said work to said media device.

26. The method of claim 25, wherein the single rendering is at least one of an audio rendering or a video rendering, and wherein the single rendering was received by the media device via a media stream.

27. The method of claim 25, further comprising:

receiving from the media device a log of user activity that is based on the content-related data; and

transmitting to the media device an offer for purchase of at least one of a product or a service related to said content-related data based on said log.

28. A non-transitory machine-readable storage medium including instructions that, when executed by a processing system, cause the processing system to perform a method of identifying a work from media content, said method comprising:

receiving, from a media device, an analytical representation created from a segment of media content of said work on said media device, the work being a single rendering, and the segment being a portion of said media content that is less than an entirety of the work, wherein said analytical representation is a digital fingerprint of perceptual features of said segment;

comparing said analytical representation to a collection of analytical representations of reference sampled media content of known works to obtain content-related data of said work from said collection of analytical representations of reference sampled media content; and

transmitting said content-related data of said work to said media device.

29. The non-transitory machine-readable storage medium of claim 28, wherein the single rendering is at least one of an audio rendering or a video rendering, and wherein the single rendering was received by the media device via a media stream.

30. The non-transitory machine-readable storage medium of claim 28, the method further comprising:

receiving from the media device a log of user activity that is based on the content-related data; and

transmitting to the media device an offer for purchase of at least one of a product or a service related to said content-related data based on said log.