MEDIA FINGERPRINTING FOR SOCIAL NETWORKING

• US 20110246495A1
• Filed: 04/01/2010
• Published: 10/06/2011
• Est. Priority Date: 04/01/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: MALLINSON, Dominic S.
• Granted Patent: US 8,560,583 B2
• Time in Patent Office: Days
• US Class Current: 707/758
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Audio fingerprinting and other media matching technologies can be used to identify media, such as movies, television shows, and radio broadcasts. A user device can record image, audio, and/or video information and upload information to a matching service that is able to use matching technology to identify the media and provide supplemental content or information to the user. The user then can share this information with other users, such as by uploading to a social networking site or passing the information to peers on a peer network as part of a container. Users can have the ability to add tagged content, provide comments and ratings, and otherwise interact based at least in part upon the tagged media content.

Claims

1. A computer-implemented method of sharing content among users, comprising:

receiving a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

comparing, using at least one processing device, the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

if a match is located with one of the instances of stored media data, providing, using at least one processing device, determined supplemental information for the corresponding identified media content in response to the matching request; and

enabling the user to provide the supplemental information to other users using at least one content sharing mechanism.

2. The computer-implemented method of claim 1, wherein the comparing is performed using at least one of an audio fingerprinting process or an image recognition process.

3. The computer-implemented method of claim 1, wherein the information included in the request corresponding to a captured media file comprises at least one of audio and video data, captured for at least one of a first period of time before a user action triggered generation of the request or a second period of time after the user action triggered generation of the request.

4. The computer-implemented method of claim 1, wherein the determined supplemental information includes at least one of advertising information, product information, trivia information, purchasing information, download information, a media file, or an address or link to related content.

5. The computer-implemented method of claim 1, wherein the at least one content sharing mechanism includes at least one of a social networking site, content-related web site, and peer network.

6. The computer-implemented method of claim 1, wherein enabling the user to provide the supplemental information to other users using at least one content sharing mechanism includes providing the user with a link to a stored media file corresponding to the captured media file, the user able to provide the link to other users via the at least one content sharing mechanism.

7. The computer-implemented method of claim 1, further comprising:

enabling other users of the at least one content sharing mechanism to obtain a copy of media corresponding to the identified media content.

8. The computer-implemented method of claim 1, wherein the at least one content sharing mechanism further enables other users to rate or comment on the identified media content.

9. A system for sharing content among users, comprising:

at least one processor; and

memory including instructions that, when executed by the processor, cause the system to;

receive a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

compare, using at least one processing device, the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

if a match is located with one of the instances of stored media data, providing, using at least one processing device, determine supplemental information for the corresponding identified media content in response to the matching request; and

enable the user to provide the supplemental information to other users using at least one content sharing mechanism.

10. The system of claim 9, wherein the captured media file information is compared to stored instances of media data using at least one of an audio fingerprinting process or an image recognition process.

11. The system of claim 9, wherein the at least one content sharing mechanism includes at least one of a social networking site, content-related web site, and peer network.

12. The system of claim 9, wherein enabling the user to provide the supplemental information to other users using at least one content sharing mechanism includes providing the user with a link to a stored media file corresponding to the captured media file, the user able to provide the link to other users via the at least one content sharing mechanism.

13. The system of claim 9, wherein the at least one content sharing mechanism further enables other users to rate or comment on the identified media content.

14. A device for identifying video content, comprising:

a processor;

at least one user input;

at least one media capture element operable to capture at least one of audio and video information; and

memory including instructions that, when executed by the processor, cause the device to;

while in a capture mode of operation, continually capture media information including at least one of audio and video information corresponding to a presentation of media content using the at least one media capture element, the device buffering the media information for at least a recent specified period of time, the buffered media information continually updating with newly captured media information and deleting media information captured outside the specified period of time;

in response to activation of the at least one user input, send a request to obtain supplemental information corresponding to the video content based at least in part upon the captured media information, the request including data corresponding to the buffered media information; and

in response to receiving supplemental information corresponding to the video content, enabling the user to provide the supplemental information to other users using at least one content sharing mechanism.

15. The device according to claim 14, wherein the captured media file information is compared to stored instances of media data using at least one of an audio fingerprinting process or an image recognition process.

16. The device according to claim 14, wherein the at least one content sharing mechanism includes at least one of a social networking site, content-related web site, and peer network.

17. The device according to claim 14, wherein enabling the user to provide the supplemental information to other users using at least one content sharing mechanism includes providing the user with a link to a stored media file corresponding to the captured media file, the user able to provide the link to other users via the at least one content sharing mechanism.

18. A computer-readable storage medium including instructions for sharing content among users, the instructions when executed by at least one processor causing the at least one processor to:

receive a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

compare, using at least one processing device, the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

if a match is located with one of the instances of stored media data, providing, using at least one processing device, determine supplemental information for the corresponding identified media content in response to the matching request; and

enable the user to provide the supplemental information to other users using at least one content sharing mechanism.

19. The computer-readable storage medium according to claim 18, wherein the at least one content sharing mechanism includes at least one of a social networking site, content-related web site, and peer network.

20. The computer-readable storage medium according to claim 18, wherein enabling the user to provide the supplemental information to other users using at least one content sharing mechanism includes providing the user with a link to a stored media file corresponding to the captured media file, the user able to provide the link to other users via the at least one content sharing mechanism.