Media fingerprinting for social networking

• US 8,874,575 B2
• Filed: 09/19/2013
• Issued: 10/28/2014
• Est. Priority Date: 04/01/2010
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Mallinson, Diminic S.
• Primary Examiner(s): LEWIS, CHERYL RENEA
• Application Number:
  US14/032,080
• Publication Number:
  US 20140025699A1
• Time in Patent Office: 404 Days
• Field of Search: 707/601, 707/702, 707/705, 707/758, 707/802, 707/913, 707/919, 705/14.4, 705/319
• US Class Current: 707/736
• CPC Class Codes: G06F 16/14 Details of searching files based on file metadata
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Audio fingerprinting and other media matching technologies can be used to identify media, such as movies, television shows, and radio broadcasts. A user device can record image, audio, and/or video information and upload information to a matching service that is able to use matching technology to identify the media and provide supplemental content or information to the user. The user then can share this information with other users, such as by uploading to a social networking site or passing the information to peers on a peer network as part of a container. Users can have the ability to add tagged content, provide comments and ratings, and otherwise interact based at least in part upon the tagged media content.

Claims

1. A computer-implemented method of sharing content among users, comprising:

receiving a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

comparing, using at least one processing device, the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

locating a match of the captured media file information with one of the instances of stored media data;

determining, using at least one processing device, supplemental information corresponding to the matched instance of stored media data in response to the matching request; and

enabling the user to provide the supplemental information to other users using at least one content sharing mechanism.

2. The computer-implemented method of claim 1, wherein the information included in the request corresponding to a captured media file comprises at least one of audio and video data, captured for at least one of a first period of time before a user action triggered generation of the request or a second period of time after the user action triggered generation of the request.

3. The computer-implemented method of claim 1 further comprising providing a graphical user interface configured to present the determined supplemental information to a user based at least on one or more user configurations, wherein the one or more user configurations include definitions of a type and a selection of available supplemental information to be presented by the provided graphical user interface.

4. The computer-implemented method of claim 1, wherein the supplemental information includes at least one of a scene of a movie, title of the movie, identifying information of the scene of the movie, and identifying information of at least one actor present in the scene of the movie.

5. The computer-implemented method of claim 1, wherein the supplemental information includes at least one of a portion of a song, title of the song, title of an album of the song, and identifying information of at least one artist of the song.

6. The computer-implemented method of claim 1, wherein the supplemental information includes at least one of a scene of a video game, title of the video game, identifying information of a theme music of the video game, identifying information of a certain level within the video game, and score information.

7. The computer-implemented method of claim 1, wherein enabling the user to provide the supplemental information to other users includes providing a link configured to allow the user to include an instance of the stored media data corresponding to the identified media data to a virtual container of information, the virtual container having a group of related instances of the stored media data that are configured to be shared among various users.

8. The computer-implemented method of claim 1, wherein enabling the user to provide the supplemental information to other users includes providing a link configured to allow the user to stream or access a stored instance of the stored media data corresponding to the identified media content.

9. The computer-implemented method of claim 8, wherein the provided link is configured to allow the user to create a personal page having multiple supplemental information corresponding to multiple identified media content in response to the matching request.

10. The computer-implemented method of claim 9, wherein the personal page is at least one of a Web page with a password and a page stored locally on a computing device not accessible via a remote device.

11. The computer-implemented method of claim 10, wherein the personal page is accessible to other users via a network using at least one of a subscription model or controlled accessibility model.

12. The computer-implemented method of claim 9, wherein at least some of the multiple supplemental information of the personal page are tagged to a particular stored instance of stored media file.

13. The computer-implemented method of claim 1, wherein enabling the user to provide the supplemental information to other users includes providing a link to allow the user to provide the presented supplemental information to other users using the at least one content sharing mechanism.

14. The computer-implemented method of claim 13, wherein enabling the user to provide the supplemental information to other users includes providing to the user a content page with content related to an instance of stored media data corresponding to the identified media content, the provided page being accessible to other users via a network.

15. The computer-implemented method of claim 13, wherein the content page is a Web page of a social networking site or a community page.

16. The computer-implemented method of claim 15, wherein the content page includes information to a particular topic or genre corresponding to the identified media content.

17. The computer-implemented method of claim 15, wherein the content page includes identifying information of products present in instances of stored media data each corresponding to identified video content.

18. The computer-implemented method of claim 15, wherein the content page includes links to Web sites that offer at least one product present in instances of stored media data, each Web site corresponding to identified video content and a full version of the identified media content.

19. A system for sharing content among users, comprising:

at least one processor; and

memory including instructions that, when executed by the processor, cause the system to;

receive a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

compare the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

locate a match of the captured media file information with one of the instances of stored media data;

determine supplemental information corresponding to the matched instance of stored media data in response to the matching request; and

enable the user to provide the supplemental information to other users using at least one content sharing mechanism.

20. A nontransitory computer-readable storage medium including instructions for sharing content among users, the instructions when executed by at least one processor causing the at least one processor to:

receive a matching request including information corresponding to a captured media file, the captured media file including at least one of audio and video data recorded from a media presentation by a user device;

compare the captured media file information to stored instances of media data to attempt to locate a match for the captured media file information, at least a portion of the instances of stored media data each corresponding to identified video content;

locate a match of the captured media file information with one of the instances of stored media data;

determine supplemental information corresponding to the matched instance of stored media data in response to the matching request; and

enable the user to provide the supplemental information to other users using at least one content sharing mechanism.