Analyzing captured sound and seeking a match based on an acoustic fingerprint for temporal and geographic presentation and navigation of linked cultural, artistic, and historic content

• US 9,754,025 B2
• Filed: 11/07/2014
• Issued: 09/05/2017
• Est. Priority Date: 08/13/2009
• Status: Active Grant

• Current Assignee: TunesMap Inc.
• Original Assignee: TunesMap Inc.
• Inventors: Roswell, Gilbert Marquard
• Primary Examiner(s): Reyes, Mariela
• Assistant Examiner(s): Almani, Mohsen
• Application Number:
  US14/536,104
• Publication Number:
  US 20150067512A1
• Time in Patent Office: 1,033 Days
• Field of Search: 707710
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15

Abstract

Collections of music and other items, related by time, location, genre, and artist, and that are registered in a data model to provide a foundation for their curatorship, discovery, and procurement are accessed by analyzing captured sound and seeking a match based on an acoustic fingerprint. As a result of said match, a map through the history and culture of music is created for display. The map is created in an embodiment by a series of choices, where a choice is a combination of any of time, place, genre, and artist. Both expert and regular individual curators can define the maps; or the maps can be defined algorithmically. Based upon said matches, one or more animated murals depicting a fundamental combination of any of time, place, genre, and artist are provided to a user via a user interface for the navigation of music, its history, and culture.

Claims

1. A computer implemented method for temporal and geographic presentation and navigation of linked cultural, artistic, and historic content, comprising:

capturing a song fragment;

providing a facility that determines an acoustic fingerprint for said song fragment;

using said acoustic fingerprint to access a music database to identify a song that corresponds to the captured fragment;

receiving from said music database music identification information for said song;

providing said music identification information as a user selection query to a navigation facility;

providing a processor configured to register collections of music and music-related information in a database and to make said collections of music and music-related information available to users, wherein said collections of music and music-related information are classified in said database by all of time, location, genre, and artist; and

said processor configured to provide a navigation facility for user selection of a combination of all of time, location, genre, and artist in connection with said collections of music and said music-related information, and for generating and presenting to said user in response to said user selection a corresponding map that includes independent images of all of music, its history, and culture with regard to said collections of music and music-related information;

wherein said culture presented on said map in response to said user selection comprises results that include independent images of all of fashion, film, literature, music, and news;

wherein said processor is configured to generate and present to said user at least one animated mural comprising said images and that depicts a fundamental combination of time, place, genre, artist, and culture in connection with said music-related information;

wherein said animated mural comprises a dynamically animated selection of said images derived from the user'"'"'s current selection; and

wherein said images further comprise any of regions, cities, artists, news items, fashion trends, movies, books, and genres of art.

2. The method of claim 1, wherein said map incorporates links to external Web sites.

3. The method of claim 1, wherein said map is defined by both expert and regular individual curators and is subject to sharing and group evaluation and ranking.

4. The method of claim 1, wherein said processor is configured to provide a facility for storing to, and retrieving from, said database community ranked curator and community commentary and recommendations, cultural events and elements, and media content in connection with said music-related information.

5. The method of claim 1, wherein said processor is configured to provide a commerce facility for user procurement of materials related to said music-related information.

6. The method of claim 1, wherein said mural further comprises a user interface for navigation of music, its history, and culture.

7. The method of claim 6, wherein said mural comprises any of film, fashion, art, literature, books, news, and comedy.

8. The method of claim 1, wherein said processor is configured to interact with, and is embedded within, a handheld GPS-enabled device.

9. The method of claim 8, wherein said processor is configured to provide a user of said device with a facility to query said database in connection with music and current and historical events relative to said user'"'"'s present location to enable discovery of music history points of interest in both a virtual world of media content displayed by a said device and in a physical world by guiding said user to actual places of interest.

10. The method of claim 1 wherein said processor is configured to transform the vocabulary used by curators into a predicate namespace of semantic music ontology for indexing of external resources.

11. The method of claim 1, wherein said processor is configured to provide a navigable relationship network view of users, curators, communities, and elements of the map database.

12. The method of claim 11, wherein said processor is configured to present clusters of icon images to a user to depict the map generated in response to said music identification information for said song.

13. The method of claim 11, wherein said processor is configured to provide an iconic filter constructer for dynamically grouping related results into a plurality of categories.

14. The method of claim 1, wherein said processor is configured to present maps of the world in a musical context.

15. The method of claim 1, wherein said processor is configured to provide a location element for a fundamental relationship of music within a map interface;

wherein said map is annotated with music related items of interest according to a selection category; and

wherein items displayed are subject to a user'"'"'s current filter settings.

16. The method of claim 1, wherein said map is published to a social networking facility.

17. The method of claim 1, further comprising:

said processor configured to provide a game element for user interaction pursuant to a game play application, wherein game play relates to a user media culture map, and wherein said user gains any of points and rewards for successful game play.

18. The method of claim 1, wherein said processor is configured to take as input any of said music identification information for said song to define the time, place, genre, artist, and context of said configuration.

19. The method of claim 18, wherein a play list of songs captured by the user animates the cultural context of said configuration.

20. The method of claim 1, wherein said processor is configured to receive an input that pivots an artist from said collections of music and music-related information to another field.

21. The method of claim 20, wherein said other field comprises any of film, art, literature, news, photography, fashion, and comedy.

22. The method of claim 21, wherein said artist comprises any of a director, painter, author, photographer, designer, and comedian.

23. The method of claim 22, wherein said map context reflects said other field.

24. A map index for conceptual, navigational, and physical organization of music-related materials, comprising:

a processor configured as a registry for maintaining a fundamental relationship between a plurality of core elements and for registering a plurality of data objects comprising descriptions of music, its history, and culture with said core elements;

wherein said core elements comprise any of time, location, genre, and artist;

wherein each of said core elements has a unique numeric id, maintained by said registry in an underlying relational database management system;

wherein said unique numeric id comprises a foreign key for referencing said map index and for relating said corresponding core elements;

wherein each combination of one numeric id from each of said core elements corresponds to a unique map_id of said map index;

wherein assignment of a single unique numeric id to each combination of core elements optimizes a mapping of higher level abstractions to a subject relationship with reduction of many-to-one a number of required index operations; and

wherein partition of said map index into a plurality of core elements provides a plurality of core filters for data object search and retrieval; and

capturing a song fragment;

providing a facility that determines an acoustic fingerprint for said song fragment;

using said acoustic fingerprint to access a music database to identify a song that corresponds to the captured fragment;

receiving from said music database music identification information for said song;

providing said music identification information as a user selection to a navigation facility; and

said processor configured to provide a navigation facility for user selection of a combination of all of said core elements in connection with collections of music and said music-related information, and for generating and presenting to said user in response to said user selection a corresponding map that includes independent images of all of music, its history, and culture with regard to said collections of music and music-related information;

wherein said culture presented on said map in response to said user selection comprises results that include independent images of all of fashion, film, literature, music, and news;

wherein said processor is configured to generate and present to said user at least one animated mural comprising said images and that depicts a fundamental combination of time, place, genre, artist, and culture in connection with said music-related information;

wherein said animated mural comprises a dynamically animated selection of said images derived from the user'"'"'s current selection; and

wherein said images further comprise represent any of regions, cities, artists, news items, fashion trends, movies, books, and genres of art.

25. The map index of claim 24, said registry further comprising:

a set of primary elements for establishing a next higher level of abstraction for classification and organization of music, its history, and culture;

wherein each data object in said registry is related to one of plurality of primary category types, each having a primary type id;

wherein said primary category types comprise any of curator, community, culture, content, and shopping;

wherein a primary type id is combinable with a map_id to establish a primary element;

wherein said primary elements define a collection of music related data objects as associated with a specific time, location, genre, and artist by way of said map_id;

wherein said primary elements enable selection of all primary types available for a given map_id, or all map_ids available for a given primary type;

wherein said primary elements further enable selection of all map_ids for a specific instance of any one of said primary categories; and

wherein said type_id of said primary categories comprises an enumerated constant of an implementing class that comprises a foreign key for a category type in said primary element id.

26. The map index of claim 24, further comprising:

a physical storage for data objects representing music, its history, and culture;

wherein data object representations are implemented by supporting elements related to primary elements many-to-one; and

wherein each primary element, relates any number of supporting elements to a fundamental relationship of music through association with a primary element.