Identification of audio content

• US 10,365,886 B2
• Filed: 06/18/2018
• Issued: 07/30/2019
• Est. Priority Date: 04/10/2015
• Status: Active Grant

• Current Assignee: Sonos, Inc.
• Original Assignee: Sonos, Inc.
• Inventors: Clayton, Eric, Ramos, Aurelio Rafael
• Primary Examiner(s): Kim, Paul
• Assistant Examiner(s): Odunukwe, Ubachukwu A
• Application Number:
  US16/011,165
• Publication Number:
  US 20180364970A1
• Time in Patent Office: 407 Days
• Field of Search: 381 77, 707758
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04R 2227/005 Audio distribution systems for home, i.e. multi-room use
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407

Abstract

An example implementation involves a playback device receiving digital data representing audio content, the digital data encoded in a first format. The playback device causes one or more speaker drivers to playback the audio content. The playback device decodes a portion of the received digital data to convert the portion of the received digital data from the first format to a second format and transmits, via a network interface to a computing device of an identification system, the decoded portion of the received digital data. The playback device receives, from via the network interface from the identification system, metadata corresponding to the audio content, and in response, causes a control device to display a graphical representation of the received metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received metadata to the control device.

Claims

1. A playback device, comprising:

an enclosure;

a network interface mounted in the enclosure;

one or more speaker drivers mounted in the enclosure;

one or more processors mounted in the enclosure; and

tangible, non-transitory, computer-readable media mounted in the enclosure and storing instructions that, when executed by the one or more processors, cause the playback device to perform functions comprising;

receiving, via the network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via the one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content and excluded from the first metadata, from an identification system, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

2. The playback device of claim 1, wherein the functions further comprise:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

3. The playback device of claim 1, wherein the additional metadata comprises one or more of:

(i) album name;

(ii) track title;

(iii) artist name;

(iv) album year;

(v) release date;

(vi) composing entity; and

(vii) performing entity.

4. The playback device of claim 1, wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a retrieval request;

receiving, via the network interface from the control device, a command for the playback device to retrieve further metadata corresponding to the musical content from the identification system;

transmitting, via the network interface, a request for further metadata corresponding to the musical content from the identification system;

receiving, via the network interface from the identification system in response to transmitting the request, further metadata corresponding to the musical content; and

in response to receiving, from the identification system, the further metadata corresponding to the musical content, causing the control device to display a graphical representation of the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received further metadata to the control device.

5. The playback device of claim 1, wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

6. The playback device of claim 1, the functions further comprising sending requests for third metadata corresponding to the musical content from the identification system at periodic instances of time.

7. The playback device of claim 1, wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

8. The playback device of claim 1, wherein sending the additional metadata to the control device comprises sending one or more of (i) metadata related to a particular audio track within the musical content, (ii) data identifying a network location of a particular device from which metadata related to the musical content can be retrieved, (iii) a uniform resource locator identifying a network location of the particular device from which metadata related to the musical content can be retrieved, and (iv) an identifier recognizable to a metadata curating device as corresponding to metadata related to the musical content.

9. The playback device of claim 1, wherein the identification system is a first identification system and wherein the functions further comprise:

receiving, via the network interface from the first identification system, a message indicating that the first identification system was unable to (i) identify the audio content and (ii) retrieve information related to the audio content;

based on receiving the message, transmitting, via the network interface, a further request for third metadata corresponding to the audio content representing the musical content, from a second identification system; and

receiving, via the network interface from the second identification system in response to transmitting the further request, supplementary metadata identifying the audio content and containing information related to the audio content.

10. The playback device of claim 9, wherein the functions further comprise:

based on receiving, from the second identification system, the supplementary metadata, storing instructions to send future requests corresponding to the audio content to the second identification system.

11. The playback device of claim 9, wherein the second identification system is configured to receive digital data corresponding to sample rates, frequency ranges, or formats that are different than those for which the first identification system is configured to receive.

12. A tangible, non-transitory computer-readable medium having stored thereon instructions executable by a one or more processors to cause a playback device to perform functions comprising:

receiving, via a network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content and excluded from the first metadata, from an identification system, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

13. The tangible, non-transitory computer-readable medium of claim 12, wherein the functions further comprise:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

14. The tangible, non-transitory computer-readable medium of claim 12, wherein the additional metadata comprises one or more of:

(i) album name;

(ii) track title;

(iii) artist name;

(iv) album year;

(v) release date;

(vi) composing entity; and

(vii) performing entity.

15. The tangible, non-transitory computer-readable medium of claim 12, wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a retrieval request;

receiving, via the network interface from the control device, a command for the playback device to retrieve further metadata corresponding to the musical content from the identification system;

transmitting, via the network interface, a request for further metadata corresponding to the musical content from the identification system;

receiving, via the network interface from the identification system in response to transmitting the request, further metadata corresponding to the musical content; and

in response to receiving, from the identification system, the further metadata corresponding to the musical content, causing the control device to display a graphical representation of the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received further metadata to the control device.

16. The tangible, non-transitory computer-readable medium of claim 12, wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

17. The tangible, non-transitory computer-readable medium of claim 12, wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

18. A method to be performed by a playback device, the method comprising:

receiving, via a network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content from an identification system and excluded from the first metadata, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

19. The method of claim 18, further comprising:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

20. The method of claim 18, wherein the additional metadata comprises one or more of:

(i) album name;

(ii) track title;

(iii) artist name;

(iv) album year;

(v) release date;

(vi) composing entity; and

(vii) performing entity.

21. The method of claim 18, further comprising:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

22. The method of claim 18, wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

23. The method of claim 18, wherein sending the additional metadata to the control device comprises sending one or more of (i) metadata related to a particular audio track within the musical content, (ii) data identifying a network location of a particular device from which metadata related to the musical content can be retrieved, (iii) a uniform resource locator identifying a network location of the particular device from which metadata related to the musical content can be retrieved, and (iv) an identifier recognizable to a metadata curating device as corresponding to metadata related to the musical content.