Method and System for Interacting with a User in an Experimental Environment

• US 20140214532A1
• Filed: 03/31/2014
• Published: 07/31/2014
• Est. Priority Date: 12/12/2000
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Shazam Ivestments Ltd. (Apple Inc.)
• Inventors: Barton, Christopher Jacques Penrose, Mukherjee, Dheeraj Shankar, Wang, Avery Li-Chun, Inghelbrecht, Philip Georges
• Granted Patent: US 9,721,287 B2
• Time in Patent Office: Days
• US Class Current: 705/14.49
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: G06Q 30/0217 involving input on products or services in exchange for incentives or rewards
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G10H 7/02 in which amplitudes at successive sample points of a tone waveform are stored in one or more memories

Abstract

A method and system for provides a user with an ability to capture a sample of an experiential environment and deliver that sample to an interactive service to trigger one or more predetermined events. In exemplary embodiments of the invention such triggered events include the delivery of information and services to the user, the execution of tasks and instructions by the service on the user'"'"'s behalf, communication events; surveillance events and other control-oriented events that are responsive to the user'"'"'s wishes. In other exemplary embodiments of the invention, the triggered events include transaction-oriented events, entertainment events, and events associated with enhancements to human ability or function.

Claims

1. A method performed by an interactive service device, the method comprising:

receiving, from a computing device, a media sample of a media stream;

determining a match of the media sample to stored content recordings;

receiving information from the computing device indicative of a selection of an event from a plurality of events offered by the interactive service device, the computing device, or an event fulfillment center; and

in response to receipt of the media sample and finding the match, triggering the selected event.

2. The method of claim 1, wherein triggering the selected event comprises providing to the computing device an option to purchase goods associated with an identity of content of the media sample via a transaction event.

3. The method of claim 2, wherein the goods comprise a song corresponding to the identity of content, a music album containing the song, or tickets to an upcoming performance by an artist of the song.

4. The method of claim 1, wherein receiving the media sample comprises receiving a sample of audio captured from an environment of the computing device.

5. The method of claim 1, wherein receiving the media sample comprises receiving a video or an image captured from an environment of the computing device.

6. The method of claim 1, wherein receiving the media sample comprises receiving a sample of an experiential environment of the computing device.

7. The method of claim 1, wherein receiving the media sample from the computing device comprises receiving a content recognition request, and the method further comprises:

determining a usage history indicative of content of prior content recognition requests;

determining candidates for the match of the media sample to stored content recordings;

removing any of the candidates that are of a dissimilar genre of music as compared to genres of the content of the prior content recognition requests; and

determining, as the match of the media sample to stored content recordings, one of a remaining candidate.

8. The method of claim 1, wherein the media sample comprises pre-processed characteristics of content of the media stream including fingerprint and landmark pairs that describe content and locations of the content in the media stream.

9. The method of claim 1, wherein determining the match of the media sample to stored content recordings comprises:

determining a temporal position of the media sample in the media stream.

10. The method of claim 1, wherein determining the match of the media sample to stored content recordings comprises:

determining a linear correspondence of the media sample to the stored content recordings.

11. The method of claim 1, wherein triggering the selected event comprises delivery of lyric information to the computing device that corresponds to the determined match of the media sample.

12. The method of claim 1, further comprising:

determining a temporal position of the media sample in the media stream;

determining a second media stream associated to the media stream; and

providing to the computing device at least a portion of the second media stream according to the temporal position.

13. The method of claim 12, wherein the second media stream comprises lyric information that corresponds the determined match of the media sample, and wherein providing to the computing device at least a portion of the second media stream according to the temporal position comprises providing a portion of the lyric information that corresponds to the temporal position in synchrony as lyrics are rendered in the media stream.

14. The method of claim 1, wherein triggering the selected event comprises providing to the computing device a voting service associated with an identity of content of the media sample.

15. The method of claim 1, further comprising:

based on finding the match, requesting payment of a fee for access to the selected event; and

based on receiving an indication of payment of the fee, triggering the selected event.

16. The method of claim 1, wherein triggering the selected event comprises providing to the computing device an advertisement associated with an identity of content of the media sample.

17. The method of claim 1, wherein in response to receipt of the media sample and finding the match, the method comprises:

determining a user profile of a user of the computing device;

based on the user profile, determining offers associated with an identity of content of the media sample that are targeted to the user; and

triggering the selected event in accordance with the determined offers.

18. The method of claim 1, wherein in response to receipt of the media sample and finding the match, the method comprises:

determining patterns of usage of the plurality of events;

adjusting offers associated with an identity of content of the media sample based on the patterns of usage; and

triggering the selected event in accordance with the adjusted offers.

19. The method of claim 1, wherein triggering the selected event comprises:

providing a notification to another computing device indicating that a user of the computing device has engaged the interactive service device to identify a song.

20. The method of claim 19, further comprising:

providing an excerpt of the song to the another computing device.

21. The method of claim 1, wherein triggering the selected event comprises:

determining a group of users to be notified based on a user profile of a user of the computing device; and

providing a notification to the group of users indicating that the user of the computing device has engaged the interactive service device, the computing device, or the event fulfillment center to perform the selected event.

22. The method of claim 1, wherein receiving the information from the computing device indicative of the selection of the event from the plurality of events comprises:

determining the selection based on a pre-programmed user profile of a first user of the computing device, and

wherein the selection indicates to notify a second user that the first user has engaged the interactive service device, the computing device, or the event fulfillment center to perform a song identification.

23. A non-transitory computer readable medium having stored therein instructions, that when executed by a computing device, cause the computing device to perform functions comprising:

receiving a media sample of a media stream;

determining a match of the media sample to stored content recordings;

receiving information indicative of a selection of an event from a plurality of events offered by an interactive service device, a computing device that captured the media sample of the media stream, or an event fulfillment center; and

in response to receipt of the media sample and finding the match, triggering the selected event.

24. The non-transitory computer readable medium of claim 23, wherein triggering the selected event comprises:

providing a notification to another computing device indicating that a user of the computing device has engaged the interactive service device to identify a song; and

providing an excerpt of the song to the another computing device.

25. The non-transitory computer readable medium of claim 23, wherein receiving the media sample from the computing device comprises receiving a content recognition request, and the functions further comprise:

determining a usage history indicative of content of prior content recognition requests;

determining candidates for the match of the media sample to stored content recordings;

removing any of the candidates that are of a dissimilar genre of music as compared to genres of the content of the prior content recognition requests; and

determining, as the match of the media sample to stored content recordings, one of a remaining candidate.

26. The non-transitory computer readable medium of claim 23, wherein triggering the selected event comprises delivery of lyric information that corresponds the determined match of the media sample.

27. The non-transitory computer readable medium of claim 23, wherein the functions further comprise:

determining a temporal position of the media sample in the media stream;

determining a second media stream associated to the media stream; and

providing to the computing device at least a portion of the second media stream according to the temporal position.

28. A method performed by an interactive service device, the method comprising:

receiving, from a computing device, a media sample of a media stream;

determining a match of the media sample to stored content recordings;

in response to receipt of the media sample and finding the match,

determining one or more users to be notified based on a user profile of a user of the computing device; and

providing a notification to the one or more users indicating that the user of the computing device has engaged an interactive service device to identify the media sample and indicating an identity of the identified media sample.

29. The method of claim 28, wherein receiving the media sample from the computing device comprises receiving a content recognition request, and the method further comprises:

determining a usage history indicative of content of prior content recognition requests;

determining candidates for the match of the media sample to stored content recordings;

removing any of the candidates that are of a dissimilar genre of music as compared to genres of the content of the prior content recognition requests; and

determining, as the match of the media sample to stored content recordings, one of a remaining candidate.

30. The method of claim 28, wherein in response to receipt of the media sample and finding the match, the method comprises:

determining a user profile of a user of the computing device;

based on the user profile, determining offers associated with an identity of content of the media sample that are targeted to the user; and

triggering the selected event in accordance with the determined offers.