Method and system for interacting with a user in an experiential environment

• US 8,688,600 B2
• Filed: 07/28/2011
• Issued: 04/01/2014
• Est. Priority Date: 12/12/2000
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Shazam Ivestments Ltd. (Apple Inc.)
• Inventors: Inghelbrecht, Philip, Mukherjee, Dheeraj Shankar, Wang, Avery Li-Chun, Barton, Christopher J. Penrose
• Primary Examiner(s): Rosen, Nicholas D
• Application Number:
  US13/193,205
• Publication Number:
  US 20110314132A1
• Time in Patent Office: 978 Days
• Field of Search: 846/03, 705/500
• US Class Current: 705/500
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: G06Q 30/0217 involving input on products or services in exchange for incentives or rewards
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G10H 7/02 in which amplitudes at successive sample points of a tone waveform are stored in one or more memories

Abstract

A method and system for provides a user with an ability to capture a sample of an experiential environment and deliver that sample to an interactive service to trigger one or more predetermined events. In exemplary embodiments of the invention such triggered events include the delivery of information and services to the user, the execution of tasks and instructions by the service on the user'"'"'s behalf, communication events; surveillance events and other control-oriented events that are responsive to the user'"'"'s wishes. In other exemplary embodiments of the invention, the triggered events include transaction-oriented events, entertainment events, and events associated with enhancements to human ability or function.

Claims

1. A method of synchronizing media, the method comprising;

receiving a media sample of a first media stream from a client device;

determining a temporal position of the media sample in the first media stream as a result of matching the media sample to content of the first media stream;

determining a second media stream according to the temporal position; and

providing to the client device the second media stream.

2. The method of claim 1, further comprising determining an identification of the first media stream from which the media sample was captured.

3. The method of claim 1, further comprising selecting the second media stream based upon a content identification of the media sample.

4. The method of claim 1, further comprising:

determining an identification of a user of the client device; and

providing the second media stream to the client device based on the identification of the user.

5. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions of:

receiving a media sample of a first media stream from a client device;

determining a temporal position of the media sample in the first media stream as a result of matching the media sample to content of the first media stream;

determining a second media stream according to the temporal position; and

providing to the client device the second media stream.

6. A method of synchronizing media, the method comprising

receiving a media sample of a first media stream at a client device;

receiving a second media stream at the client device;

receiving a temporal position of the media sample in the first media stream as a result of matching the media sample to content of the first media stream; and

rendering the second media stream at the client device in synchrony with the first media stream based on a temporal position of the media sample in the first media stream.

7. The method of claim 6, further comprising the client device synchronizing the second media stream with the first media stream such that the second media stream is rendered in correspondence with the first media stream being rendered.

8. The method of claim 6, wherein rendering the second media stream at the client device in synchrony with the first media stream comprises rendering the second media stream in real-time with the first media stream as the first media stream is being broadcast.

9. The method of claim 6, further comprising receiving portions of the second media stream as the first media stream progresses, the portions of the second media stream being received in time alignment with corresponding portions of the first media stream being broadcast.

10. The method of claim 6, wherein the first media stream includes media within an ambient environment of the client device.

11. The method of claim 6, wherein receiving the media sample of the first media stream at the client device comprises the client device recording the media sample using a microphone.

12. The method of claim 6, wherein receiving the media sample of the first media stream at the client device comprises the client device recording the media sample using a video or image capture device.

13. The method of claim 6, wherein the first media stream includes a song and the second media stream includes lyric information for the song.

14. The method of claim 13, further comprising displaying the lyric information on the client device in synchrony with the song being broadcast.

15. The method of claim 6, wherein the second media stream is related to a content identification of the media sample.

16. The method of claim 6, wherein receiving the second media stream at the client device comprises the client device retrieving the second media stream from memory of the client device.

17. The method of claim 6, further comprising:

providing the media sample to a recognition engine; and

receiving from the recognition engine information associated with an identity of the first media stream.

18. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions of:

receiving a media sample of a first media stream at a client device;

receiving a second media stream at the client device;

receiving a temporal position of the media sample in the first media stream as a result of matching the media sample to content of the first media stream; and

rendering the second media stream at the client device in synchrony with the first media stream based on a temporal position of the media sample in the first media stream.