Interacting with time-based content

• US 9,197,945 B2
• Filed: 07/12/2012
• Issued: 11/24/2015
• Est. Priority Date: 07/12/2011
• Status: Active Grant

• Current Assignee: Nate D'Amico, Vijay Chandrasekhar
• Original Assignee: Nate D'Amico, Vijay Chandrasekhar
• Inventors: D'Amico, Nate, Chandrasekhar, Vijay
• Primary Examiner(s): LIN, WEN TAI
• Application Number:
  US13/547,193
• Publication Number:
  US 20130018936A1
• Time in Patent Office: 1,230 Days
• US Class Current: 1/1
• CPC Class Codes: H04H 60/56 Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467

Abstract

Systems and methods are provided for facilitating user and time-based content interaction. Sampling data received from a user device is compared to time-based content. The comparison is carried out, optionally without relying on watermark matching, to determine whether a match exists between the sampling data and the time-based content. Information relating to the sampling data may be transmitted to the user if the identification engine determines that the match exists.

Claims

1. A method for facilitating user and time-based content interaction upon user instruction, comprising:

(a) using a content receiver to receive time-based content from a source of time-based content;

(b) carrying out an analysis of the time-based content received by the content receiver as the content is received as content blocks, the analysis comprising

searching the content blocks against pre-computed content media signatures and/or metadata, and

generating at least one cue to mark at least one interactive point in the time-based content in a database if a match is found between the blocks and the pre-computed content media signatures and/or a match is found between the blocks and metadata;

(c) receiving user sampling data from a user device upon user instruction, wherein the device is capable of receiving time-based content from the source of time-based content substantially simultaneously to when the time-based content is received;

(d) determining, without relying on watermark matching, whether a match exists between the sampling data received by the sampling data receiver and the time-based content received by the content receiver; and

(e) transmitting information relating to the sampling data to the user device according to whether a match is determined in step (d) in a manner such that the information is received by the user device within 8 seconds of when step (c) begins,

wherein the information transmitted during step (e) comprises the at least one cue generated in step (b), the cue being associated with time-based content received in step (a) that precedes when user instruction is given to receive user sampling data during step (c).

2. The method of claim 1, wherein step (a) comprises receiving time-based content from a plurality of sources of time-based content.

3. The method of claim 2, wherein step (a) comprises receiving time-based content simultaneously from the sources of time-based content.

4. The method of claim 3, wherein step (a) comprises receiving time-based content from a television station, radio station, and/or an internet content provider.

5. The method of claim 3, wherein step (a) comprises receiving time-based content via cable, satellite, and/or cellular signals.

6. The method of claim 1, wherein the content blocks are about 1 to about 6 seconds in duration.

7. The method of claim 1, wherein

step (b) further comprises computing content signatures on the content blocks, and

step (d) comprises using the content signatures to determine whether the match exists.

8. The method of claim 1, wherein at least one time based cue is generated to mark at least one interactive point in the time-based content in the database.

9. The method of claim 1, wherein at least one metadata cue is generated to mark at least one interactive point in the time-based content.

10. The method of claim 1, wherein step (c) comprises (c1) collecting the data received by user sampling data receiver as successive data blocks.

11. The method of claim 10, wherein the data blocks are about 1 to about 6 seconds in duration.

12. The method of claim 1, wherein step (c) comprises receiving optical and/or audio sampling data.

13. The method of claim 1, wherein the information transmitted during step (e) identifies the source of time-based content associated with the match.

14. The method of claim 1, wherein the information transmitted during step (e) pertains to at least one cue and/or asset associated with the match.

15. The method of claim 1, wherein the information transmitted during step (e) pertains to time-based content received during at least step (c).

16. The method of claim 1, wherein the information transmitted during step (e) is useful to the user for engaging in an activity selected from

delivery of content,

participating in a survey, quiz, or poll,

initiating or taking a call,

requesting for information,

engaging in a commercial transaction,

adding a calendar event or reminder, and

adding a contact to an address book.

17. A method for a user, upon user instruction, to interact with time-based content from an apparatus that receives time-based content from a source and can present the content to the user, comprising:

(a) using a user device to sample the time-based content received and/or presented by the apparatus, thereby generating sampling data;

(b) instructing the user device to transmit sampling data to a computer system for facilitating user and time-based content interaction upon user instruction, the computer system comprising

a content receiver for receiving time-based content from the source of time-based content;

a substantially real-time content analyzer that analyzes the time-based content as the content is received by the content receiver as content blocks, the analyzer configured for

searching the content blocks against pre-computed content media signatures and/or metadata, and

generating at least one cue to mark at least one interactive point in the time-based content in a database if a match is found between the blocks and the pre-computed content media signatures and/or a match is found between the blocks and metadata;

a sampling data receiver for receiving sampling data from a device of a user that is capable of sampling time-based content from the source of time-based content substantially simultaneously to when the content receiver receives the time-based content;

an identification engine for determining, without relying on watermark matching, whether a match exists between the sampling data and the time-based content; and

a transmitter for transmitting information relating to the sampling data according to whether the identification engine determines that the match;

(c) using the user device to receive the information relating to the sampling data within 8 seconds from when step (b) begins,

wherein the information received during step (c) comprises the at least one cue generated by the computer system, the cue being associated with time-based content from the source that precedes step (b).

18. The method of claim 17, wherein the user device is detached from the apparatus.

19. The method of claim 17, wherein the user device comprises a computer, cellular phone and/or a set-top box.

20. The method of claim 17, wherein the user device and the apparatus are physically connected to each other.

21. The method of claim 17, wherein the user device and the apparatus form a unitary item.

22. The method of claim 17, wherein step (a) comprises

(a1) having the apparatus present the time-based content to the user, and

(a2) activating the user device to sample the content presented in step (a1).

23. The method of claim 22, wherein step (a2) comprises activating the user device via touch, sound input, and/or light input.

24. The method of claim 17, wherein step (a) comprises

(a1) having the apparatus present the time-based content to the user, and

(a2) having the user device automatically to sample the content presented in step (a1).