Matching data objects to video content

• US 10,432,996 B2
• Filed: 10/05/2016
• Issued: 10/01/2019
• Est. Priority Date: 11/07/2014
• Status: Active Grant

• Current Assignee: Kube-It Incorporated
• Original Assignee: Kube-It Incorporated
• Inventors: Dacus, Taylor, Dacus, Barry, Niedfeldt, Jon, Lau, Emil
• Primary Examiner(s): Alcon, Fernando
• Application Number:
  US15/286,440
• Publication Number:
  US 20170026672A1
• Time in Patent Office: 1,091 Days
• Field of Search: None
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06Q 30/0233 Method of redeeming a frequent usage reward
• CPC Class Codes: G07C 13/00 Voting apparatus
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4758 for providing answers, e.g. voting
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A distributed application is executed by a client device, sampling output by a player device that is playing audio-video content, and obtains information (e.g., advertising) relating to an object that is imaged or referenced in a portion of the playing content. The client device outputs the information on the client device while the content is playing on the player device, and optionally receives user input responsive to the information. The user of the client device receives the advertising or other information without any interruption of the content playing on the player device. Associating and providing user interface objects (information “cards”) in connection with limited portions of video content enables more user-friendly, less distracting advertising in connection with video content.

Claims

1. A method by an application server for matching information to video content for creation of a relatively large volume of information-to-video content matches, comprising:

providing, by an application processor and via a network access device, a list of videos to be reviewed for tagging with a tag that identifies a limited portion of the video content of a corresponding video listed in the list of videos;

receiving, from each of a plurality of devices each associated with a corresponding user account and via the network access device, a message including at least one vote indicating that the tag corresponds to a Graphical User Interface (GUI) object that includes information topically relevant to a subject of video content of one video of the list of videos;

validating, by the application processor, that the tag corresponds to the GUI enabled data object based at least in part on a number of received votes compared to a threshold number of votes; and

assigning, by the application processor, the video content to an authorized account in response to the number of received votes reaching or exceeding the threshold number of votes; and

receiving, from a device associated with the authorized account, data indicating that the tag corresponds to the GUI enabled data object;

wherein validating that the tag corresponds to the GUI enabled data object is further determined based on receiving the data indicating that the tag corresponds to the GUI enabled data object from the device associated with the authorized account.

2. The method of claim 1, further comprising receiving, from each of the plurality of devices and via a network access device, metadata including an identifier of a corresponding one of the plurality of devices and a time at which the corresponding one of the plurality of devices received input data indicating that the tag corresponds to the GUI enabled data object and data.

3. The method of claim 1, further comprising determining, by the application processor, that a first user account associated with a first device of the plurality of devices is a trusted account based on at least one of:

a total number of messages received from devices associated with the first user account;

a total number of messages received from the devices associated with the first user account that correspond to video content that was validated by the application processor;

or

a ratio of the total number of messages received from the devices associated with the user account to the total number of messages received from the devices associated with the first user account that correspond to video content that was validated by the application processor.

4. The method of claim 3, wherein a second user account associated with a second device of the plurality of devices is a non-trusted account and receiving at least one vote includes receiving a greater number of votes from the first device than the second device due to the first account being a trusted account.

5. The method of claim 4, further comprising associating, by the application processor, a credit to each of the plurality of devices in response to receiving the at least one vote.

6. The method of claim 5, wherein the credit includes at least one of a monetary credit, credit that can be redeemed for products or benefits, a credit to a monetary account or a credit to a game account.

7. The method of claim 1, further comprising adding, by the application processor and to the one video, metadata indicating that the GUI enabled data object is associated with the video content.

8. The method of claim 7, wherein the metadata allows the GUI enabled data object to be associated with additional videos including the video content.

9. The method of claim 1, further comprising storing, in a GUI enabled data object database, a plurality of GUI enabled data objects and a list of tags each corresponding to at least one of the plurality of GUI enabled data objects.

10. The method of claim 1, wherein the GUI enabled data object includes at least one of a title identifying the subject of the video content, an image related to the subject of the video content or interactive features associated with the subject of the video content.

11. A method by an application server for matching information to video content for creation of a relatively large volume of information-to-video content matches, comprising:

providing, by an application processor and via a network access device, a list of videos to be reviewed for tagging with a tag that identifies a limited portion of the video content of a corresponding video listed in the list of videos;

receiving, from each of a plurality of devices each associated with a corresponding user account and via the network access device, a message including at least one vote indicating that the tag corresponds to a Graphical User Interface (GUI) object that includes information topically relevant to a subject of video content of one video of the list of videos;

validating, by the application processor, that the tag corresponds to the GUI enabled data object based at least in part on a number of received votes compared to a threshold number of votes; and

determining, by the application processor, that a first user account associated with a first device of the plurality of devices is a trusted account based on at least one of;

a total number of messages received from devices associated with the first user account;

a total number of messages received from the devices associated with the first user account that correspond to video content that was validated by the application processor;

or

a ratio of the total number of messages received from the devices associated with the user account to the total number of messages received from the devices associated with the first user account that correspond to video content that was validated by the application processor;

wherein a second user account associated with a second device of the plurality of devices is a non-trusted account and receiving at least one vote includes receiving a greater number of votes from the first device than the second device due to the first account being a trusted account.

12. The method of claim 11, further comprising receiving, from each of the plurality of devices and via a network access device, metadata including an identifier of a corresponding one of the plurality of devices and a time at which the corresponding one of the plurality of devices received input data indicating that the tag corresponds to the GUI enabled data object and data.

13. The method of claim 11, further comprising associating, by the application processor, a credit to each of the plurality of devices in response to receiving the at least one vote.

14. The method of claim 13, wherein the credit includes at least one of a monetary credit, credit that can be redeemed for products or benefits, a credit to a monetary account or a credit to a game account.

15. The method of claim 11, further comprising:

assigning, by the application processor, the video content to an authorized account in response to the number of received votes reaching or exceeding the threshold number of votes; and

receiving, from a device associated with the authorized account, data indicating that the tag corresponds to the GUI enabled data object;

wherein validating that the tag corresponds to the GUI enabled data object is further determined based on receiving the data indicating that the tag corresponds to the GUI enabled data object from the device associated with the authorized account.

16. The method of claim 11, further comprising adding, by the application processor and to the one video, metadata indicating that the GUI enabled data object is associated with the video content.

17. The method of claim 16, wherein the metadata allows the GUI enabled data object to be associated with additional videos including the video content.

18. The method of claim 11, further comprising storing, in a GUI enabled data object database, a plurality of GUI enabled data objects and a list of tags each corresponding to at least one of the plurality of GUI enabled data objects.

19. The method of claim 11, wherein the GUI enabled data object includes at least one of a title identifying the subject of the video content, an image related to the subject of the video content or interactive features associated with the subject of the video content.