Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device

• US 9,848,250 B2
• Filed: 07/23/2016
• Issued: 12/19/2017
• Est. Priority Date: 11/26/2008
• Status: Active Grant

• Current Assignee: Samba TV Incorporated
• Original Assignee: Free Stream Media Corporation
• Inventors: Harrison, David
• Primary Examiner(s): Chae, Kyu
• Application Number:
  US15/217,979
• Publication Number:
  US 20160330530A1
• Time in Patent Office: 514 Days
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06F 21/53 by executing in a restricted environment, e.g. sandbox or secure virtual machine
• CPC Class Codes: G06F 2221/033 Test or assess software
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: H04L 12/18 for broadcast or conference , e.g. multicast
• CPC Class Codes: H04L 2101/668 Internet protocol [IP] address subnets
• CPC Class Codes: H04L 61/2514 between local and global IP addresses
• CPC Class Codes: H04L 61/2517 using port numbers
• CPC Class Codes: H04L 61/256 NAT traversal
• CPC Class Codes: H04L 61/2575 using address mapping retrieval, e.g. simple traversal of user datagram protocol through session traversal utilities for NAT [STUN]
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/4541 Directories for service discovery
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 63/10 for controlling access to devices or network resources
• CPC Class Codes: H04L 63/102 Entity profiles
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/61 : for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/141 : Setup of application sessions admission control or resource allocation in data switching networks H04L47/70
• CPC Class Codes: H04L 67/51 : Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04N 21/23424 : involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2541 : Rights Management protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/278 : Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4126 : The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4147 : PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/435 : Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4415 : using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/466 : Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 21/6175 : involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 21/64322 : IP
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/835 : Generation of protective data, e.g. certificates protecting software against unauthorised usage in a vending or licensing environment G06F21/10
• CPC Class Codes: H04N 21/8352 : involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

In one embodiment, a method of a relevancy-matching server includes matching primary data generated from a fingerprint data with targeted data based on a relevancy factor and locating in a storage the targeted data, a reference and/or a metadata. A mobile device is associated with a television. An executable environment is constrained in a security sandbox of the mobile device. A sandboxed application is executed capable of bypassing at least one access control of the security sandbox. An embedded object is processed in the sandboxed application. The television and/or the mobile device is to generate the fingerprint data from characteristic features of media data. The fingerprint data from the television and/or the mobile device is processed through a content identification server. The primary data is communicated to any device with access to identification data of the television and/or an automatic content identification service.

Claims

1. A method of a system comprising:

generating, through at least one of a television and a mobile device, fingerprint data from characteristic features of media data;

matching primary data generated from the fingerprint data with targeted data based on a relevancy factor using a relevancy-matching server;

locating in a storage at least one of the targeted data, a reference to the targeted data and a metadata of the targeted data using the relevancy-matching server;

constraining an executable environment in a security sandbox of the mobile device;

executing a sandboxed application in the executable environment capable of bypassing at least one access control of the security sandbox;

associating the mobile device with the television based on;

executing a sandbox-reachable service on the television;

automatically announcing, through the television, the sandbox-reachable service to a discovery module executing at least one of;

on a pairing server external to the mobile device and as part of an extension of the security sandbox executing on the mobile device;

identifying the sandbox-reachable service offered through the television based on receiving, through the discovery module, the automatic announcement to enable the sandboxed application of the mobile device reach the sandbox-reachable service by communicating an identification data of the television via the sandbox-reachable service when a shared computer network is determined to be commonly associated with the mobile device and the television; and

establishing bidirectional communication between the mobile device and the television based on the sandboxed application reaching the sandbox-reachable service to render the primary data available across the sandbox-reachable service and the sandboxed application;

processing an embedded object within the sandboxed application;

executing the embedded object through the sandboxed application to cause rendering of the targeted data therethrough;

processing the fingerprint data from the at least one of the television and the mobile device through a content identification server; and

communicating the primary data from the fingerprint data to any of a number of devices with access to at least one of;

the identification data of the television and an identification data of an automatic content identification service of the television through the content identification server.

2. The method of claim 1:

wherein the relevancy factor comprises at least one of a category of the primary data, a behavioral history of a user, a category of the sandboxed application, and other information associated with the user.

3. The method of claim 1:

wherein

the identification data of the television comprises at least one of a global unique identifier (GUID), an alphanumeric name, a hardware address associated with the television, a public address associated with the automatic content identification service of the television, and a private address associated with the automatic content identification service of the television when the shared computer network is determined to be commonly associated with the mobile device and the television.

4. The method of claim 1:

wherein the embedded object comprises at least one of a script, an image, a player, an iframe, and other external media included in the sandboxed application.

5. The method of claim 1, comprising:

generating, through the relevancy-matching server, the targeted data.

6. The method of claim 1, further comprising:

associating the mobile device with a user based on a unique identifier.

7. The method of claim 1:

wherein the primary data further comprises at least one of descriptive metadata associated with a content identification data, a monitored event, a geolocation, a weather information, a private Internet Protocol (IP) address, and other data stored in at least one of a volatile memory and a non-volatile memory.

8. The method of claim 1, comprising:

the television automatically announcing the automatic content identification service thereof to the pairing server.

9. A system comprising:

a television;

a relevancy-matching server to;

match primary data generated using fingerprint data with targeted data based on a relevancy factor, and

search a storage for at least one of the targeted data, a reference to the targeted data and a metadata of the targeted data; and

a mobile device associated with the television, at least one of the television and the mobile device being configured to generate the fingerprint data from characteristic features of media data,

wherein the mobile device is configured to;

process an embedded object within a sandboxed application,

constrain an executable environment in a security sandbox, and

execute the embedded object through the sandboxed application in the executable environment capable of bypassing at least one access control of the security sandbox, the execution of the embedded object causing rendering of the targeted data therethrough,

wherein the television executes a sandbox-reachable service thereon, and is configured to automatically announce the sandbox-reachable service to a discovery module executing at least one of;

on a pairing server external to the mobile device and as part of an extension of the security sandbox executing on the mobile device,

wherein the discovery module identifies the sandbox-reachable service offered through the television based on receiving the automatic announcement to enable the sandboxed application of the mobile device reach the sandbox-reachable service by communicating an identification data of the television via the sandbox-reachable service when a shared computer network is determined to be commonly associated with the mobile device and the television,

wherein the sandboxed application reaching the sandbox-reachable service establishes bidirectional communication between the mobile device and the television, and, thereby, association between the mobile device and the television,

wherein the primary data is available across the sandbox-reachable service and the sandboxed application based on the established bidirectional communication between the mobile device and the television, and

wherein the relevancy-matching server causes the rendering of the targeted data to a user through the sandboxed application of the mobile device.

10. The system of claim 9:

wherein the relevancy factor comprises at least one of a category of the primary data, a behavioral history of the user, a category of the sandboxed application, and other information associated with the user.

11. The system of claim 9, wherein:

the identification data of the television comprises at least one of a GUID, an alphanumeric name, a hardware address associated with the television, a public address associated with an automatic content identification service of the television, and a private address associated with the automatic content identification service of the television when the shared computer network is determined to be commonly associated with the mobile device and the television.

12. The system of claim 9:

wherein the embedded object comprises at least one of a script, an image, a player, an iframe, and other external media included in the sandboxed application.

13. The system of claim 9, further comprising:

a content identification server to;

process the fingerprint data from the at least one of the television and the mobile device, and

communicate the primary data from the fingerprint data to any of a number of devices with access to at least one of;

the identification data of the television and an identification data of an automatic content identification service of the television.

14. The system of claim 9:

wherein the relevancy-matching server generates the targeted data.

15. The system of claim 9:

wherein the mobile device is associated with the user based on a unique identifier.

16. The system of claim 9:

wherein the primary data further comprises at least one of descriptive metadata associated with a content identification data, a monitored event, a geolocation, a weather information, a private IP address, and other data stored in at least one of a volatile memory and a non-volatile memory.

17. The system of claim 9:

wherein the television automatically announces an automatic content identification service thereof to the pairing server.

18. A method comprising:

generating, through at least one of a television and a mobile device, fingerprint data from characteristic features of media data;

matching primary data generated from the fingerprint data with targeted data based on a relevancy factor using a relevancy-matching server, the matching comprising searching a storage for at least one of a matching item and a related item based on the relevancy factor comprising at least one of a category of the primary data, a behavioral history of a user, a category of a sandboxed application of the mobile device, and other information associated with the user;

searching the storage for at least one of the targeted data, a reference to the targeted data and a metadata of the targeted data using the relevancy-matching server,

wherein the primary data is any one of a content identification data and a content identification history;

associating the mobile device with the television based on;

executing a sandbox-reachable service on the television;

automatically announcing, through the television, the sandbox-reachable service to a discovery module executing at least one of;

on a pairing server external to the mobile device and as part of an extension of a security sandbox executing on the mobile device, the security sandbox constraining an executable environment for the sandboxed application therein;

identifying the sandbox-reachable service offered through the television based on receiving, through the discovery module, the automatic announcement to enable the sandboxed application of the mobile device reach the sandbox-reachable service by communicating an identification data of the television via the sandbox-reachable service when a shared computer network is determined to be commonly associated with the mobile device and the television; and

establishing bidirectional communication between the mobile device and the television based on the sandboxed application reaching the sandbox-reachable service to render the primary data available across the sandbox-reachable service and the sandboxed application; and

determining the mobile device to be associated with the user based on a unique identifier that is unlikely to change.

19. The method of claim 18:

wherein

the identification data of the television comprises at least one of a GUID, an alphanumeric name, a hardware address associated with the television, a public address associated with an automatic content identification service of the television, and a private address associated with the automatic content identification service of the television when the shared computer network is determined to be commonly associated with the mobile device and the television.

20. The method of claim 18, further comprising:

the mobile device processing an embedded object through the sandboxed application comprising at least one of a script, an image, a player, an iframe, and other external media included in the sandboxed application in accordance with the availability of the primary data across the sandbox-reachable service and the sandboxed application.

21. The method of claim 18, further comprising:

processing the fingerprint data from the at least one of the television and the mobile device through a content identification server; and

communicating the primary data from the fingerprint data to any of a number of devices with access to at least one of;

the identification data of the television and an identification data of an automatic content identification service of the television through the content identification server.

22. The method of claim 18, comprising:

the relevancy matching server causing rendering of the targeted data to the user through an embedded object within the sandboxed application of the mobile device.

23. The method of claim 18:

wherein the primary data comprises at least one of a number of descriptive metadata associated with the content identification data, a monitored event, a geolocation, a weather information, a private IP address, and other data stored in at least one of a volatile memory and a non-volatile memory.

24. The method of claim 18, comprising:

generating, through the relevancy-matching server, the targeted data.

25. A method comprising:

generating, through at least one of a television and a mobile device, fingerprint data from characteristic features of media data;

matching primary data generated from the fingerprint data with targeted data, based on a relevancy factor comprising at least one of a category of the primary data, a behavioral history of a user, a category of a sandboxed application of the mobile device, and other information associated with the user, using a relevancy-matching server, the relevancy-matching server being communicatively coupled with the television and the mobile device through a network;

looking in a data repository for at least one of the targeted data, a reference to the targeted data and a metadata of the targeted data using the relevancy-matching server,

wherein the primary data is any one of a content identification data and a content identification history, and

wherein the primary data comprises at least one of a number of descriptive metadata associated with the content identification data, a monitored event, a geolocation, a weather information, a private IP address, and other data stored in at least one of a volatile memory and a non-volatile memory; and

associating the mobile device with the television based on;

executing a sandbox-reachable service on the television;

automatically announcing, through the television, the sandbox-reachable service to a discovery module executing at least one of;

on a pairing server external to the mobile device and as part of an extension of a security sandbox executing on the mobile device, the security sandbox constraining an executable environment for the sandboxed application therein;

identifying the sandbox-reachable service offered through the television based on receiving, through the discovery module, the automatic announcement to enable the sandboxed application of the mobile device reach the sandbox-reachable service by communicating an identification data of the television via the sandbox-reachable service when a shared computer network is determined to be commonly associated with the mobile device and the television; and

establishing bidirectional communication between the mobile device and the television based on the sandboxed application reaching the sandbox-reachable service to render the primary data available across the sandbox-reachable service and the sandboxed application.

26. The method of claim 25, further comprising:

matching the targeted data with the primary data based on the relevancy-matching server looking in the data repository for at least one of a matching item and a related item based on the relevancy factor,

wherein

the identification data of the television comprises at least one of a GUID, an alphanumeric name, a hardware address associated with the television, a public address associated with an automatic content identification service of the television, and a private address associated with the automatic content identification service of the television when the shared computer network is determined to be commonly associated with the mobile device and the television.

27. The method of claim 25, further comprising:

the mobile device processing an embedded object through the sandboxed application comprising at least one of a script, an image, a player, an iframe, and other external media included in the sandboxed application in accordance with the availability of the primary data across the sandbox-reachable service and the sandboxed application.

28. The method of claim 25, further comprising:

processing the fingerprint data from the at least one of the television and the mobile device through a content identification server; and

communicating the primary data from the fingerprint data to any of a number of devices with access to at least one of;

the identification data of the television and an identification data of an automatic content identification service of the television through the content identification server.

29. The method of claim 25, further comprising:

the relevancy-matching server causing rendering of the targeted data to the user through the sandboxed application of the mobile device.

30. The method of claim 25, comprising:

the television automatically announcing an automatic content identification service thereof to the pairing server.