Method, manufacture, and apparatus for protection of media objects from the web application environment

• US 9,697,185 B1
• Filed: 12/07/2012
• Issued: 07/04/2017
• Est. Priority Date: 12/12/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Dorwin, David Kimbal, Scherkus, Andrew Martin
• Primary Examiner(s): Louie, Oscar
• Assistant Examiner(s): Forman, James
• Application Number:
  US13/708,573
• Time in Patent Office: 1,670 Days
• CPC Class Codes: G06F 11/3003 Monitoring arrangements specially adapted to the computing system or computing system component being monitored
• CPC Class Codes: G06F 21/105 Arrangements for software license management or administration, e.g. for managing licenses at corporate level
• CPC Class Codes: G06F 21/1062 Editing
• CPC Class Codes: G06F 21/1073 Conversion
• CPC Class Codes: G06F 21/50 Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
• CPC Class Codes: G06F 21/60 Protecting data
• CPC Class Codes: G06F 21/602 Providing cryptographic facilities or services
• CPC Class Codes: G06F 21/62 Protecting access to data via a platform, e.g. using keys or access control rules
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G11B 20/00086 Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: H04L 2209/603 Digital right managament [DRM]
• CPC Class Codes: H04L 2463/101 applying security measures for digital rights management data processing systems or methods, specially adapted for commerce, e.g. marketing, shopping, billing, auctions or e-commerce G06Q30/00
• CPC Class Codes: H04L 2463/103 applying security measure for protecting copy right protecting software against unauthorised usage in a vending or licensing environment, e.g. protection the software providers copyright G06F21/10; data processing systems or methods, specially adapted for payment schemes, architectures or protocols G06Q20/00; secrecy systems or subscription systems H04N7/16
• CPC Class Codes: H04L 47/801 Real time traffic
• CPC Class Codes: H04L 47/805 QOS or priority aware
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/06 for supporting key management in a packet data network cryptographic mechanisms or cryptographic arrangements for key management H04L9/08
• CPC Class Codes: H04L 63/0876 : based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
• CPC Class Codes: H04L 63/102 : Entity profiles
• CPC Class Codes: H04L 65/1101 : Session protocols
• CPC Class Codes: H04L 65/1108 : Web based protocols, e.g. webRTC
• CPC Class Codes: H04L 65/613 : for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/762 : at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04L 9/0631 : Substitution permutation network [SPN], i.e. cipher composed of a number of stages or rounds each involving linear and nonlinear transformations, e.g. AES algorithms
• CPC Class Codes: H04L 9/0861 : Generation of secret information including derivation or calculation of cryptographic keys or passwords
• CPC Class Codes: H04L 9/32 : including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
• CPC Class Codes: H04N 21/2347 : involving video stream encryption
• CPC Class Codes: H04N 21/24 : Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests monitoring of server performance or load G06F11/34; arrangements for observation, testing or troubleshooting for broadcast or for distribution combined with broadcast H04H20/12
• CPC Class Codes: H04N 21/25825 : involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 : involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4405 : involving video stream decryption
• CPC Class Codes: H04N 21/4516 : involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available

Abstract

A method, apparatus, and manufacture for content protection for protecting some objects is provided. A content protection operation or license operation is performed for at least one media object of a web application. Some or all of the objects are then marked as protected. When an operation is performed that accesses a protected object, a user agent determines whether to deny the operation, to allow the operation and mark data exported by the operation and objects storing the exported data as protected objects, or to allow the operation and not mark data exported by the operation and objects storing the exported data as protected objects.

Claims

1. A method, comprising:

receiving, by a user agent, a web application comprising a document object model (DOM);

performing, at the user agent, an operation for at least one media object of the web application, wherein the operation is at least one of a content protection operation or a license operation, and wherein the at least one media object includes at least one of a hypertext markup language (HTML) video element, an HTML audio element, or an HTML media element;

marking, based on the operation at the user agent, at least a portion of a plurality of objects within the DOM as protected objects; and

when another operation performed by the web application, based on an HTML canvas element of the web application, initiates access to a protected object of the DOM, employing the user agent to make a determination as to whether to deny said another operation, to allow said another operation and mark data exported by said another operation and objects storing data exported by said another operation as protected objects, or to allow said another operation and not mark data exported by said another operation and objects storing data exported by said another operation as protected objects.

2. The method of claim 1, wherein

marking the at least the portion of the plurality of objects as protected objects is accomplished by setting a Boolean flag for each object that is marked as a protected object.

3. The method of claim 1, wherein marking at least the portion of the plurality of objects as protected objects includes marking each of the plurality of objects.

4. The method of claim 1, wherein marking at least the portion of the plurality of objects as protected objects includes marking each of media elements, video elements, and audio elements in the plurality of objects.

5. The method of claim 1, wherein marking at least the portion of the plurality of objects as protected objects includes marking one or more of media elements, video elements, and audio elements in the plurality of objects.

6. The method of claim 1, further comprising tracking the protected objects and tracking code that acts on objects in the plurality of objects.

7. The method of claim 1, further comprising detecting code that is capable of accessing the protected objects.

8. The method of claim 1, wherein making the determination as to whether to enable protection is based, at least in part, on whether at least one of a browser add-on or a browser extension is present.

9. The method of claim 1, wherein making the determination as to whether to enable protection is based, at least in part, on a determination as to whether potentially adversarial behavior, scripts, or elements are present in the plurality of objects.

10. The method of claim 1, wherein making the determination as to whether to enable protection is based, at least in part, on whether the plurality of objects originate from more than one origin.

11. The method of claim 1, further comprising:

identifying, by the user agent, a reference to media content;

determining the identified media content is encrypted; and

marking the at least the portion of the plurality of objects within the DOM in response to determining that the identified media content is encrypted.

12. The method of claim 1, wherein the plurality of objects comprises the at least one media object.

13. The method of claim 1, wherein the at least one media element is an HTML5 element.

14. A client device, comprising:

a hardware memory storing instructions; and

a hardware processing component arranged to execute the instructions to enable actions, including;

receiving, by a user agent, a web application comprising a document object model (DOM);

performing, at the user agent, an operation for at least one media object of the web application, wherein the operation is at least one of a content protection operation or a license operation, and wherein the at least one media object includes at least one of a hypertext markup language (HTML) video element, an HTML audio element, or an HTML media element;

marking, based on the operation at the user agent, at least a portion of a plurality of objects within the DOM as protected objects; and

when another operation performed by the web application, based on an HTML canvas element of the web application, initiates access to a protected object of the DOM, employing the user agent of the client device to make a determination as to whether to deny said another operation, to allow said another operation and mark data exported by said another operation and objects storing data exported by said another operation as protected objects, or to allow said another operation and not mark data exported by said another operation and objects storing data exported by said another operation as protected objects.

15. The client device of claim 14, wherein the actions further include:

identifying, by the user agent, a reference to media content;

determining the identified media content is encrypted; and

marking the at least the portion of the plurality of objects within the DOM in response to determining that the identified media content is encrypted.

16. The client device of claim 14, wherein the plurality of objects comprises the at least one media object.

17. A non-transitory computer readable storage media having processor-executable code encoded therein, which when executed by one or more processors, enables actions, comprising:

receiving, by a user agent, a web application comprising a document object model (DOM);

performing, at the user agent, an operation for at least one media object of the web application, wherein the operation is at least one of a content protection operation or a license operation, and wherein the at least one media object includes at least one of a hypertext markup language (HTML) video element, an HTML audio element, or an HTML media element;

marking, based on the operation at the user agent, at least a portion of a plurality of objects within the DOM as protected objects; and

when another operation performed by the web application, based on an HTML canvas element of the web application, initiates access to a protected object of the DOM, employing the user agent to make a determination as to whether to deny said another operation, to allow said another operation and mark data exported by said another operation and objects storing data exported by said another operation as protected objects, or to allow said another operation and not mark data exported by said another operation and objects storing data exported by said another operation as protected objects.

18. The non-transitory computer readable storage media of claim 17, wherein the actions further comprise:

identifying, by the user agent, a reference to media content;

determining the identified media content is encrypted; and

marking the at least the portion of the plurality of objects within the DOM in response to determining that the identified media content is encrypted.

19. The non-transitory computer readable storage media of claim 17, wherein the plurality of objects comprises the at least one media object.

20. The non-transitory computer readable storage media of claim 17, wherein the at least one media element is an HTML5 element.