System and method of applying multiple adaptive privacy control layers to encoded media file types

• US 10,037,413 B2
• Filed: 12/31/2016
• Issued: 07/31/2018
• Est. Priority Date: 12/31/2016
• Status: Active Grant

• Current Assignee: Entefy Inc.
• Original Assignee: Entefy Inc.
• Inventors: Ghafourifar, Alston, Michelsen, Wayne
• Primary Examiner(s): Pyzocha, Michael
• Application Number:
  US15/396,491
• Publication Number:
  US 20180189461A1
• Time in Patent Office: 577 Days
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/2347 involving video stream encryption
• CPC Class Codes: H04N 21/26613 for generating or managing keys in general key distribution for secret or secure communication involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] H04L9/083; network support of key management H04L63/06; key management for network security in communication control or processing H04W12/04
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/631 Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols
• CPC Class Codes: H04N 7/16 Analogue secrecy systems; Analogue subscription systems

Abstract

Disclosed are systems to apply customized permission settings to protect particular regions of a document, and, in particular, documents that are of a lossy′ encoded media file type, e.g., an MPEG video format. The custom access permission settings may be implemented by obfuscating the protected regions of the original file and then embedding “secret,” e.g., hidden and/or encrypted, versions of the obfuscated regions in parts of the data structure of the original file, e.g., in the form of “layers” that are held within video stream containers. The content of the individual encrypted video stream containers may then be decrypted according to each recipient'"'"'s permissions and layered on top of the obfuscated regions of the encoded media file before being displayed to the recipient. In some embodiments, additional layers of video may be used to reduce the appearance of aliasing around borders of the protected regions of the encoded media file.

Claims

1. A non-transitory computer readable medium comprising computer executable instructions stored thereon that when executed cause one or more processing units to:

receive an indication of a first protected region of a file of an encoded media file type that uses lossy compression;

receive first access permission settings for the first protected region;

receive an indication of a first recipient for the first protected region;

create an encrypted version of the first protected region of the file;

generate a first layer representation corresponding to the first protected region, wherein the first layer representation comprises the encrypted version of the first protected region of the file and a first pixel margin buffer surrounding the first protected region;

create a version of the file that is obfuscated at a location of the first protected region;

generate a second layer representation, wherein the second layer representation comprises a hollow frame region configured to overlay and enclose the first protected region, and wherein the second layer representation is configured to mask aliasing artifacts caused by the obfuscation at the location of the first protected region;

create an edited encoded media file based on the version of the file that is obfuscated at the location of the first protected region;

add the first and second layer representations into the file structure of the edited encoded media file; and

transmit the edited encoded media file to the first recipient.

2. The non-transitory computer readable medium of claim 1, wherein the second layer representation is not encrypted.

3. The non-transitory computer readable medium of claim 1, wherein the first layer representation and the second layer representation are at least partially overlapping.

4. The non-transitory computer readable medium of claim 1, wherein the first protected region comprises one or more portions within one or more video frames of the encoded media file.

5. The non-transitory computer readable medium of claim 4, wherein the first protected region further comprises one or more identified objects that are tracked over the one or more video frames of the encoded media file.

6. The non-transitory computer readable medium of claim 1, wherein the instructions to encrypt the protected region further include instructions to cause the one or more processing units to:

encrypt the first protected region based, at least in part, on the first access permission setting.

7. The non-transitory computer readable medium of claim 1, wherein a size of the first pixel margin buffer surrounding the first protected region is determined based, at least in part, on an encoding method used to create the edited encoded media file.

8. The non-transitory computer readable medium of claim 1, wherein at least one of the first layer representation and the second layer representation is stored in a Video Object Plane (VOP).

9. The non-transitory computer readable medium of claim 1, wherein the edited encoded media file is configured such that the first and second layer representations are only viewable by a recipient in an authorized viewing application.

10. The non-transitory computer readable medium of claim 1, wherein the first layer representation is configured to be layered on top of the edited encoded media file when an authorized recipient views the file in an authorized viewing application.

11. The non-transitory computer readable medium of claim 10, wherein the second layer representation is configured to be layered on top of both the edited encoded media file and the first layer representation when an authorized recipient views the file in an authorized viewing application.

12. A system, comprising:

a memory; and

one or more processing units, communicatively coupled to the memory, wherein the memory stores instructions to configure the one or more processing units to;

receive an indication of a first protected region of a file of an encoded media file type that uses lossy compression;

receive first access permission settings for the first protected region;

receive an indication of a first recipient for the first protected region;

create an encrypted version of the first protected region of the file;

generate a first layer representation corresponding to the first protected region, wherein the first layer representation comprises the encrypted version of the first protected region of the file and a first pixel margin buffer surrounding the first protected region;

create a version of the file that is obfuscated at a location of the first protected region;

generate a second layer representation, wherein the second layer representation comprises a hollow frame region configured to overlay and enclose the first protected region, and wherein the second layer representation is configured to mask aliasing artifacts caused by the obfuscation at the location of the first protected region;

create an edited encoded media file based on the version of the file that is obfuscated at the location of the first protected region;

add the first and second layer representations the file structure of the edited encoded media file; and

transmit the edited encoded media file to the first recipient.

13. The system of claim 12, wherein the second layer representation is not encrypted.

14. The system of claim 12, wherein the first layer representation and the second layer representation are at least partially overlapping.

15. The system of claim 12, wherein the first protected region comprises one or more portions within one or more video frames of the encoded media file.

16. The system of claim 15, wherein the first protected region further comprises one or more identified objects that are tracked over the one or more video frames of the encoded media file.

17. The system of claim 12, wherein the instructions to encrypt the protected region further include instructions to cause the one or more processing units to:

encrypt the first protected region based, at least in part, on the first access permission setting.

18. The system of claim 12, wherein a size of the first pixel margin buffer surrounding the first protected region is determined based, at least in part, on an encoding method used to create the edited encoded media file.

19. The system of claim 12, wherein at least one of the first layer representation and the second layer representation is stored in a VOP.

20. The system of claim 12, wherein the edited encoded media file is configured such that the first and second layer representations are only viewable by a recipient in an authorized viewing application.

21. The system of claim 12, wherein the first layer representation is configured to be layered on top of the edited encoded media file when an authorized recipient views the file in an authorized viewing application.

22. The system of claim 21, wherein the second layer representation is configured to be layered on top of both the edited encoded media file and the first layer representation when an authorized recipient views the file in an authorized viewing application.

23. A computer-implemented method, comprising:

receiving an indication of a first protected region of a file of an encoded media file type that uses lossy compression;

receiving first access permission settings for the first protected region;

receiving an indication of a first recipient for the first protected region;

creating an encrypted version of the first protected region of the file;

generating a first layer representation corresponding to the first protected region, wherein the first layer representation comprises the encrypted version of the first protected region of the file and a first pixel margin buffer surrounding the first protected region;

creating a version of the file that is obfuscated at a location of the first protected region;

generating a second layer representation, wherein the second layer representation comprises a hollow frame region configured to overlay and enclose the first protected region, and wherein the second layer representation is configured to mask aliasing artifacts caused by the obfuscation at the location of the first protected region;

creating an edited encoded media file based on the version of the file that is obfuscated at the location of the first protected region;

adding the first and second layer representations the file structure of the edited encoded media file; and

transmitting the edited encoded media file to the first recipient.

24. The method of claim 23, wherein a size of the first pixel margin buffer surrounding the first protected region is determined based, at least in part, on an encoding method used to create the edited encoded media file.

25. The method of claim 23, wherein the first layer representation is configured to be layered on top of the edited encoded media file when an authorized recipient views the file in an authorized viewing application, and wherein the second layer representation is configured to be layered on top of both the edited encoded media file and the first layer representation when an authorized recipient views the file in an authorized viewing application.