Method and apparatus to provide a unified redaction system

• US 7,805,673 B2
• Filed: 07/31/2006
• Issued: 09/28/2010
• Est. Priority Date: 07/29/2005
• Status: Expired due to Fees

• Current Assignee: Ernst & Young US LLP (Ernst & Young LLP)
• Original Assignee: Cataphora Incorporated
• Inventors: Dhakouani, Neji, der Quaeler, Loki, Charnock, Elizabeth
• Primary Examiner(s): Hutton; Doug
• Assistant Examiner(s): Mills; Frank D
• Application Number:
  US11/497,470
• Publication Number:
  US 20070030528A1
• Time in Patent Office: 1,520 Days
• Field of Search: 715/271, 715/255
• US Class Current: 715/255
• CPC Class Codes: G06F 16/33 Querying
• CPC Class Codes: G06F 21/6254 by anonymising data, e.g. decorrelating personal data from the owner's identification
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A method comprising enabling a user to define a redaction of a part of a document in a corpus of documents, the redaction definition including a scope defining a range of documents in the corpus to which the redaction applies.

Claims

1. A method comprising:

enabling a user to define a redaction of a part of a document in a corpus of documents, the redaction definition including a scope defining a range of documents in the corpus to which the redaction applies, wherein the document is produced as a bitmap image file in which a redacted region appears as a region of black pixel data;

creating a temporary image file representing an unredacted version of the document;

creating a temporary image file representing a redacted version of the document utilizing custom fonts in rendering which result in foreground and background colors of redaction regions being an inverse of the foreground and the background colors of fonts used for non-redaction regions;

performing XOR operations between corresponding sections in the temporary image files of the unredacted and the redacted documents; and

creating a mapping between a redacted token and pixel space bounds of the redacted token, thereby creating the region of black pixel data.

2. The method of claim 1, wherein a document is any type of information that has been committed to a permanent electronic medium.

3. The method of claim 2, wherein each document has a document type, and document types include one or more of the following:

text documents, image documents, motion documents, and mixed type documents.

4. The method of claim 3, wherein a document may include metadata, and the metadata is available for redaction.

5. The method of claim 2, wherein a document is data extracted from a database, the method further comprising:

defining boundaries of one or more documents from the data extracted from the database; and

defining-any potential subsections of the one or more documents.

6. The method of claim 1, wherein the redaction scope is a defined subset of the corpus.

7. The method of claim 1, wherein the redaction has a category associated with it, the category defining a reason for the redaction.

8. The method of claim 7, further comprising:

automatically assigning a reason to a redaction based on a set of rules.

9. The method of claim 1, wherein the redaction has a content associated with it, the content specifying what was redacted.

10. The method of claim 9, further comprising:

automatically generating a redaction description.

11. The method of claim 9, wherein the content comprises, for a supra-document image specification a hash value to represent an image or image portion redacted.

12. The method of claim 9, wherein the content comprises, for an image document, a page number, a layer number, and a closed path defining a polygonal region.

13. The method of claim 9, wherein the content comprises, for a motion document, a starting and ending time stamp of an interval to be redacted.

14. The method of claim 1, further comprising:

adding each non-ephemeral interaction with the redaction to an audit trail.

15. The method of claim 1, further comprising:

performing de-duplication on the corpus of documents, prior to applying the redactions.

16. The method of claim 15, further comprising:

de-duplicating content on a text block by text block basis for no-boundary documents.

17. The method of claim 15, further comprising:

propagating the redaction to copies of a redacted document.

18. The method of claim 1, further comprising:

identifying items having linked documents; and

attempting to acquire and cache copies of embedded documents, to ensure that any referenced embedded documents can also be produced and redacted.

19. The method of claim 18, further comprising:

enabling a user to freeze the document, so that during production the cached copy of the embedded documents are produced by preference.

20. The method of claim 1, further comprising:

identifying a document including variable data; and

classifying the document as having variable data.

21. The method of claim 20, further comprising:

enabling the user to freeze the variable data at intake, so that during production, values of the variable data will be made static at the moment of intake.

22. The method of claim 1, further comprising:

providing a single user interface for redaction, the single user interface capable of handling documents of two or more of the following types;

text documents, image documents, motion documents, and mixed-type documents.

23. The method of claim 1, further comprising:

for a spreadsheet document, enabling redaction of part of a cell.

24. The method of claim 23, further comprising:

enabling the user to select a plurality of cells for redaction.

25. The method of claim 24, wherein the selection is based on one or more of the following:

manual selection of cells, cell attributes.

26. The method of claim 1, wherein redaction comprises one or more of the following:

removal of data, removal of data and insertion of segment of alternative data of a same length, and removal of data and insertion of empty data of the same length.

27. The method of claim 1, further comprising:

upon receiving a redaction edit, determining whether the document being redacted has been produced; and

alerting a user that the document has been previously produced.

28. The method of claim 27, further comprising:

when an agreement regarding clawback exists, replacing the previously produced document with an incorrect redaction with a newly, correctly redacted document.

29. The method of claim 1, further comprising:

enabling a migration of redactions from an originally redacted corpus to a destination corpus.

30. The method of claim 29, further comprising:

flagging any redactions that were selected for migration and which cannot be migrated, based on a set of rules.

31. The method of claim 1, further comprising:

presenting a user interface to enable what-if modeling of redactions, to indicate without actually saving the redactions.

32. The method of claim 31, further comprising:

identifying groups of documents within a particular set that are indicated as affected by the what-if modeling.

33. The method of claim 1, further comprising:

maintaining a redaction log, the redaction log configurable to enable a user to view redaction history in various ways.

34. The method of claim 33, wherein the redaction log enables a user to correct mistakes, alter redactions, and track reviewer performance.

35. The method of claim 1, further comprising:

watermarking image documents after redaction.

36. The method of claim 1, further comprising:

providing an option to disable a redaction, after the redaction has been made, with respect to one or more matters.

37. The method of claim 1, further comprising:

utilizing redundant verification to verifying that text content was successfully redacted.

38. The method of claim 37, wherein the redundant verification comprises performing optical character recognition (OCR) on the redacted text content;

and verifying that none of the redacted text is present.

39. The method of claim 1, further comprising:

permitting a user-configurable display of redactions to indicate different attributes of the redaction.

40. The method of claim 39, further comprising:

displaying redacted data with a transparency setting, wherein the transparency setting is completely opaque for certain redactions.

41. The method of claim 1, further comprising:

performing analysis on items being displayed to determine content that should likely be redacted, whether or not a user has redacted it.

42. The method of claim 41, further comprising:

providing a redaction hint when the analysis indicates that content on the items should be redacted.

43. The method of claim 41, further comprising:

comparing the analysis to actual reduction decisions by a reviewer, to check for reviewer consistency.

44. The method of claim 1, further comprising:

providing controls to redact an entire document section when the document section contains any redactions, with a single selection.

45. The method of claim 44, wherein a document section comprises one of the following:

phrase, sentence, paragraph, document section, entire document.

46. The method of claim 1, further comprising:

dividing no-boundary content, including instant message transcripts, into sessions to enable redaction.

47. The method of claim 1, further comprising:

providing a first view and a timeline view to display a motion document, to enable tracking along a timeline; and

providing a model-view-controller so when a user navigates to a particular point in time in one of the views, all of the other views reset to the particular point.

48. The method of claim 47, further comprising:

providing an audio-to-text transcript view, when audio data is part of the motion document.

49. The method of claim 1, further comprising:

for mixed type documents, displaying a root document, and custom UI widgets to represent a sub-document.

50. The method of claim 49, wherein the custom UI widget to represent a sub-document comprises a button which contains a thumbnail image associated with the sub-document.

51. The method of claim 49, further comprising:

providing a tiling option, which displays the root document and at least one sub-document simultaneously.

52. The method of claim 1, further comprising:

providing a tool enabling an administrator to specify that certain items cannot be redacted without approval from the administrator.

53. The method of claim 1, further comprising:

requesting a jurisdiction identification for a newly created matter including one or more documents; and

automatically applying a rule set associated with the jurisdiction for the analysis.

54. The method of claim 1, further comprising:

creating a mapping between the redacted token and a redaction category;

using the created mapping to render a name of the redaction category on the black pixel data region representing the associated redacted token.

55. The method of claim 1, further comprising:

condensing neighboring regions of black pixel data to create larger contiguous regions of black pixel data.

56. A method comprising:

enabling a user to define a redaction of a part of a document in a corpus of documents, the redaction definition including a scope defining a range of documents in the corpus to which the redaction applies, wherein the document is produced as a bitmap image file in which a redacted text appears as a region of black pixel data;

creating a temporary image file representing an unredacted version of the document;

creating a temporary image file representing a redacted version of the document utilizing a character transposition on the redacted text that is calculated to match rendered bounds of the unredacted version of the text;

using a region detection process which accounts for page orientation and text reading direction to produce a pixel space representation of relevant text tokens on any given page of the document;

performing XOR operations between each corresponding section in the image files of the unredacted and redacted versions of the document;

grouping differences produced by the XOR operations into the detected token regions;

filling the affected token regions with black pixel data; and

creating a mapping between a redacted token and pixel space bounds of the redacted token.

57. The method of claim 56, further comprising:

condensing neighboring regions of black pixel data to create larger contiguous regions of black pixel data.

58. The method of claim 56, further comprising:

creating a mapping between redacted token and a redaction category;

using the created mappings to render a name of the redaction category on the black pixel data region representing the associated redacted token.