Generating and storing a printed representation of a document on a local computer upon printing

• US 9,311,336 B2
• Filed: 06/11/2012
• Issued: 04/12/2016
• Est. Priority Date: 07/31/2006
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Hull, Jonathan J., Erol, Berna, Graham, Jamey, Moraleda, Jorge, Sakikawa, Ichiro, Van Olst, Daniel G.
• Primary Examiner(s): Baderman, Scott
• Assistant Examiner(s): Mrabi, Hassan
• Application Number:
  US13/494,008
• Publication Number:
  US 20120257237A1
• Time in Patent Office: 1,401 Days
• Field of Search: 715/205, 715/233, 715/274
• US Class Current: 1/1
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit, and an MMR publisher. A computer includes a document authoring application, plug-in, and printer driver. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a method for capturing symbolic information from documents and for capturing printer dll functions.

Claims

1. A computer-implemented method performed by a printer driver, the method comprising:

intercepting, with one or more processors, a command to print a page intended for a printer graphics dynamically linked library;

creating a printer device context for a target printer device, the printer device context having an associated primary surface, the primary surface used to draw a printed representation of the page to the target printer device;

creating a memory buffer on a local computer and associating the memory buffer with the printer device context as a secondary surface, the secondary surface used to draw the printed representation of the page to the local computer;

performing, with the one or more processors, the command on the target printer device and the memory buffer to output the printed representation of the page on the primary surface associated with the target printer device and on the secondary surface associated with the memory buffer;

extracting, with the one or more processors, features from the printed representation of the page on the secondary surface by applying a transformation rule to a portion of the printed representation of the page and parsing the portion of the printed representation of the page to capture coordinates corresponding to the features; and

storing, on the local computer, contents of the memory buffer including a raster image of the printed representation of the page along with the extracted features.

2. The method of claim 1, wherein the extracted features include at least one of x-y coordinates of content within the printed representation of the page, two dimensional arrangements of text within the printed representation of the page, characteristics of text within the printed representation of the page and characteristics of images within the printed representation of the page.

3. The method of claim 1, further comprising creating a physical device instance and a printer device monitoring object.

4. The method of claim 3, wherein the printer device monitoring object creates the memory buffer as the secondary surface.

5. The method of claim 1, further comprising, in response to the command to print the page, storing the extracted features as a symbolic description.

6. The method of claim 1, further comprising monitoring calls received at the printer graphics dynamically linked library.

7. The method of claim 6, further comprising passing on the received calls to the printer graphics dynamically linked library.

8. The method of claim 1, wherein the print driver comprises a print capture dynamically linked library for performing one or more of the intercepting, performing, extracting, and storing;

and wherein the print capture dynamically linked library is a forwarding dynamically linked library.

9. A computer program product comprising a non-transitory machine-readable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

intercept a command to print a page intended for a printer graphics dynamically linked library;

create a printer device context for a target printer device, the printer device context having an associated primary surface, the primary surface used to draw a printed representation of the page to the target printer device;

create a memory buffer on a local computer and associating the memory buffer with the printer device context as a secondary surface, the secondary surface used to draw the printed representation of the page to the local computer;

perform the command on the target printer device and the memory buffer to output the printed representation of the page on the primary surface associated with the target printer device and on the secondary surface associated with the memory buffer;

extract features from the printed representation of the page on the secondary surface by applying a transformation rule to a portion of the printed representation of the page and parsing the portion of the printed representation to capture coordinates corresponding to the features;

and store, on the local computer, contents of the memory buffer including a raster image of the printed representation of the page along with the extracted features.

10. The computer program product of claim 9, wherein the extracted features include at least one of x-y coordinates of content within the printed representation of the page, two dimensional arrangements of text within the printed representation of the page, characteristics of text within the printed representation of the page and characteristics of images within the printed representation of the page.

11. The computer program product of claim 9, further causing the computer to create a physical device instance and a printer device monitoring object.

12. The computer program product of claim 11, wherein the printer device monitoring object creates the memory buffer as the secondary surface.

13. The computer program product of claim 9, further causing the computer to, in response to the command to print the page, store the extracted features as symbolic description.

14. The computer program product of claim 9, further causing the computer to monitor calls received at the print capture dynamically linked library.

15. The computer program product of claim 14, further causing the computer to pass on the received calls to the printer graphics dynamically linked library.

16. The computer program product of claim 9, further causing the computer to perform one or more of the intercepting, performing, extracting, and storing by a print capture dynamically linked library;

and wherein the print capture dynamically linked library is a forwarding dynamically linked library.

17. A system comprising:

one or more processors;

a printer driver stored in a memory and executable by the one or more processors for intercepting a command to print a page intended for a printer graphics dynamically linked library, creating a printer device context for a target printer device, the printer device context having an associated primary surface, the primary surface used to draw a printed representation of the page to the target printer device, creating a memory buffer on a local computer and associating the memory buffer with the printer device context as a secondary surface, the secondary surface used to draw the printed representation of the page to the local computer, performing the command on the target printer device and the memory buffer to output the printed representation of the page on the primary surface associated with the target printer device and on the secondary surface associated with the memory buffer, and extracting features from the printed representation of the page on the secondary surface by applying a transformation rule to a portion of the printed representation and parsing the portion of the printed representation to capture coordinates corresponding to the features;

and a storage module stored in the memory and executable by the one or more processors, the storage module coupled to the printer driver and for storing, on the local computer, contents of the memory buffer including a raster image of the printed representation of the page along with the extracted features.

18. The system of claim 17, wherein the extracted features include at least one of x-y coordinates of content within the printed representation of the page, two dimensional arrangements of text within the printed representation of the page characteristics of text within the printed representation of the page and characteristics of images within the printed representation of the page.

19. The system of claim 17, wherein the printer driver creates a physical device instance and a printer device monitoring object.

20. The system of claim 19, wherein the printer device monitoring object creates the memory buffer as the secondary surface.