Adding value to a rendered document

• US 9,811,728 B2
• Filed: 08/13/2013
• Issued: 11/07/2017
• Est. Priority Date: 04/12/2004
• Status: Active Grant

• Current Assignee: Kyocera Corporation
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: King, Martin T., Grover, Dale L., Kushler, Clifford A., Stafford-Fraser, James Q.
• Primary Examiner(s): NGUYEN, CHAU T
• Application Number:
  US13/966,236
• Publication Number:
  US 20170140219A1
• Time in Patent Office: 1,547 Days
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/332 Query formulation
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/131 Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1448 based on markings or identifiers characterising the document or the area
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images

Abstract

A system for processing data captured from rendered documents is described. The system provides a way for authors and publishers to add value to printed documents using associated supplemental material. The system can use text scanned from a document and context to identify an electronic document that corresponds to the scanned document. A user can then access supplemental material associated with the digital document.

Claims

1. A computer implemented method of identifying a document, the method comprising:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of the document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document;

identifying a location-based action to be performed based on the identified location of the captured portion and data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.

2. The method of claim 1, wherein identifying the digital document associated with the document comprises receiving data specifying a second scan of a second portion of a second document and using the second portion to identify the digital document associated with the document.

3. The method of claim 2, wherein the second document is the document.

4. The method of claim 3, wherein the second portion of the second document is the same as the captured portion of the document.

5. The method of claim 1, wherein identifying location of the captured portion within the digital document comprises identifying the location in a layout independent manner using features of the captured portion that are independent of a rendering format of the document.

6. The method of claim 1, wherein the document context data comprises geographic data specifying a geographic location at which each previous scan occurred.

7. The method of claim 6, wherein the geographic data specifies global positioning system coordinates.

8. The method of claim 1, wherein identifying the digital document associated with the document comprises identifying the document in a layout independent manner using features of the captured portion that are independent of a rendering format of the document.

9. The method of claim 1, wherein the captured portion comprises a plurality of line portions of the document.

10. The method of claim 1, wherein a typographic change indicates a change in document context.

11. The method of claim 1, wherein identifying the location-based action to be performed comprises determining similar actions from other captures of portions of documents.

12. The method of claim 1, wherein identifying a digital document comprises:

identifying a plurality of digital documents; and

identifying the digital document from among the plurality of identified digital documents.

13. The method of claim 12, wherein the plurality of identified digital documents are ranked according to similar captures of portions of documents.

14. The method of claim 1, further comprising posting text related to the identified digital document to a computer accessible location.

15. A computing system having a processor coupled to a memory containing computer executable instructions for performing functions of:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of a document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document; and

identifying a location-based action to be performed based on the identified location of the captured portion data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.

16. The computing system of claim 15:

wherein the document context data further comprises data specifying frequencies with which portions located within a plurality of digital documents are captured, and

wherein identifying the digital document associated with the document using the document context data and the captured portion comprises;

identifying a plurality of digital documents that include the captured portion;

ranking the plurality of digital documents based on the frequencies; and

selecting a digital document having a maximum frequency of the frequencies from among the plurality of digital documents.

17. The computing system of claim 15:

wherein the document context data further comprises data specifying frequencies with which portions located within a plurality of digital documents are captured, and

identifying a location of the captured portion within the digital document comprises;

identifying a plurality of locations within the digital document;

ranking the plurality of locations based on the frequencies; and

selecting a location having a maximum frequency of the frequencies from among the plurality of locations.

18. A non-transitory computer readable storage medium having storied therein instructions executable by a computing device to cause the computing device to perform functions of:

obtaining document context data for one or more documents, wherein the document context data includes supplemental information used to identify the document and includes temporal information for one or more previous scans of portions of the one or more documents, the temporal information specifying a time at which each previous scan occurred;

receiving data specifying a portion of a document captured using a handheld capture device;

identifying a digital document associated with the document using the document context data including the temporal information and the captured portion of the document;

identifying, using the captured portion of the document, a location of the captured portion within the digital document;

identifying a location-based action to be performed based on the identified location of the captured portion and data specifying one or more location-based actions associated with one or more locations within the digital document; and

performing the identified location-based action.