Electronic filing system searchable by a handwritten search query

• US 7,630,962 B2
• Filed: 01/13/2003
• Issued: 12/08/2009
• Est. Priority Date: 01/31/2002
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Napper, Jonathon Leigh, Lapstun, Paul
• Primary Examiner(s): Breene; John E
• Assistant Examiner(s): Le; Thu-Nguyet
• Application Number:
  US10/502,575
• Publication Number:
  US 20050154707A1
• Time in Patent Office: 2,521 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/50 of still image data
• CPC Class Codes: G06F 16/53 Querying
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/15 Cutting or merging image elements, e.g. region growing, watershed or clustering-based techniques
• CPC Class Codes: G06V 30/268 Lexical context
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching

Abstract

A method of providing an electronic filing system which is searchable using a handwritten search query, the method including the steps of: obtaining the handwritten search query using an input device; performing a search of at least one database based on a comparison between the handwritten search query and handwritten annotations made on interactive pages stored in the at least one database; and, providing the results of the search to a user and facilitating access to at least one interactive page identified in the results of the search. An apparatus is also disclosed. Preferably, the interactive page is provided to the user in the form of printed paper, and the handwritten annotations are user handwriting, symbols, drawings, indicia or the like.

Claims

1. A method of providing an electronic filing system which is searchable using a handwritten search query, the method including the steps of:

obtaining the handwritten search query using interaction of an input device;

obtaining a text search query including a text search term;

performing a search of at least one database for instances of the text search term;

performing a search of the at least one database for handwritten annotations that are a given physical distance from each of at least one of the instances of the text search term;

comparing the handwritten search query and the handwritten annotations in order to determine matches between the handwritten search query and the handwritten annotations; and

,

providing results of the comparing step to a user and facilitating access to at least one page upon which the handwritten annotations appear.

2. The method as claimed in claim 1, wherein an interactive page identified in the results of the search is displayed to a user on a display device.

3. The method as claimed in claim 1, wherein the handwritten annotations are one or more of handwriting, symbols, drawings, and indicia.

4. The method as claimed in claim 1, wherein the input device is an imaging pen.

5. The method as claimed in claim 1, wherein the handwritten search query is one of a hand-drawn loop, underline, squiggle, cross, circumflex, and asterisk, associated with the text string.

6. The method as claimed in claim 4, wherein the comparing step comprises the sub-steps of:

segmenting the handwritten annotations in the at least one database into segmented strokes and mapping the segmented strokes into a first sequence of feature representations;

segmenting the handwritten search query into segmented strokes and mapping the segmented strokes into a second sequence of feature representations;

performing an edit distance calculation between the first sequence of feature representations and the second sequence of feature representations; and

,

determining matches between the handwritten annotations in the at least one database and the handwritten search query by locating the smallest values from the edit distance calculation.

7. The method as claimed in claim 6, wherein the edit distance calculation uses sub-stroke insertion, sub-stroke deletion and/or sub-stroke substitution.

8. The method as claimed in claim 6, wherein segmentation at the vertical-axis (Y) extrema coordinates of strokes is utilized.

9. The method as claimed in claim 6, wherein the mapping of the segmented strokes into the feature representations uses a zone-normalized coordinate method.

10. The method as claimed in claim 6, wherein a weighting factor is applied to the vertical-axis (Y) coordinates of the feature representations.

11. The method as claimed in claim 6, wherein the segmented strokes undergo vector quantization and the edit distance calculation is replaced by a look-up table of codeword distances.

12. The method as claimed in claim 6, wherein the method uses full stroke matching of the search query.

13. The method as claimed in claim 1, wherein the at least one database is a digital image database containing one or more of pictures, drawings, images, and figures.