Method of providing information via a printed substrate and two-mode sensing device

• US 7,821,507 B2
• Filed: 02/08/2007
• Issued: 10/26/2010
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Hollins, Michael, Newman, Andrew Timothy Robert, Lapstun, Paul, Dehghani, Zhamak, Silverbrook, Kia
• Primary Examiner(s): Colbert, Ella
• Application Number:
  US11/672,950
• Publication Number:
  US 20070146322A1
• Time in Patent Office: 1,356 Days
• Field of Search: 345/179, 235/375, 235/454, 235/462.46, 235/380, 382/187, 382/188, 358/1.1, 358/1.15, 715/201, 707/1, 707/3, 707/5
• US Class Current: 345/179
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06V 10/26 Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A method of enabling a user to initiate an action via a printed substrate, said substrate comprising user information and coded data, said coded data being indicative of a region identity associated with the substrate and of a plurality of locations on the substrate, said method comprising the steps of: receiving, in a computer system and from a sensing device, mode data and interaction data, the sensing device being operable in a plurality of modes and the mode data being indicative of one of said modes, the interaction data being indicative of the region identity and at least one position of the sensing device relative to the substrate, the sensing device generating the interaction data, when operatively positioned or moved relative to the substrate, by reading at least some of the coded data; identifying and retrieving at least part of a page description corresponding to the printed substrate using the region identity; determining a mode of the sensing device using the mode data; identifying an action using said mode, said interaction data and said page description; and initiating said action.

Claims

1. A method of enabling a user to initiate an action via a printed substrate, said substrate comprising user information and coded data, said coded data being indicative of a region identity associated with the substrate and of a plurality of locations on the substrate, said method comprising the steps of:

receiving, in a computer system and from an optically imaging pen, mode data and interaction data, the pen being operable in a plurality of modes and the mode data being indicative of one of said modes, the interaction data being indicative of the region identity and at least one position of the pen relative to the substrate, the pen generating the interaction data, when operatively positioned or moved relative to the substrate, by reading at least some of the coded data;

identifying and retrieving at least part of a page description corresponding to the printed substrate using the region identity;

determining a mode of the pen using the mode data; and

initiating an action using said mode, said interaction data and said page description,

wherein;

said mode is selected from the group consisting of;

a hyperlinking mode;

a searching mode;

a content-extraction mode;

a mouse mode; and

a handwriting mode;

said pen in operable in two or more of said modes; and

said action is selected from the group consisting of;

hyperlinking, searching, content-extraction, cursor control and handwriting input.

2. The method of claim 1, comprising the steps of:

determining the pen to be in a hyperlinking mode;

determining, using the page description and the position of the pen, whether the pen is positioned within a zone of a hyperlink on the substrate; and

sending a hyperlink Uniform Resource Identifier (URI) or a hyperlinked resource to the user only if the pen is positioned within said zone.

3. The method of claim 2, wherein the hyperlink URI is sent to the user'"'"'s web terminal in which user'"'"'s web terminal can retrieve a corresponding hyperlinked resource via the internet.

4. The method of claim 1, comprising the steps of:

determining the pen to be in a searching mode;

generating a query expression comprising one or more search terms, at least one of said search terms being identified using the page description and the at least one position of the pen;

forming a request using the query expression; and

sending the request, or a results resource including search results obtained using the request, to the user.

5. The method of claim 4, wherein the request is sent as a request URI to a user'"'"'s web terminal in which user'"'"'s web terminal can retrieve a corresponding hyperlinked resource via the internet.

6. The method of claim 4, wherein the at least one search term is associated, in the page description, with a zone of the substrate containing the position of the pen.

7. The method of claim 6, wherein at least one search term is a keyword extracted from text in the zone.

8. The method of claim 6, wherein the at least one search term is a primary search term and at least one of the other search terms of the query expression is a context search term, said context search term being derived from a word, phrase, line, sentence, paragraph, section, article, document or region containing the zone.

9. The method of claim 8, wherein said context search term is contained in or associated with a word, phrase, line, sentence, paragraph, section, article, document or region containing the zone.

10. The method of claim 4, wherein at least one of said search terms identifies a concept, a person, an organization, a place, a product, a publication, a weather condition, a geographic location, a date, a time of day, a day of the week, a current user location, a user home location, a user demographic indicator, a user preference, a search history, a click-through history, a user interest or a user language.

11. The method of claim 4, wherein at least one of said search terms is derived from a resource description, a subject description, a user description or an environment description.

12. The method of claim 4, wherein the query expression is generated by combining the search terms using operators selected from the group comprising:

Boolean operators, proximity constraint operators and occurrence constraint operators.

13. The method of claim 1, comprising the steps of:

determining the pen to be in content-extraction mode;

identifying content using the page description and the at least one position of the pen; and

extracting the content from the page description.

14. The method of claim 13, further comprising the step of:

sending the content to the user.

15. The method of claim 1, comprising the steps of:

determining the pen to be in a handwriting mode;

associating said at least one position, as digital ink, with a corresponding part of the page description.

16. The method of claim 15, wherein said part of said page description describes a field of a form, and said method further comprises interpreting said digital ink as input into said field.

17. The method of claim 1, comprising the steps of:

determining the pen to be in a mouse mode;

interpreting said at least one position as a cursor position in a graphical user interface.

18. The method of claim 17, wherein said at least one position is interpreted as a relative or absolute cursor position.

20. The method of claim 1, wherein said pen comprises a marking nib or a non-marking stylus.

19. A system for enabling a user to initiate an action via a printed substrate, said substrate comprising user information and coded data, said coded data being indicative of a region identity associated with the substrate and of a plurality of locations on the substrate, said system comprising a computer system configured for:

receiving mode data and interaction data from an optically imaging pen, the pen being operable in a plurality of modes and the mode data being indicative of one of said modes, the indicating data being indicative of the region identity and at least one position of the pen relative to the substrate, the pen generating the interaction data, when operatively positioned or moved relative to the substrate, by reading at least some of the coded data;

identifying and retrieving at least part of a page description corresponding to the printed substrate using the region identity;

determining a mode of the pen using the mode data; and

initiating an action using said mode, said interaction data and said page description,

wherein;

said mode is selected from the group consisting of;

a hyperlinking mode;

a searching mode;

a content-extraction mode;

a mouse mode; and

a handwriting mode;

said pen in operable in two or more of said modes; and

said action is selected from the group consisting of;

hyperlinking, searching, content-extraction, cursor control and handwriting input.