Method and system for implementing a user interface for a device through recognized text and bounded areas

• US 20060066591A1
• Filed: 01/12/2005
• Published: 03/30/2006
• Est. Priority Date: 03/17/2004
• Status: Abandoned Application

• Current Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Original Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Inventors: Marggraff, James, Edgecomb, Tracy L., Chisholm, Alexander
• Application Number:
  US11/035,155
• Publication Number:
  US 20060066591A1
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method and system for implementing a user interface for a pen device through recognized text and bounded areas. The method includes recognizing a text string and accessing a function or application related to the text string upon the recognition. An output is provided in accordance with the function and the function is associated with the text string. Alternatively, selection of the text string automatically applies the recognized result of the text string to a currently active application. The method includes recognizing an actuation within a bounded area and automatically accessing a function related to the bounded area upon the actuation. A text string recognized within a bounded area produces an output in accordance with the text string and the bounded area.

Claims

1. A method of interpreting user commands, comprising:

recognizing an actuation of a pen device within a bounded area of a writable surface;

accessing a function of the pen device related to the bounded area upon the actuation;

providing an output in accordance with the function; and

associating the function with the bounded area.

2. The method of claim 1, wherein the output comprises an audio output related to the function.

3. The method of claim 1, further comprising:

enabling a subsequent access of the function by storing the association of the function with the bounded area.

4. The method of claim 3, wherein the storing of the association of the function with the bounded area implements a persistent availability of the function for a predetermined amount of time via interaction of the pen device with the bounded area.

5. The method of claim 1, wherein the bounded area is user drawn with the pen device on the surface.

6. The method of claim 5, wherein the surface comprises a sheet of paper.

7. The method of claim 1, further comprising:

determining the function related to the bounded area by the first selecting one of a plurality of options of a graphic element icon on the surface.

8. The method of claim 7, further comprising:

prompting the creation of the bounded area in accordance with the selection of the one of the plurality of options.

9. The method of claim 1, wherein the bounded area is a preprinted bounded area and the function related to the bounded area is predetermined.

10. The method of claim 1, further comprising:

wherein the actuation comprises user written text within the bounded area and further comprising automatically recognizing the user written text as a particular word.

11. The method of claim 10, wherein said providing an output comprises:

automatically applying the particular word to the function related to the bounded area to generate a result thereof.

12. The method of claim 11 wherein the result is audibly rendered.

13. The method of claim 1, further comprising:

enabling a subsequent access of a plurality of functions for a corresponding plurality of bounded areas by respectively storing the association of the plurality of functions with the plurality of bounded areas.

14. A method of interpreting user commands, comprising:

recognizing a text string on a writable surface;

accessing a function of a pen device related to the text string upon the recognition;

providing an output in accordance with the function; and

associating the function with the text string.

15. The method of claim 14, wherein the output comprises an audio output related to the function.

16. The method of claim 14, further comprising:

enabling a subsequent access of the function by storing the association of the function with the text string.

17. The method of claim 16, wherein the storing of the association of the function with the text string implements a persistent availability of the function for a predetermined amount of time via interaction of the text string with the pen device.

18. The method of claim 14, wherein the text string is user drawn with the pen device on the writing surface.

19. The method of claim 18, wherein the writing surface comprises a sheet of paper.

20. The method of claim 14, further comprising:

determining the function related to the text string by selecting one of a plurality of options of a graphic element icon.

21. The method of claim 19, further comprising:

prompting the creation of the text string in accordance with the selection of the one of the plurality of options.

22. The method of claim 14, wherein the text string is recognized within a preprinted bounded area having a function that is related to the bounded area and is predetermined.

23. The method of claim 14, further comprising:

selecting the function related to the text string input within the bounded area in accordance with the function related to the bounded area.

24. The method of claim 14, further comprising:

selecting one of a plurality of functions for use with the text string by selecting one of a plurality of options of a graphic element icon.

25. A method of claim 14 further comprising:

recognizing selection of said text string by said pen device;

accessing said function related to said text string; and

providing said output in accordance with said function.

26. A method of interpreting user commands comprising:

recognizing a user written text string as a particular word wherein said user written text string is written on a writable surface using a pen device;

applying said particular word to a first application to generate a first result thereof, wherein said first application is one of a plurality of applications that are operable to be executed on said pen device; and

audibly rendering said result using said pen device.

27. A method as described in claim 26 further comprising:

recognizing that a second application is selected in response to said pen device interacting with an image on said writable surface;

recognizing that said user written text string is selected in response to said pen device interacting therewith;

automatically applying said particular word to said second application to generate a second result thereof; and

audibly rendering said second result using said pen device.

28. A device comprising:

an optical sensor for detecting images from a writable surface;

a processor coupled to the sensor; and

a memory coupled to said processor, the memory storing instructions that when executed cause the processor to implement a method of interpreting user commands, comprising;

recognizing a created graphic element icon on the surface;

accessing a function related to the graphic element icon;

recognizing a user written text string as a particular word;

providing an output in accordance with the particular word and in accordance with the function; and

associating the function with the user written text string.

29. The method of claim 28, wherein the output comprises an audio output related to the function and related to the user written text string.

30. The method of claim 28, further comprising:

enabling a subsequent access of the function by storing the association of the function with the user written text string.

31. The method of claim 30, wherein the storing of the association of the function with the user written text string implements a persistent availability of the function for a predetermined amount of time via interaction with the text string using the pen device.

32. The method of claim 28, wherein the user written text string is created with the pen device on the surface.

33. The method of claim 32, wherein the surface comprises a sheet of paper.

34. The method of claim 28, further comprising:

determining the function related to the text string by selecting one of a plurality of options of the graphic element icon.

35. The method of claim 28, further comprising:

prompting the creation of the text string in accordance with the function.

36. The method of claim 28, further comprising:

prompting the creation of a bounded area in accordance with the function; and

prompting the creation of the text string within the bounded area to implement the function.

37. The method of claim 36, further comprising:

selecting the function related to the text string input within the bounded area in accordance with the function related to the bounded area.

38. The method of claim 28, further comprising:

selecting one of a plurality of functions for use with the text string by selecting one of a plurality of options of a graphic element icon.

39. A pen device comprising:

an optical sensor for sensing images on a writable surface;

a writing instrument;

a processor coupled to a bus;

a speaker;

a memory coupled to said bus and comprising instructions that when executed implement a method of interpreting user commands comprising;

recognizing a user written text string as a particular word wherein said user written text string is written on said writable surface using said writing instrument;

applying said particular word to a first application to generate a first result thereof, wherein said first application is one of a plurality of applications that are operable to be executed on said pen device; and

audibly rendering said result using said speaker.

40. A device as described in claim 39 wherein said method further comprises:

recognizing that a second application is selected in response to said pen device interacting with an image on said writable surface;

recognizing that said user written text string is selected in response to said pen device interacting therewith;

automatically applying said particular word to said second application to generate a second result thereof; and

audibly rendering said second result using said speaker.

41. A pen device comprising:

an optical sensor for sensing images on a writable surface;

a writing instrument;

a processor coupled to a bus;

a speaker;

a memory coupled to said bus and comprising instructions that when executed implement a method of interpreting user commands comprising;

defining a first bounded area of said writable surface to a first application;

defining a second bounded area of said writable surface to a second application, wherein said first and second applications are operable to be executed on said pen device;

in response to a first user-written data in said first bounded area, recognizing said first user-written data as a first expression and automatically applying said first expression to said first application to generate a first result thereof; and

audibly rendering said first result using said speaker.

42. A pen device as described in claim 41 wherein said method further comprises:

in response to a second user-written data in said second bounded area, recognizing said second user-written data as a second expression and automatically applying said second expression to said second application to generate a second result thereof; and

audibly rendering said second result using said speaker.

43. A pen device as described in claim 41 wherein said defining said first bounded area to said first application comprises:

recognizing that said first application is selected in response to said pen device interacting with an image on said writable surface;

prompting the drawing of said first bounded area on said surface using said speaker;

defining said first bounded area in response to the drawing thereof using said pen device; and

associating said first bounded area with said first application.

44. A pen device as described in claim 43 wherein said defining said second bounded area to said second application comprises:

recognizing that said second application is selected in response to said pen device interacting with an image on said writable surface;

prompting the drawing of said second bounded area on said surface using said speaker;

defining said second bounded area in response to the drawing thereof using said pen device; and

associating said second bounded area with said second application.

45. A method of accepting input from a user, comprising:

recognizing an actuation of a pen device within a bounded area of a writable surface;

accessing a function of the pen device related to the bounded area upon the actuation;

providing an output in accordance with the function; and

associating the function with the bounded area.

46. The method of claim 45, wherein the output comprises an audio output related to the function.

47. The method of claim 46, wherein the audio output is provided via a pen device.

48. The method of claim 47, wherein the audio output is provided via a second device in communication with the pen device.

49. The method of claim 45, wherein the output comprises a visual output related to the function.

50. The method of claim 49, wherein the visual output is provided via a pen device.

51. The method of claim 50, wherein the visual output is provided via a second device in communication with the pen device.