Method and device for audibly instructing a user to interact with a function

• US 20060080609A1
• Filed: 11/01/2005
• Published: 04/13/2006
• Est. Priority Date: 03/17/2004
• Status: Active Grant

• Current Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Original Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Inventors: Marggraff, James
• Granted Patent: US 7,853,193 B2
• Time in Patent Office: Days
• US Class Current: 715/727
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06V 10/19 by sensing codes defining pattern positions
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

A method for audibly instructing a user to interact with a function. A function is associated with a user-written selectable item. The user-written selectable item is recognized on a surface. In response to recognizing the user-written selectable item, a first instructional message related to the operation of the function is audibly rendered without requiring further interaction from the user.

Claims

1. A method for audibly instructing a user to interact with a function, said method comprising:

associating a function with a user-written selectable item;

recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user.

2. The method as recited in claim 1 wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function.

3. The method as recited in claim 2 further comprising:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message; and

provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

4. The method as recited in claim 2 further comprising:

determining whether said user interface element has been properly drawn on said surface; and

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element.

5. The method as recited in claim 4 further comprising, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

6. The method as recited in claim 4 further comprising, provided said user interface element has been properly drawn, executing said function.

7. The method as recited in claim 1 further comprising, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

8. The method as recited in claim 1 further comprising executing said function prior to audibly rendering said first instructional message.

9. The method as recited in claim 1 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

10. The method as recited in claim 1 wherein said recognizing said user-written selectable item comprises:

optically recording positions of the tip of a pen computer; and

performing image recognition of said positions to recognize said user-written selectable item.

11. The method as recited in claim 1 wherein said audibly rendering said first instructional message is performed by an audio output device of a pen computer.

12. A method for automatically executing a function, said method comprising:

associating a function with a user-written selectable item;

recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, immediately executing said function without first requiring further interaction between a user and said surface.

13. The method as recited in claim 12 further comprising audibly rendering an instructional message related to the operation of said function without first requiring further interaction between said user and said surface.

14. The method as recited in claim 13 wherein said audibly rendering said instructional message is performed in response to the lapsing of a predetermined time period without user interaction with said surface.

15. The method as recited in claim 12 further comprising, in response to a user interaction with said user-written selectable item, re-executing said function.

16. The method as recited in claim 12 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

17. The method as recited in claim 12 wherein said immediately executing said function without first requiring further interaction between a user and said surface comprises immediately executing said function without first requiring auxiliary writing by said user on said surface.

18. A computer-usable medium having computer-readable program code embodied therein for causing a computer system to perform a method for audibly instructing a user to interact with a function, said method comprising:

associating a function with a user-written selectable item;

recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user.

19. The computer-usable medium as recited in claim 18 wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function.

20. The computer-usable medium as recited in claim 19, wherein said method further comprises:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message; and

provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

21. The computer-usable medium as recited in claim 19, wherein said method further comprises:

determining whether said user interface element has been properly drawn on said surface; and

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element.

22. The computer-usable medium as recited in claim 21, wherein said method further comprises, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

23. The computer-usable medium as recited in claim 21, wherein said method further comprises, provided said user interface element has been properly drawn, executing said function.

24. The computer-usable medium as recited in claim 18, wherein said method further comprises, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

25. The computer-usable medium as recited in claim 18, wherein said method further comprises executing said function prior to audibly rendering said first instructional message.

26. The computer-usable medium as recited in claim 18 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

27. The computer-usable medium as recited in claim 18 wherein said recognizing said user-written selectable item comprises:

optically recording positions of the tip of a pen computer; and

performing image recognition of said positions to recognize said user-written selectable item.

28. The computer-usable medium as recited in claim 18 wherein said audibly rendering said first instructional message is performed by an audio output device of a pen computer.

29. A computer-usable medium having computer-readable program code embodied therein for causing a computer system to perform a method for automatically executing a function, said method comprising:

associating a function with a user-written selectable item;

recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, immediately executing said function without first requiring further interaction between a user and said surface.

30. The computer-usable medium as recited in claim 29, wherein said method further comprises audibly rendering an instructional message related to the operation of said function without first requiring further interaction between a user and said surface.

31. The computer-usable medium as recited in claim 30 wherein said audibly rendering said instructional message is performed in response to the lapsing of a predetermined time period without user interaction with said surface.

32. The computer-usable medium as recited in claim 29, wherein said method further comprises, in response to a user interaction with said user-written selectable item, executing said function.

33. The computer-usable medium as recited in claim 29 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

34. The computer-usable medium as recited in claim 29 wherein said immediately executing said function without first requiring further interaction between a user and said surface comprises immediately executing said function without first requiring auxiliary writing by said user on said surface.

35. An interactive device comprising:

a bus;

an audio output device coupled to said bus;

a writing element for allowing a user to write on a writable surface;

an optical detector coupled to said bus for detecting positions of said writing element with respect to said writable surface;

a processor coupled to said bus; and

a memory unit coupled to said bus, said memory storing instructions that when executed cause said processor to implement a method for audibly instructing a user to interact with a function, said method comprising;

associating a function with a user-written selectable item;

recognizing said user-written selectable item on said writable surface; and

in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user.

36. The interactive device as recited in claim 35 wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function.

37. The interactive device as recited in claim 36 wherein said method further comprises:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message; and

provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

38. The interactive device as recited in claim 36, wherein said method further comprises:

determining whether said user interface element has been properly drawn on said surface; and

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element.

39. The interactive device as recited in claim 38, wherein said method further comprises, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

40. The interactive device as recited in claim 38, wherein said method further comprises, provided said user interface element has been properly drawn, executing said function.

41. The interactive device as recited in claim 35, wherein said method further comprises, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

42. The interactive device as recited in claim 35, wherein said method further comprises executing said function prior to audibly rendering said first instructional message.

43. The interactive device as recited in claim 35 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

44. The interactive device as recited in claim 35 wherein said recognizing said user-written selectable item comprises:

optically recording positions of a tip of said interactive device on said writable surface using said optical detector; and

performing image recognition of said positions to recognize said user-written selectable item.

45. The interactive device as recited in claim 35 wherein said audibly rendering said first instructional message is performed by said audio output device.

46. An interactive device comprising:

a bus;

an audio output device coupled to said bus;

a writing element for allowing a user to create a user-written selectable item on a writable surface;

an optical detector coupled to said bus for detecting information on said writable surface;

a processor coupled to said bus;

a memory unit coupled to said bus, said memory storing instructions that when executed cause said processor to implement a method for automatically executing a function, said method comprising;

associating a function with a user-written selectable item;

recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, immediately executing said function without first requiring further interaction between a user and said surface.

47. The interactive device as recited in claim 46, wherein said method further comprises audibly rendering an instructional message related to the operation of said function without first requiring further interaction between a user and said surface.

48. The interactive device as recited in claim 47 wherein said audibly rendering said instructional message is performed in response to the lapsing of a predetermined time period without user interaction with said surface.

49. The interactive device as recited in claim 46, wherein said method further comprises, in response to a user interaction with said user-written selectable item, executing said function.

50. The interactive device as recited in claim 46 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

51. The interactive device as recited in claim 46 wherein said immediately executing said function without first requiring further interaction between a user and said surface comprises immediately executing said function without first requiring auxiliary writing by said user on said surface.