Method and device for audibly instructing a user to interact with a function

• US 7,853,193 B2
• Filed: 11/01/2005
• Issued: 12/14/2010
• Est. Priority Date: 03/17/2004
• Status: Active Grant

• Current Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Original Assignee: LeapFrog Enterprises, Inc. (VTech Holdings Ltd.)
• Inventors: Marggraff, James
• Primary Examiner(s): Saadat; Cameron
• Application Number:
  US11/264,955
• Publication Number:
  US 20060080609A1
• Time in Patent Office: 1,869 Days
• Field of Search: 434/155, 434/317, 345/179, 715/863, 382/188
• US Class Current: 434/317
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06V 10/19 by sensing codes defining pattern positions
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

A method for audibly instructing a user to interact with a function. A function is associated with a user-written selectable item. The user-written selectable item is recognized on a surface. In response to recognizing the user-written selectable item, a first instructional message related to the operation of the function is audibly rendered without requiring further interaction from the user.

Claims

1. A method for audibly instructing a user to interact with a function, said method comprising:

associating a function with a user-written selectable item;

at a pen computer, recognizing said user-written selectable item on a surface, subsequent to writing said user-written selectable item, by determining that said pen computer is disposed on said user-written selectable item; and

in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user,

wherein said audibly rendering said first instructional message is performed by an audio output device of said pen computer.

2. The method as recited in claim 1 wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function.

3. The method as recited in claim 2 further comprising:

determining whether said user interface element has been properly drawn on said surface; and

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element.

4. The method as recited in claim 3 further comprising, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

5. The method as recited in claim 3 further comprising, provided said user interface element has been properly drawn, executing said function.

6. The method as recited in claim 2 further comprising:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message; and

provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

7. The method as recited in claim 1 further comprising, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

8. The method as recited in claim 1 further comprising executing said function prior to audibly rendering said first instructional message.

9. The method as recited in claim 1 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

10. The method as recited in claim 1 wherein said recognizing said user-written selectable item comprises:

optically recording positions of the tip of a pen computer; and

performing image recognition of said positions to recognize said user-written selectable item.

11. A computer-usable medium having computer-readable program code embodied therein for causing a computer system to perform a method for audibly instructing a user to interact with a function, said method comprising:

associating a function with a user-written selectable item;

at a pen computer, recognizing said user-written selectable item on a surface; and

in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user,

wherein said audibly rendering said first instructional message is performed by an audio output device of said pen computer.

12. The computer-usable medium as recited in claim 11 wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function.

13. The computer-usable medium as recited in claim 12, wherein said method further comprises:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message; and

provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

14. The computer-usable medium as recited in claim 12, wherein said method further comprises:

determining whether said user interface element has been properly drawn on said surface; and

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element.

15. The computer-usable medium as recited in claim 14, wherein said method further comprises, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

16. The computer-usable medium as recited in claim 14, wherein said method further comprises, provided said user interface element has been properly drawn, executing said function.

17. The computer-usable medium as recited in claim 11 wherein said method further comprises, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

18. The computer-usable medium as recited in claim 11 wherein said method further comprises executing said function prior to audibly rendering said first instructional message.

19. The computer-usable medium as recited in claim 11 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

20. The computer-usable medium as recited in claim 11 wherein said recognizing said user-written selectable item comprises:

optically recording positions of the tip of a pen computer; and

performing image recognition of said positions to recognize said user-written selectable item.

21. An interactive device comprising:

a bus;

an audio output device coupled to said bus;

a writing element for allowing a user to write on a writable surface;

an optical detector coupled to said bus for detecting positions of said writing element with respect to said writable surface;

a processor coupled to said bus; and

a memory unit coupled to said bus, said memory storing instructions that when executed cause said processor to implement a method for audibly instructing a user to interact with a function, said method comprising;

associating a function with a user-written selectable item;

recognizing said user-written selectable item on said writable surface;

and in response to said recognizing said user-written selectable item, audibly rendering a first instructional message related to the operation of said function without requiring further interaction from said user, wherein said first instructional message directs said user to draw at least one user interface element that enables said user to interface with said function;

determining whether said user interface element has been properly drawn on said surface;

provided said user interface element has not been properly drawn on said surface, audibly rendering a second instructional message comprising a hint about a manner in which said user should properly draw said user interface element; and

provided said user interface element has been properly drawn, executing said function.

22. The interactive device as recited in claim 21 wherein said method further comprises:

determining whether a writing has been drawn on said surface within a predetermined time period since said audibly rendering said first instructional message;

and provided no writing has been drawn on said surface within said predetermined time period, repeating said first instructional message.

23. The interactive device as recited in claim 21 wherein said method further comprises, provided said user interface element has been properly drawn, audibly rendering a third instructional message.

24. The interactive device as recited in claim 21 wherein said method further comprises, in response to a user interaction with said user-written selectable item, repeating said first instructional message.

25. The interactive device as recited in claim 21 wherein said method further comprises executing said function prior to audibly rendering said first instructional message.

26. The interactive device as recited in claim 21 wherein said recognizing said user-written selectable item is performed in response to detecting a termination event indicating that said user-written selectable item is complete.

27. The interactive device as recited in claim 21 wherein said recognizing said user-written selectable item comprises:

optically recording positions of a tip of said interactive device on said writable surface using optical detector; and

performing image recognition of said positions to recognize said user-written selectable item.

28. The interactive device as recited in claim 21 wherein said audibly rendering said first instructional message is performed by said audio output device.