Dynamic creation of selectable items on surfaces

• US 6,476,834 B1
• Filed: 05/28/1999
• Issued: 11/05/2002
• Est. Priority Date: 05/28/1999
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ocheltree, Kenneth Blair, Doval, Diego, Kwok, Thomas Yu-Kiu, Pickover, Clifford Alan, Russell, Gregory Fraser
• Primary Examiner(s): SAX, STEVEN PAUL
• Application Number:
  US09/322,387
• Time in Patent Office: 1,257 Days
• Field of Search: 345/863, 345/825-826, 345/744-747, 345/864, 345/762-763, 345/816, 345/838, 345/839, 345/840, 345/728-729, 345/702, 345/707-708, 345/711, 345/183, 382/189
• US Class Current: 715/863
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

Using a writing surface, such as paper on a portable digital notebooks (PDNs) or the surface of a digital white board, users draw, on the fly, selectable items such as buttons with text inside. The user could even draw symbols, on the fly, in the air with his/her finger. The user then selects the drawn selectable item to initiate a function.

Claims

1. A method of directing a computer system to perform a specified function, said method comprising:

dynamically customizing at least one hand drawn symbol, each symbol to be correlated to a selected function from a set of functions;

graphically connecting each said selected function to each said at least one hand drawn customized symbol for later selection;

dynamically drawing at least one symbol representing at least one function, said drawing comprising providing positional input to an input device having position sensing software; and

analyzing positional input to recognize the at least one symbol and to correlate the recognized at least one symbol to at least one function, thereby selecting said at least one symbol to perform said at least one function.

2. A method as recited in claim 1, wherein said symbol is a geometric shape.

3. A method as recited in claim 1, wherein said symbol is a geometric shape with text therein.

4. A method as recited in claim 3, wherein said symbol and said text therein are recognized by handwriting recognition software.

5. A method as recited in claim 1, wherein said symbol is a geometric shape with a figure therein.

6. A method as recited in claim 1, wherein said symbol comprises text.

7. A method as recited in claim 1, wherein said symbol comprises a geometric shape with other symbols therein, wherein each of said other symbols is assigned a function, and wherein said computer system performs all functions assigned to said other symbols when said symbol is selected.

8. A method as recited in claim 1, wherein the assignment of a function to said symbol depends upon the shape of and the text inside of said geometric shape of said symbol.

9. A method as recited in claim 1, further comprising the step of providing feedback upon selection of symbol to indicate that a corresponding function is about to be performed.

10. A method as recited in claim 1, wherein said input device is additionally associated with speech recognition software and wherein said symbol is selected by saying a specific word recognized by said speech recognition software.

11. A method as recited in claim 1, wherein said symbol is selected by a gesture detected by said computer system.

12. A method as recited in claim 1, wherein said symbol is selected by touching said symbol.

13. A method as recited in claim 1, wherein a function assigned to said symbol depends upon the position of said symbol on a surface.

14. A method as recited in claim 1, wherein said symbol is drawn by moving an object or finger in any space.

15. A method as recited in claim 1, wherein a function assigned to said symbol depends on the position of said symbol in any space.

16. A method as recited in claim 1, wherein said symbol is selected by having another symbol near former said symbol.

17. A method as recited in claim 1, wherein said symbol represents a function of an attribute when said symbol is drawn near another symbol representing said attribute.

18. A method as recited in claim 1, wherein said symbol represents a function of an attribute when said symbol is drawn with another symbol which represents an association of former said symbol with said attribute.

19. In a computer system having a digitizing surface, a method of performing selected functions comprising:

dynamically customizing at least one hand drawn symbol, each symbol to be correlated to a selected function from a set of functions;

graphically connecting each said selected function to each of said at least one hand drawn customized symbol for later selection;

dynamically drawing at least one symbol corresponding to at least one of said selected functions on said surface, said drawing comprising providing positional input to said surface having position sensing software;

analyzing said positional input to recognize said at least one symbol;

correlating said recognized at least one symbol to at least one of said functions; and

performing said at least one selected function when said at least one symbol is selected.

20. A method as recited in claim 19, wherein said symbol is a geometric shape.

21. A method as recited in claim 19, wherein said symbol is a geometric shape with text therein.

22. A method as recited in claim 19, wherein said symbol is a geometric shape with a figure therein.

23. A method as recited in claim 19, wherein said symbol comprises text.

24. A method as recited in claim 19, wherein said symbol comprises a geometric shape with other symbols therein, wherein each of said other symbols is assigned a function, and wherein said computer system performs all functions assigned to said other symbols when said symbol is selected.

25. A method as recited in claim 19, wherein said correlation of at least one function to said symbol depends upon the shape of and the text inside of said geometric shape of said symbol.

26. A method as recited in claim 25, wherein said symbol and said text therein are recognized by handwriting recognition software.

27. A method as recited in claim 19, further comprising the step of providing feedback upon selection of a symbol to indicate at least one corresponding function is about to be performed.

28. A method as recited in claim 19, wherein said computer system surface is additionally associated with speech recognition software and wherein said symbol is selected by saying a specific word recognized by said speech recognition software.

29. A method as recited in claim 19, wherein said symbol is selected by a gesture detected by said computer system.

30. A method as recited in claim 19, wherein said symbol is selected by touching said symbol.

31. A method as recited in claim 19, wherein a function assigned to said symbol depends upon the position of said symbol on a surface.

32. A method as recited in claim 19, wherein said symbol is selected by having another symbol near former said symbol.

33. A method as recited in claim 19, wherein said symbol represents a function of an attribute when said symbol is drawn near another symbol representing said attribute.

34. A method as recited in claim 19, wherein said symbol represents a function of an attribute when said symbol is drawn with another symbol which represents an association of former said symbol with said attribute.

35. A computer system comprising:

a digital electronic surface;

a stylus for transmitting a signal to said surface wherein said signal represents the movements of said stylus on said surface;

at least one processor for performing the steps of;

receiving said signals to determine the movements of said stylus to customize at least one hand drawn symbol drawn on said surface by said stylus, each of said at least one symbol to be correlated to a selected function from a set of functions;

graphically connecting each said selected function to each of said at least one hand drawn customized symbol for later selected;

receiving signals to determine the movements of said stylus to determine the dynamic drawing of at least one symbol corresponding to at least one of said selected functions on said surface;

analyzing said movements to recognize said at least one symbol;

correlating said recognized at least one symbol to at least one of said functions; and

performing said at least one selected function assigned to said at least one symbol.

36. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for;

dynamically customizing a hand drawn symbol to be correlated to a selected function from a set of functions;

graphically connecting said selected function to said customized symbol for later selection;

detecting dynamic input comprising drawing a symbol representing a function, said drawing comprising providing positional input to an input device having position sensing software; and

analyzing positional input to recognize the at least one symbol and to correlate the recognized at least one symbol to at least one function, thereby selecting said at least one symbol to perform said at least one function.

37. A computer system comprising:

an electronic device for sensing positional input to said computer system;

at least one processor for performing the steps of;

receiving said signals to determine the positional input for dynamically customizing at least one hand drawn symbol, each of said at least one symbol to be correlated to a selected function from a set of functions;

graphically connecting each said selected function to each of said at least one hand drawn customized symbol for later selected;

receiving signals to determine the positional input to determine the dynamic drawing of at least one symbol corresponding to at least one of said selected functions on said surface;

analyzing said movements to recognize said at least one symbol;

correlating said recognized at least one symbol to at least one of said functions; and

performing said at least one selected function assigned to said at least one symbol.