System and method for preview and selection of words

• US 20080270896A1
• Filed: 04/27/2007
• Published: 10/30/2008
• Est. Priority Date: 04/27/2007
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Shapewriter Inc.
• Inventors: Kristensson, Per Ola
• Granted Patent: US 7,895,518 B2
• Time in Patent Office: Days
• US Class Current: 715/261
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs

Abstract

A system, method and computer-readable medium that previews words and commands recognized by a continuous stroke recognizer based on input into a virtual keyboard layout is presented. The system and method allows a user to see the word that will be recognized or output before the user commits the continuous stroke input to the system. Further, after recognition and output, the system presents the recognized output word and the closest word candidates in a correction display integrated with the virtual keyboard layout. Among other things, the user is provided with options to change the current output word by selecting another word candidate on the correction display, and to delete the current output word by selecting the representation of the current output word on the correction display.

Claims

4-1. The system of claim 54 wherein said display is integrated with said virtual keyboard.

20. A method of displaying a list of candidate words in a continuous stroke system having a virtual keyboard with an integrated correction display, comprising:

receiving a continuous stroke which has been input into a virtual keyboard;

comparing said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

generating a plurality of known words which correspond to said continuous stroke; and

displaying said plurality of known words on said correction display integrated with said virtual keyboard.

21. The method of claim 20 wherein said continuous stroke system is associated with an active application, further comprising:

outputting to said associated active application a best matching known word.

22. The method of claim 21, further comprising:

deleting said best matching known word from said associated active application if said best matching known word is selected on said correction display.

23. The method of claim 21, further comprising:

deleting said best matching known word from said correction display if said best matching known word is selected on said correction display.

24. The method of claim 21 wherein said associated active application is a word processor, an e-mail client, instant messaging client or forms application

25. The method of claim 20 wherein said correction display is adjacent to the keys of said virtual keyboard.

26. The method of claim 20, further comprising:

displaying a best matching known word with a distinct graphical attribute.

27. The method of claim 26 wherein said distinct graphical attribute is an alternate color.

28. The method of claim 26 wherein said distinct graphical attribute is an associated icon.

29. The method of claim 20, further comprising:

providing a computer, PDA, cellular phone, smartphone, tablet PC or mobile communications device having a virtual keyboard.

30. The method of claim 20, further comprising:

providing a projection device for projecting said virtual keyboard on a wall, screen or display;

wherein said continuous stroke is input via the projected representation of said virtual keyboard.

31. A computer-readable medium having computer-executable instructions for displaying a word preview in a continuous stroke system, comprising:

instructions for receiving a first part of a continuous stroke which has been input into a virtual keyboard;

instructions for comparing said first part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

instructions for generating a preview of known words which correspond to said first part of said continuous stroke; and

instructions for displaying said preview on a display prior to completion of said continuous stroke.

32. The computer-readable medium of claim 31, further comprising:

instructions for receiving a second part of said continuous stroke;

instructions for comparing said first part and said second part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

instructions for displaying a preview of known words which correspond to said first part and said second part of said continuous stroke; and

instructions for displaying said preview on said display prior to completion of said continuous stroke.

33. The computer-readable medium of claim 31, further comprising:

instructions for receiving a completed continuous stroke;

instructions for comparing said completed continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

instructions for displaying a plurality of known words which correspond to said completed continuous stroke; and

instructions for displaying said plurality of known words on said display.

34. The computer-readable medium of claim 31 wherein said display is integrated with said virtual keyboard.

35. The computer-readable medium of claim 31 wherein said known words in said preview are alternatively selectable, further comprising:

instructions for accepting a selection of a desired known word in said preview when a part of a continuous stroke intersects with said desired known word in said preview.

36. The computer-readable medium of claim 35 wherein said continuous stroke system is associated with an operating system, further comprising:

instructions for outputting said desired known word to said associated operating system.

37. The computer-readable medium of claim 35 wherein said continuous stroke system is associated with an active application, further comprising:

instructions for outputting said desired known word to said associated active application.

38. The computer-readable medium of claim 31, further comprising:

instructions for receiving spatiotemporal information concerning said continuous stroke;

instructions for comparing said spatiotemporal information to expected values; and

instructions for displaying said preview on said display if said spatiotemporal information differs from said expected values.

39. The computer-readable medium of claim 31, further comprising:

instructions for receiving spatiotemporal information concerning said continuous stroke;

instructions for comparing said spatiotemporal information to expected values; and

instructions for accepting a selection of a desired known word in said preview if said spatiotemporal information differs from said expected values.

40. The computer-readable medium of claim 31 wherein said continuous stroke system is associated with an active application, further comprising:

instructions for receiving speed information concerning the rate of movement of said continuous stroke;

instructions for comparing said speed information to a predetermined value;

instructions for outputting to an associated active application a known word in said preview if said speed information is greater than said predetermined value;

whereby a known word in said preview may be selected.

41. The computer-readable medium of claim 31, further comprising:

instructions for terminating the receiving of said continuous stroke if part of said continuous stroke intersects with a predetermined edge of said virtual keyboard.

42. The computer-readable medium of claim 31 wherein said virtual keyboard comprises an icon, further comprising:

instructions for terminating the receiving of said continuous stroke if part of said continuous stroke intersects with said icon.

43. The computer-readable medium of claim 31, further comprising:

instructions for defining word patterns of a plurality of known words by a plurality of input paths, wherein each path is associated with a word input into a virtual keyboard; and

instructions for matching the path of said first part of said continuous stroke with a corresponding word pattern.

44. The computer-readable medium of claim 31 wherein said continuous stroke system is associated with an electronic device, wherein said known words comprise commands to an electronic device associated with said virtual keyboard.

45. The computer-readable medium of claim 44, further comprising:

instructions for comparing said first part of said continuous stroke with a plurality of known command patterns which correspond to a plurality of known commands;

instructions for matching said first part of said continuous stroke to a corresponding command pattern; and

instructions for executing an instruction corresponding to said corresponding command pattern.

46. The computer-readable medium of claim 31, further comprising:

a computer, PDA, cellular phone, smartphone, tablet PC or mobile communications device having a virtual keyboard.

47. The computer-readable medium of claim 31, further comprising:

a projection device for projecting said virtual keyboard on a wall, screen or display;

wherein said continuous stroke is input via the projected representation of said virtual keyboard.

48. A computer-readable medium having computer-executable instructions for displaying a list of candidate words in a continuous stroke system having a virtual keyboard with an integrated correction display, comprising:

instructions for receiving a continuous stroke which has been input into a virtual keyboard;

instructions for comparing said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

instructions for generating a plurality of known words which correspond to said continuous stroke; and

instructions for displaying said plurality of known words on said correction display integrated with said virtual keyboard.

49. The computer-readable medium of claim 48 wherein said continuous stroke system is associated with an active application, further comprising:

instructions for outputting to said associated active application a best matching known word.

50. The computer-readable medium of claim 49, further comprising:

instructions for deleting said best matching known word from said associated active application if said best matching known word is selected on said correction display.

51. The computer-readable medium of claim 49, further comprising:

instructions for deleting said best matching known word from said correction display if said best matching known word is selected on said correction display.

52. The computer-readable medium of claim 48, further comprising:

displaying a best matching known word with a distinct graphical attribute.

53. The computer-readable medium of claim 48, further comprising:

a computer, PDA, cellular phone, smartphone, tablet PC, mobile communications device or projection device having a virtual keyboard.

54. A system for displaying a word preview in a continuous stroke system, comprising:

means for receiving a first part of a continuous stroke which has been input into a virtual keyboard;

means for comparing said first part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

means for generating a preview of known words which correspond to said first part of said continuous stroke; and

means for displaying said preview on a display prior to completion of said continuous stroke.

1. A method of displaying a word preview in a continuous stroke system, comprising:

receiving a first part of a continuous stroke which has been input into a virtual keyboard;

comparing said first part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

generating a preview of known words which correspond to said first part of said continuous stroke; and

displaying said preview on a display prior to completion of said continuous stroke.

2. The method of claim 1, further comprising:

receiving a second part of said continuous stroke;

comparing said first part and said second part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

displaying a preview of known words which correspond to said first part and said second part of said continuous stroke; and

displaying said preview on said display prior to completion of said continuous stroke.

3. The method of claim 1, further comprising:

receiving a completed continuous stroke;

comparing said completed continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

displaying a plurality of known words which correspond to said completed continuous stroke; and

displaying said plurality of known words on said display.

4. The method of claim 1 wherein said display is integrated with said virtual keyboard.

5. The method of claim 1 wherein said display is positioned outside said virtual keyboard.

6. The method of claim 1 wherein said known words in said preview are alternatively selectable, further comprising:

accepting a selection of a desired known word in said preview when a part of a continuous stroke intersects with said desired known word in said preview.

7. The method of claim 6 wherein said continuous stroke system is associated with an operating system, further comprising:

outputting said desired known word to said associated operating system.

8. The method of claim 6 wherein said continuous stroke system is associated with an active application, further comprising:

outputting said desired known word to said associated active application.

9. The method of claim 8 wherein said associated active application is a word processor, an e-mail client, instant messaging client or forms application.

10. The method of claim 1, further comprising:

receiving spatiotemporal information concerning said continuous stroke;

comparing said spatiotemporal information to expected values; and

displaying said preview on said display if said spatiotemporal information differs from said expected values.

11. The method of claim 1, further comprising:

receiving spatiotemporal information concerning said continuous stroke;

comparing said spatiotemporal information to expected values; and

accepting a selection of a desired known word in said preview if said spatiotemporal information differs from said expected values.

12. The method of claim 1 wherein said continuous stroke system is associated with an active application, further comprising:

receiving speed information concerning the rate of movement of said continuous stroke;

comparing said speed information to a predetermined value;

outputting to an associated active application a known word in said preview if said speed information is greater than said predetermined value;

whereby a known word in said preview may be selected.

13. The method of claim 1, further comprising:

terminating the receiving of said continuous stroke if part of said continuous stroke intersects with a predetermined edge of said virtual keyboard.

14. The method of claim 1 wherein said virtual keyboard comprises an icon, further comprising:

terminating the receiving of said continuous stroke if part of said continuous stroke intersects with said icon.

15. The method of claim 1, further comprising:

defining word patterns of a plurality of known words by a plurality of input paths, wherein each path is associated with a word input into a virtual keyboard; and

matching the path of said first part of said continuous stroke with a corresponding word pattern.

16. The method of claim 1 wherein said continuous stroke system is associated with an electronic device, wherein said known words comprise commands to an electronic device associated with said virtual keyboard.

17. The method of claim 16, further comprising:

comparing said first part of said continuous stroke with a plurality of known command patterns which correspond to a plurality of known commands;

matching said first part of said continuous stroke to a corresponding command pattern; and

executing an instruction corresponding to said corresponding command pattern.

18. The method of claim 1, further comprising:

providing a computer, PDA, cellular phone, smartphone, tablet PC or mobile communications device having a virtual keyboard.

19. The method of claim 1, further comprising:

providing a projection device for projecting said virtual keyboard on a wall, screen or display;

wherein said continuous stroke is input via the projected representation of said virtual keyboard.

55. The system of claim 54, further comprising:

means for receiving a second part of said continuous stroke;

means for comparing said first part and said second part of said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

means for displaying a preview of known words which correspond to said first part and said second part of said continuous stroke; and

means for displaying said preview on said display prior to completion of said continuous stroke.

56. The system of claim 54, further comprising:

means for receiving a completed continuous stroke;

means for comparing said completed continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

means for displaying a plurality of known words which correspond to said completed continuous stroke; and

means for displaying said plurality of known words on said display.

57. The system of claim 54 wherein said known words in said preview are alternatively selectable, further comprising:

means for accepting a selection of a desired known word in said preview when a part of a continuous stroke intersects with said desired known word in said preview.

58. The system of claim 57 wherein said continuous stroke system is associated with an operating system, further comprising:

means for outputting said desired known word to said associated operating system.

59. The system of claim 57 wherein said continuous stroke system is associated with an active application, further comprising:

means for outputting said desired known word to said associated active application.

60. The system of claim 59 wherein said associated active application is a word processor, an e-mail client, instant messaging client or forms application.

61. The system of claim 54, further comprising:

means for receiving spatiotemporal information concerning said continuous stroke;

means for comparing said spatiotemporal information to expected values; and

means for displaying said preview on said display if said spatiotemporal information differs from said expected values.

62. The system of claim 54, further comprising:

means for receiving spatiotemporal information concerning said continuous stroke;

means for comparing said spatiotemporal information to expected values; and

means for accepting a selection of a desired known word in said preview if said spatiotemporal information differs from said expected values.

63. The system of claim 54 wherein said continuous stroke system is associated with an active application, further comprising:

means for receiving speed information concerning the rate of movement of said continuous stroke;

means for comparing said speed information to a predetermined value;

means for outputting to an associated active application a known word in said preview if said speed information is greater than said predetermined value;

whereby a known word in said preview may be selected.

64. The system of claim 54, further comprising:

means for terminating the receiving of said continuous stroke if part of said continuous stroke intersects with a predetermined edge of said virtual keyboard.

65. The system of claim 54 wherein said virtual keyboard comprises an icon, further comprising:

means for terminating the receiving of said continuous stroke if part of said continuous stroke intersects with said icon.

66. The system of claim 54, further comprising:

means for defining word patterns of a. plurality of known words by a plurality of input paths, wherein each path is associated with a word input into a virtual keyboard; and

means for matching the path of said first part of said continuous stroke with a corresponding word pattern.

67. The system of claim 54 wherein said continuous stroke system is associated with an electronic device, wherein said known words comprise commands to an electronic device associated with said virtual keyboard.

68. The system of claim 67, further comprising:

means for comparing said first part of said continuous stroke with a plurality of known command patterns which correspond to a plurality of known commands;

means for matching said first part of said continuous stroke to a corresponding command pattern; and

means for executing an instruction corresponding to said corresponding command pattern.

69. The system of claim 54, further comprising:

means for providing a computer, PDA, cellular phone, smartphone, tablet PC or mobile communications device having a virtual keyboard.

70. The system of claim 54, further comprising:

means for providing a projection device for projecting said virtual keyboard on a wall, screen or display;

wherein said continuous stroke is input via the projected representation of said virtual keyboard.

71. A system of displaying a list of candidate words in a continuous stroke system having a virtual keyboard with an integrated correction display, comprising:

means for receiving a continuous stroke which has been input into a virtual keyboard;

means for comparing said continuous stroke with a plurality of known word patterns which correspond to a plurality of known words;

means for generating a plurality of known words which correspond to said continuous stroke; and

means for displaying said plurality of known words on said correction display integrated with said virtual keyboard.

72. The system of claim 71 wherein said continuous stroke system is associated with an active application, further comprising:

means for outputting to said associated active application a best matching known word.

73. The system of claim 72, further comprising:

means for deleting said best matching known word from said associated active application if said best matching known word is selected on said correction display.

74. The system of claim 72, further comprising:

means for deleting said best matching known word from said correction display if said best matching known word is selected on said correction display.

75. The system of claim 71, further comprising:

means for displaying a best matching known word with a distinct graphical attribute.

76. The system of claim 71, further comprising:

a computer, PDA, cellular phone, smartphone, tablet PC, mobile communications device or projection device having a virtual keyboard.