Semantic user interface
First Claim
1. A system for permitting a user to implement functionality on a computer, the functionality being provided across a plurality of application programs, the computer including a data entry device, comprising:
- means for monitoring all data entered by a user within any one of the plurality of application programs, said data including one or more alphabetic letters, symbols and/or words;
a wordbase having stored therein a plurality of item records, each item record having an action word and one of a plurality of associated functions, wherein one of said item records includes a default action word;
means for searching said wordbase for a match with said data entered by said user; and
means for performing said function associated with said data.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method that allows a user to use their everyday language or user defined words to operate a computer in a highly efficient way. In short, every word, letter, control character and symbol is potentially actionable. A computer user'"'"'s productivity is dramatically increased by making available those functions that enable a user to produce most of his work through simple, language-based commands. The present invention provides an intuitive interface, referred to as a semantic user interface (SUI), that enhances the operation of the current standard window-based interface in a manner that is simple, richer and natural. By leveraging all of the richness and power inherent in a user'"'"'s language, the present invention provides an important tool that allows the personal computer to operate in a manner that is much closer to our natural way of interacting. A user is allowed to enter “commands” in his everyday natural language in order to control the operations of the computer. All commands are language-based and user-defined. These commands can be entered from any context of the user'"'"'s computer (e.g., any application or operating system workspace). The commands allows a user to launch applications and navigate within applications by using language rather than clicks from a pointing device such as a mouse. It also allows the replacement of keystrokes with stored words or keystrokes. The system also keeps a complete archive record of all the text content the user provides as input, regardless of which application program or operating system window the user is operating in at the time. The combined set of all user defined commands and the memory of all the input text that is stored in the archive constitutes the personality profile and is transportable from one computer to another.
-
Citations
131 Claims
-
1. A system for permitting a user to implement functionality on a computer, the functionality being provided across a plurality of application programs, the computer including a data entry device, comprising:
-
means for monitoring all data entered by a user within any one of the plurality of application programs, said data including one or more alphabetic letters, symbols and/or words;
a wordbase having stored therein a plurality of item records, each item record having an action word and one of a plurality of associated functions, wherein one of said item records includes a default action word;
means for searching said wordbase for a match with said data entered by said user; and
means for performing said function associated with said data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 124)
-
-
24. A system for permitting a user to access information across a plurality of application programs, comprising:
-
means for monitoring data selected by a user within any one of the plurality of application programs;
a wordbase; and
means for displaying information relating to said data selected by said user, wherein said wordbase is accessed prior to displaying said information. - View Dependent Claims (25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81)
means for performing said function associated with said data.
-
-
26. The system of claim 25, wherein said means for monitoring also monitors for data entered by said user via a keyboard.
-
27. The system of claim 26, wherein said data is formed from one or more alphabetic letters, symbols and/or words.
-
28. The method of claim 26, further comprising the step of establishing a user profile, wherein said information is displayed after consulting said user profile.
-
29. The method claim 28, wherein said information is accessed from a web page.
-
30. The method of claim 28, wherein said information is one of a stock quote, statistics, or a translation of said data into another language.
-
31. The method of claim 28, wherein said information is from a dictionary or an encyclopedia.
-
32. The method of claim 26, further comprising storing said wordbase on a server connected to a network, wherein the application programs execute on a computer system, which is also connected to said network.
-
33. The method of claim 26, wherein said wordbase is populated by a third party.
-
34. The method of claim 33, wherein said wordbase is further populated by said user.
-
35. The method of claim 26, wherein one of said item records includes a default action word.
-
36. The system of claim 25, wherein one of said records includes a default action word.
-
37. The system of claim 25, wherein a single action word can activate two or more functions, the system further comprising means for selecting between said two or more functions when said single action word is selected by said user.
-
38. The system of claim 25, wherein said action word is formed by at least two natural language words.
-
39. The system of claim 25, wherein an action word can be a code word or a dual word, the system further comprising means for allowing said user to turn said code word and said dual word on and off within said wordbase.
-
40. The system of claim 25, wherein said wordbase is populated by a third party.
-
41. The system of claim 40, wherein said wordbase is further populated by the user.
-
42. The system of claim 40, further comprising storing said wordbase on a server connected to a network, wherein the application programs execute on a computer system, which is also connected to said network.
-
43. The system of claim 24, wherein said data is selected via a mouse.
-
44. The system of claim 24, wherein said means for displaying is configured to display said information based on a user profile.
-
45. The system of claim 44, further comprising means for maintaining an archive record of language preferences, word frequencies, and utterance behavior of said user.
-
46. The system of claim 44, further comprising means for maintaining multiple user profiles.
-
47. The system of claim 24, wherein said means for displaying includes displaying a number of resources relating to said selected data.
-
48. The system of claim 24, wherein said means for displaying displays a list of equivalent words in one or more languages related to said selected data.
-
49. The system of claim 24, wherein said means for displaying displays a list of Internet links (URL'"'"'s) related to said selected data.
-
50. The system of claim 24, wherein said means for displaying displays a list of synonyms for said selected data.
-
51. The system of claim 24, wherein the plurality of application programs include at least one of an e-mail program, a word processing program, or a browser.
-
52. The system of claim 24, wherein said data is selected by said user by activating a user-defined key.
-
53. The system of claim 24, wherein said data can be selected from a web page.
-
54. The system of claim 24, wherein said information is a stock quote.
-
55. The system of claim 24, wherein said information is from a dictionary or encyclopedia.
-
56. The system of claim 24, wherein said information is a statistic.
-
57. The system of claim 24, wherein said information is displayed within a pop-up window.
-
58. The system of claim 24, further comprises providing an indication that additional information is available relating to said selected data.
-
59. The system of claim 24, wherein said information is a translation of said data into another language.
-
60. The system of claim 24, wherein said information includes a weather report for a designated location.
-
61. The system of claim 24, wherein said data is selected by said user by pressing a button on a mouse.
-
62. The system of claim 24, wherein said data is selected by pressing a designated key on a keyboard.
-
63. The system of claim 62, wherein said information is displayed within a pop-up window.
-
64. The system of claim 62, wherein said information is a web page accessed via the Internet.
-
65. The system of claim 24, wherein said wordbase is populated by a third party.
-
66. The system of claim 65, wherein said wordbase is further populated by the user.
-
67. The system of claim 24, wherein said wordbase is located on a server connected to a network.
-
68. The system of claim 24, wherein said data can be selected from within an environment created by an operating system.
-
69. The system of claim 24, wherein said data is selected by entering a delineator.
-
70. The system of claim 69, wherein said delineator is user-definable.
-
71. The system of claim 69, wherein said delineator is a button on a point-and-click device.
-
72. The method of claim 24, wherein said data is in a first language, and further comprising:
-
means for searching said wordbase to determine a translation of said data into a second language;
means for displaying said translation of said word in said second language within said pop-up window.
-
-
73. The method of claim 72, further comprising the step of establishing a user profile, wherein said translation is displayed after accessing said user profile.
-
74. The method of claim 72, wherein said first language is English and said second language is Spanish or French.
-
75. The method of claim 72, wherein said data is selected using a mouse and a pre-defined key on a keyboard.
-
76. The method of claim 72, wherein said step of displaying includes providing a window that includes a translation of said data in a plurality of languages.
-
77. The method of claim 72, wherein said wordbase is located on a server connected to a network.
-
78. The system of claim 24, wherein said data including one or more alphabetic letters, symbols and/or words, and said means for displaying accesses said wordbase prior to displaying said information, wherein said wordbase includes other functions that can be performed upon selection of said selected data, wherein each of said functions is associated with one or more of said alphabetic letters, symbols and/or words.
-
79. The system of claim 24, further comprising:
-
means for converting voice signals received via microphone from a user to data, wherein said means for monitoring also monitors for said data entered via said microphone; and
wherein said wordbase having stored therein a plurality of item records, each item record having an action word and one of a plurality of associated functions.
-
-
80. The system of claim 79, further comprising:
-
means for establishing a user profile; and
means for displaying information relating to said selected data, wherein said information is based on said user profile.
-
-
81. The system of claim 24, wherein said data entered by said user is selected by using a mouse.
-
82. A method for permitting a user to access information across a plurality of application programs, comprising:
-
monitoring data entered by a user within any one of the plurality of application programs;
accessing a wordbase for a match with data entered by said user; and
displaying information within a display box relating to said data entered by said user. - View Dependent Claims (83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102)
activating a function associated with said data if said data matches an action word stored within said wordbase.
-
-
85. The method of claim 82, wherein said data is selected via a mouse.
-
86. The method of claim 82, further comprising selecting said data from at least one of an e-mail program, a word processing program, or a browser.
-
87. The method of claim 82, wherein said data can be selected from a web page.
-
88. The method of claim 82, wherein said information is a stock quote or statistic.
-
89. The method of claim 82, wherein said information is from a dictionary.
-
90. The method of claim 82, wherein said information is from an encyclopedia.
-
91. The method of claim 82, further comprising providing an indication that additional information is available relating to said selected data.
-
92. The method of claim 82, wherein said data is selected by the user activating a user-defined key.
-
93. The method of claim 82, wherein said data is selected by the user pressing a button on a mouse.
-
94. The method of claim 82, wherein said data is selected by pressing a designated key on a keyboard.
-
95. The method of claim 82, wherein said wordbase is populated by a third party.
-
96. The method of claim 95, wherein said wordbase is further populated by the user.
-
97. The method of claim 96, wherein said information is one of:
- a stock quote, a statistic, a translation, or from a dictionary, an encyclopedia, or a web page.
-
98. The method of claim 95, wherein said wordbase is located on a server connected to a network.
-
99. The method of claim 98, further comprising entering a user-defined delineator, whereby said data is selected by entering said delineator.
-
100. The method of claim 82, further comprising entering a user-defined delineator, whereby said data is selected by entering said delineator.
-
101. The method of claim 82, wherein said date entered by said user is selected by using a mouse.
-
102. The method of claim 82, wherein said data is monitored within any context of a computer system.
-
103. A method of accessing information, comprising the steps of:
-
selecting data via a point-and-click device associated with a computer, wherein said selection can occur within any one of a plurality of application programs executing on the computer;
entering a delineator;
accessing a wordbase using said selected data; and
displaying a window in response to said selection of said data, wherein said window contains information relating to said data. - View Dependent Claims (104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120)
-
-
121. A method for permitting a user to access information via a computer, comprising the steps of:
-
monitoring data selected by a user across a plurality of application programs, wherein said data is selected using a point-and-click device attached to the computer, wherein a selection of said data is followed by either pressing a pre-defined key on a keyboard attached to the computer or by pressing a button on said point-and-click device;
populating a wordbase;
accessing said wordbase in response to said user selecting said data; and
displaying information related to said data, based on said step of accessing said wordbase, within a pop-up window. - View Dependent Claims (122, 123, 125, 126, 127, 128, 129, 130, 131)
-
Specification