Method and system for implicitly resolving pointing ambiguities in human-computer interaction (HCI)
First Claim
1. A method for implicitly resolving pointing ambiguities in human-computer interaction, comprising the steps of:
- (a) intending by a user to select a user targeted object from a plurality of at least two objects in an object domain displayed by a computer executing a computer application including a pointing mechanism featuring a pointer dynamically moveable throughout said object domain;
(b) moving by said user said pointer towards said user targeted object;
(c) estimating by said computer user movement continuation of said pointer towards said user targeted object;
(d) forming by said computer a set of candidate predicted user targeted objects according to parameters selected from the group consisting of pointer movement continuation parameters obtained from step (c) and pointer position parameters;
(e) predicting by said computer said user targeted object from said set of said candidate predicted user targeted objects according to at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures, application context measures, and, number of computer suggestions of each predicted user targeted object measures, for generating by said computer a best predicted user targeted object;
(f) suggesting by said computer said best predicted user targeted object to said user; and
(g) making a decision by said user, said decision is selected from the group consisting of accepting said computer suggested best predicted user targeted object as said user targeted object and as correct, and, rejecting said computer suggested best predicted user targeted object as not said user targeted object and as incorrect, whereby if said decision is said accepting said computer suggested best predicted user targeted object as said user targeted object, then said user performs an acceptance action using said pointing mechanism, indicative that the pointing ambiguities are resolved.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for implicitly resolving pointing ambiguities in human-computer interaction by implicitly analyzing user movements of a pointer toward a user targeted object located in an ambiguous multiple object domain and predicting the user targeted object, using different categories of heuristic (statically and/or dynamically learned) measures, such as (i) implicit user pointing gesture measures, (ii) application context, and (iii) number of computer suggestions of each predicted user targeted object. Featured are user pointing gesture measures of (1) speed-accuracy tradeoff, referred to as total movement time (TMT), and, amount of fine tuning (AFT) or tail-length (TL), and, (2) exact pointer position. A particular application context heuristic measure used is referred to as containment hierarchy. The invention is widely applicable to resolving a variety of different types of pointing ambiguities such as composite object types of pointing ambiguities, involving different types of pointing devices, and which are widely applicable to essentially any type of software and/or hardware methodology involving using a pointer, such as in computer aided design (CAD), object based graphical editing, and text editing.
-
Citations
72 Claims
-
1. A method for implicitly resolving pointing ambiguities in human-computer interaction, comprising the steps of:
-
(a) intending by a user to select a user targeted object from a plurality of at least two objects in an object domain displayed by a computer executing a computer application including a pointing mechanism featuring a pointer dynamically moveable throughout said object domain;
(b) moving by said user said pointer towards said user targeted object;
(c) estimating by said computer user movement continuation of said pointer towards said user targeted object;
(d) forming by said computer a set of candidate predicted user targeted objects according to parameters selected from the group consisting of pointer movement continuation parameters obtained from step (c) and pointer position parameters;
(e) predicting by said computer said user targeted object from said set of said candidate predicted user targeted objects according to at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures, application context measures, and, number of computer suggestions of each predicted user targeted object measures, for generating by said computer a best predicted user targeted object;
(f) suggesting by said computer said best predicted user targeted object to said user; and
(g) making a decision by said user, said decision is selected from the group consisting of accepting said computer suggested best predicted user targeted object as said user targeted object and as correct, and, rejecting said computer suggested best predicted user targeted object as not said user targeted object and as incorrect, whereby if said decision is said accepting said computer suggested best predicted user targeted object as said user targeted object, then said user performs an acceptance action using said pointing mechanism, indicative that the pointing ambiguities are resolved. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60)
-
-
13. A method for implicitly resolving pointing ambiguities in human-computer interaction, comprising the steps of:
-
(a) intending by a user to select a user targeted object from a plurality of at least two objects in an object domain displayed by a computer executing a computer application including a pointing mechanism featuring a pointer dynamically moveable throughout said object domain;
(b) moving by said user said pointer towards said user targeted object;
(c) selecting by said user a position of said pointer located in a vicinity of said user targeted object;
(d) estimating by said computer user movement continuation of said pointer towards said user targeted object;
(e) forming by said computer a set of candidate predicted user targeted objects according to parameters selected from the group consisting of pointer movement continuation parameters obtained from step (d) and pointer position parameters;
(f) predicting by said computer said user targeted object from said set of said candidate predicted user targeted objects according to at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures and application context measures, for generating by said computer a best predicted user targeted object; and
(g) selecting by said computer said computer generated best predicted user targeted object, whereby if said computer generated best predicted user targeted object is said user targeted object, then the pointing ambiguities are resolved.
-
-
25. A method for implicitly resolving pointing ambiguities in human-computer interaction, comprising the steps of:
-
(a) intending by a user to select a user targeted object from a plurality of at least two objects in an object domain displayed by a computer executing a computer application including a pointing mechanism featuring a pointer dynamically moveable throughout said object domain;
(b) moving by said user said pointer towards said user targeted object;
(c) implicitly resolving by said computer the pointing ambiguities by implicitly analyzing user movements of said pointer towards said user targeted object located in said object domain and predicting said user targeted object, whereby said implicitly analyzing and predicting are performed by using at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures, application context measures, and number of computer suggestions of each best predicted user targeted object measures.
-
-
37. A method for implicitly resolving pointing ambiguities in human-computer interaction, comprising the steps of:
-
(a) intending by a user to select a user targeted object from a plurality of at least two objects in an object domain displayed by a computer executing a computer application including a pointing mechanism featuring a pointer dynamically moveable throughout said object domain;
(b) moving by said user said pointer towards said user targeted object;
(c) implicitly resolving by said computer the pointing ambiguities by implicitly analyzing user movements of said pointer towards said user targeted object located in said object domain and predicting said user targeted object, whereby said implicitly analyzing and predicting are performed by using at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures and application context measures.
-
-
49. A system for implicitly resolving pointing ambiguities in human-computer interaction, comprising:
-
(a) a user intending to select a user targeted object from a plurality of at least two objects in an object domain;
(b) a pointing mechanism featuring a pointer dynamically moveable throughout said object domain and controllable by said user; and
(c) a computer displaying said plurality of said at least two objects in said object domain and executing a computer application including said pointer dynamically moveable throughout said object domain, whereby said computer implicitly resolves the pointing ambiguities by implicitly analyzing user movements of said pointer towards said user targeted object located in said object domain and predicting said user targeted object, said implicitly analyzing and predicting are performed by using at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures, application context measures, and number of computer suggestions of each best predicted user targeted object measures.
-
-
61. A system for implicitly resolving pointing ambiguities in human-computer interaction, comprising:
-
(a) a user intending to select a user targeted object from a plurality of at least two objects in an object domain;
(b) a pointing mechanism featuring a pointer dynamically moveable throughout said object domain and controllable by said user; and
(c) a computer displaying said plurality of said at least two objects in said object domain and executing a computer application including said pointer dynamically moveable throughout said object domain, whereby said computer implicitly resolves the pointing ambiguities by implicitly analyzing user movements of said pointer towards said user targeted object located in said object domain and predicting said user targeted object, said implicitly analyzing and predicting are performed by using at least one category of heuristic measures selected from the group consisting of implicit user pointing gesture measures and application context measures. - View Dependent Claims (62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72)
-
Specification