Method and program product for resolving ambiguities through fading marks in a user interface

• US 7,676,754 B2
• Filed: 05/04/2004
• Issued: 03/09/2010
• Est. Priority Date: 05/04/2004
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Basson, Sara, Faisman, Alexander, Kanevsky, Dimitri
• Primary Examiner(s): Hailu; Tadesse
• Assistant Examiner(s): CHAUDHURI, ANITA
• Application Number:
  US10/838,444
• Publication Number:
  US 20050251746A1
• Time in Patent Office: 2,135 Days
• Field of Search: 715/701, 715/702, 715/703, 715/753, 715/757, 715/758, 715/773, 715/850, 715/865, 715/863, 715/727, 715/760, 715/762, 715/763, 715/764
• US Class Current: 715/762
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

Resolving an ambiguous input. When an ambiguous user input is received, the user input is displayed, for example, in a way that either the ambiguity is resolved or the ambiguity is indicated to the user by unique and distinctive graphical indications. Then, after waiting either for a time to receive a corrective input from the user or for a predetermined time, the display of the user input is faded.

Claims

1. A computer-implemented method of resolving an ambiguous input to a computer system, said computer-implemented method comprising:

programming a specific processor with computer executable instructions that, when executed within the computer system, execute steps comprising;

receiving a user tactile input that has been input by a user on a display screen, wherein said user tactile input is an ambiguous input due to an imprecise location of the user tactile input on a display monitor;

in response to receiving said ambiguous input, displaying said ambiguous input to said user in a way that indicates an ambiguity of said ambiguous input to the user by graphical means;

in response to displaying said ambiguous input in a way that indicates the ambiguity of said ambiguous input to the user by graphical means, waiting a predetermined period of time to receive a corrective input from the user; and

fading a display of the ambiguous input during said predetermined period of time, wherein said fading occurs gradually during said predetermined period of time, wherein said ambiguous input is displayed as a geometric shape having an initial thickness, and wherein the initial thickness of the geometric shape decreases during said predetermined period of time.

2. The computer-implemented method of claim 1, further comprising:

in response to the display of the ambiguous input completely fading away, replacing a first screen being displayed on the display monitor with a second screen.

3. The computer-implemented method of claim 2, wherein the second screen is presented automatically after a preset period of time.

4. The computer-implemented method of claim 2, wherein the second screen is presented only after the user confirms an entry on the first screen.

5. The computer-implemented method of claim 1, wherein the ambiguity is detected, by the computer system, in response to the user failing to look at a location of the user tactile input on the display monitor while entering the user tactile input.

6. The computer-implemented method of claim 1, wherein said ambiguous input is a tactile input onto a touch screen, and wherein a display of the tactile input is brightness coded to identify a level of user confidence that an initial tactile input is correct.

7. A computer system for resolving input ambiguity comprising:

a central processing unit (CPU), a computer readable memory, and a computer readable storage media;

first program instructions for receiving a user tactile input that has been input by a user on a display screen, wherein said user tactile input is an ambiguous input due to an imprecise location of the user tactile input on a display monitor;

second program instructions for, in response to receiving said ambiguous input, displaying said ambiguous input to said user in a way that indicates an ambiguity of said ambiguous input to the user by graphical means;

third program instructions for, in response to displaying said ambiguous input in a way that indicates the ambiguity of said ambiguous input to the user by graphical means, waiting a predetermined period of time to receive a corrective input from the user; and

fourth program instructions for fading a display of the ambiguous input during said predetermined period of time, wherein said fading occurs gradually during said predetermined period of time, wherein said ambiguous input is displayed as a geometric shape having a initial thickness, and wherein the initial thickness of the geometric shape decreases during said predetermined period of time, and wherein

said first, second, third and fourth program instructions are stored on said computer readable storage media for execution by said CPU via said computer readable memory.

8. The computer system of claim 7, wherein the ambiguous input is chosen from a group consisting of touch, gestures, head mounted mouse movements, eye movements, voice, and voice intonations.

9. The computer system of claim 7, wherein an ambiguity of said ambiguous input is from a group consisting of all of:

ambiguity in a user intention,

ambiguity in interpretation of a user intention,

ambiguity in user interpretation of computer actions,

ambiguity in user perception of computer actions, and

user perceptual dissatisfaction in interactions between the user and the computer system.

10. The computer system of claim 7, wherein displaying said ambiguous input comprises either resolving said ambiguity or indicating an unresolved ambiguity.

11. The computer system of claim 10 adapted to indicate said ambiguity to the user by a graphical output.

12. The computer system of claim 7, wherein the ambiguous input is a tactile input chosen from a group consisting of a touch screen sensor, a mouse pointer, and a head mounted mouse pointer.

13. The computer system of claim 12, wherein when the user applies a tactile input, the system causes a circle that is surrounding a cursor to collapse onto a current cursor position.

14. The computer system of claim 13, wherein when the user positions the cursor around an area of interest and clicks a tactile input drag button while dragging the tactile input, wherein the system displays a rectangle, and wherein said user'"'"'s dragging of the rectangle indicates the area of interest that has been grabbed and dragged.

15. The computer system of claim 14, wherein when the user releases the tactile input drag button, the system updates the display screen by filling in additional detail.

16. The computer system of claim 15, wherein the system fades the rectangle.

17. The computer system of claim 7, wherein a duration of pausing processing of the user tactile input to receive a corrective user input is a function of different multimodal input events.

18. The computer system of claim 7, wherein the computer system resolves user intention ambiguities in multimodal actions based upon time delays between user input multimodal events.

19. The computer system of claim 7 adapted for geographic use, wherein sequence of and time intervals between subsequent user input events result in a display of different location sequences.

20. A tangible data storage medium on which is stored a program product, said program product comprising computer readable code, said computer readable code configuring and directing a computer to perform a method for resolving an ambiguous multimodal input to a computer system, said method comprising:

receiving an ambiguous multimodal input from a user;

determining that the geometric shape obscures pre-determined important information on a graphical display;

in response to determining that the geometric shape obscures the pre-determined important information on the graphical display, replacing the geometric shape with another type of geometric shape that does not obscure the pre-determined important information on the graphical display;

in response to receiving said ambiguous multimodal input, displaying the ambiguous multimodal input to said user on the graphical display as a geometric shape;

in response to displaying said ambiguous multimodal input, pausing processing the ambiguous multimodal input to receive a corrective user input; and

in response to receiving a corrective user input, fading the display of said ambiguous multimodal input from said graphical display over a predetermined length of time wherein said fading occurs gradually over said predetermined period of time.

21. The tangible data storage medium of claim 20, wherein the ambiguous multimodal input is chosen from a group consisting of touch, gestures, a mouse pointer, a head mounted mouse pointer, eye movements, voice, and voice intonations.

22. The tangible data storage medium of claim 20, wherein an ambiguity of said ambiguous multimodal input is chosen from a group consisting of one or more of:

ambiguity in a user intention;

ambiguity in interpretation of a user intention;

ambiguity in user interpretation of computer actions;

ambiguity in user perception of computer actions; and

user perceptual dissatisfaction in interactions between the user and the computer system.

23. The tangible data storage medium of claim 20 adapted for displaying said ambiguous multimodal input and either resolving ambiguity or indicating unresolved ambiguity.

24. The tangible data storage medium of claim 23 adapted for graphically indicating ambiguity to the user.

25. The tangible data storage medium of claim 20 adapted for indicating ambiguity to the user by fading a display of a mark in response to receiving a corrective response from said user.

26. The tangible data storage medium of claim 20 wherein input means are chosen from a group consisting of a touch screen sensor, a mouse pointer, and a head mounted mouse pointer.

27. The tangible data storage medium of claim 26 adapted for receiving a user tactile input, displaying a cursor and a circle associated with the cursor in response thereto, and collapsing the circle on a current cursor position.

28. The tangible data storage medium of claim 27 adapted for the user positioning the cursor around an area of interest and clicking a tactile drag button while dragging the tactile input, and thereafter displaying a rectangle, wherein said user'"'"'s dragging of the rectangle indicates the area of interest that has been grabbed and dragged.

29. The tangible data storage medium of claim 28 adapted for updating the graphical display when the user releases the tactile input drag button.

30. The tangible data storage medium of claim 29 adapted for fading the rectangle.

31. The tangible data storage medium of claim 20 adapted for pausing the ambiguous multimodal input to receive a corrective user input as a function of different multimodal input events.

32. The tangible data storage medium of claim 20 adapted for generating a corrective input in the absence of a user reply.

33. The tangible data storage medium of claim 20 adapted for resolving user intention ambiguities in multimodal actions based upon time delays between user input multimodal events.