Method for improving usage of a graphic user interface pointing device

• US 7,240,299 B2
• Filed: 04/26/2001
• Issued: 07/03/2007
• Est. Priority Date: 04/26/2001
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: International Business Machines Corporation
• Inventors: Abrams, Roger Kenneth
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): TRAN, MYLINH T
• Application Number:
  US09/842,471
• Publication Number:
  US 20020158920A1
• Time in Patent Office: 2,259 Days
• Field of Search: 345/654, 345/474, 345/440.1, 345/440.2, 345/764, 345/857, 345/858, 345/442, 345/157, 345/856, 715/654, 715/764, 715/857, 715/858, 715/856
• US Class Current: 715/857
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B

Abstract

A two part method for improving the usage of a pointing device by a physically impaired user is disclosed. A first method is provided for learning how a user moves the pointing device by acquiring motion data for a user and generating motion vectors corresponding to when the user moves from source point icons to destination point icons. A second method of combining the learned user motion data with an application program where the user navigates the pointing device to select program icons on a graphical user interface (GUI) screen is provided. The method determines when the actual motion vector is similar to a previously acquired motion vector with a similar source point. The method predicts a destination point icon and highlights and locks the prediction icon until the user either actuates the iconor generates motion vectors that indicate that another destination point icon is the more likely destination.

Claims

1. A method for improving a selection of a graphic user interface (GUI) icon with a pointing device, comprising the steps of:

acquiring data corresponding to a motion of a pointing cursor on a display, said motion of said pointing cursor corresponding to a pointing device used to move said pointing cursor from a first source position to a first destination position on said display;

generating a set of motion vectors corresponding to said motion of said pointing cursor from said first source position to said first destination position; and

storing said set of motion vectors and said first destination position referenced to said first source position.

2. The method of claim 1 further comprising the steps of:

(a) generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

(b) predicting a destination point icon in response to a compare of said second source position to a corresponding stored source position or a source position proximate to said second source position, wherein said corresponding stored source position which compares to said second source position also has stored said first motion vector or a motion vector proximate to said first motion vector; and

(c) highlighting said destination point icon.

3. The method of claim 2, further comprising the step of:

repeating said steps (a) through (c) until said highlighted destination point icon is actuated by a user of said pointing device.

4. The method of claim 2, wherein said set of motion vectors are stored in response to actuating said destination point icon.

5. The method of claim 2, wherein said second source position corresponds to a position of a source point icon.

6. The method of claim 2, wherein said pointing cursor locks to said destination point icon until said destination point icon is actuated by a user.

7. The method of claim 2, wherein said pointing cursor locks to said destination point icon until a motion vector indicates a more likely destination point icon.

8. The method of claim 3, wherein said motion of said pointing cursor proceeds from said first source position to said destination point icon corresponding to an ideal motion vector, said ideal motion vector motion changed only if a new destination point icon is determined.

9. The method of claim 1, further comprising the steps of:

(a) generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

(b) predicting a destination point icon in response to a compare of said second source position to a corresponding stored source position or a source position proximate to said second source position, wherein said corresponding stored source position which compares to said second source position also has stored said first motion vector or a motion vector proximate to said first motion vector; and

(c) modifying a motion of said pointing cursor to more nearly follow ideal motion vectors from said first source position to said destination point icon.

10. The method of claim 9, further comprising the step of:

repeating said steps (a) through (c) until said predicted destination point icon is actuated by a user of said pointing device.

11. The method of claim 1, wherein said display corresponds to a graphic user interface (GUI).

12. The method of claim 1, wherein said first source position is a position of a predetermined source point icon.

13. The method of claim 1, wherein said first destination position is a position of a predetermined destination point icon.

14. The method of claim 1, wherein another of said motion vectors is generated each time said motion starts from a motion stop.

15. The method of claim 1, wherein said motion vector comprises parameters defining a pointing cursor average velocity, starting position, stopping position, and motion direction.

16. The method of claim 1, wherein said set of motion vectors are associated with said first source position and source positions proximate to said first source position, and said first destination position and destination positions proximate to said first destination position.

17. A computer program product, said computer program product embodied in a machine readable medium, including programming for a processor, said computer program comprising a program of instructions for performing the program steps of:

acquiring data corresponding to a motion of a pointing cursor on a display, said motion of said pointing cursor corresponding to a pointing device used to move said pointing cursor from a first source position to a first destination position on said display;

generating a set of motion vectors corresponding to said motion of said pointing cursor from said first source position to said first destination position; and

storing said set of motion vectors and said first destination position referenced to said first source position.

18. The computer program product of claim 17 further comprising the steps of:

(a) generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

(b) predicting a destination point icon in response to a compare of said second source position to a corresponding stored source position or a source position proximate to said second source position, wherein said corresponding stored source position which compares to said second source position also has stored said first motion vector or a motion vector proximate to said first motion vector; and

(c) highlighting said destination point icon.

19. The computer program product of claim 18, further comprising the step of:

repeating said steps (a) through (c) until said highlighted destination point icon is actuated by a user of said pointing device.

20. The computer program product of claim 18, wherein said set of motion vectors are stored in response to actuating said predetermined destination point icon.

21. The computer program product of claim 18, wherein said second source position corresponds to a position of a source point icon.

22. The computer program product of claim 18, wherein said pointing cursor locks to said destination point icon until said destination point icon is actuated by a user.

23. The computer program product of claim 18, wherein said pointing cursor locks to said destination point icon until a motion vector indicates a more likely destination point icon.

24. The computer program product of claim 19, wherein said motion of said pointing cursor proceeds from said first source position to said destination point icon corresponding to an ideal motion vector, said ideal motion vector motion changed only if a new destination point icon is determined.

25. The computer program product of claim 17, further comprising the steps of:

(a) generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

(b) predicting a destination point icon in response to a compare of said second source position to a corresponding stored source position or a source position proximate to said second source position, wherein said corresponding stored source position which compares to said second source position also has stored said first motion vector or a motion vector proximate to said first motion vector; and

(c) modifying a motion of said pointing cursor to more nearly follow ideal motion vectors from said first source position to said destination point icon.

26. The computer program product of claim 25, further comprising the step of:

repeating said steps (a) through (c) until said predicted destination point icon is actuated by a user of said pointing device.

27. The computer program product of claim 17, wherein said display corresponds to a graphic user interface (GUI).

28. The computer program product of claim 17, wherein said first source position is a position of a predetermined source point icon.

29. The computer program product of claim 17, wherein said first destination position is a position of a predetermined destination point icon.

30. The computer program product of claim 17, wherein another of said motion vectors is generated each time said motion starts from a motion stop.

31. The computer program product of claim 17, wherein said motion vector comprises parameters defining a pointing cursor average velocity, starting position, stopping position, and motion direction.

32. The computer program product of claim 17, wherein said set of motion vectors are associated with said first source position and source positions proximate to said first source position, and said first destination position and destination positions proximate to said first destination position.

33. A data processing system comprising:

a central processing unit (CPU);

a random access memory (RAM);

a communications adapter coupled to a communication network;

an I/O adapter

a bus system coupling said CPU to said PROM, said communications adapter, said I/O adapter, and said RAM, wherein said CPU comprises;

circuitry for acquiring data corresponding to a motion of a pointing cursor on a display, said pointing cursor corresponding to a pointing device used to move said pointing cursor from a first source position to a first destination position on said display;

circuitry for generating a set of motion vectors corresponding to said motion of said pointing cursor from said first source position to said first destination position, said motion vectors having a vector source point, a magnitude and direction; and

circuitry for storing said set of motion vectors and said first destination position referenced to said first source position.

34. The data processing system of claim 33, further comprising:

circuitry for generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

circuitry for predicting a destination point icon in response to a compare of said second source position with a corresponding stored source position or a stored proximate source position having a stored corresponding said first motion vector or a proximate motion vector; and

circuitry for highlighting said destination point icon.

35. The data processing system of claim 34, wherein said set of motion vectors are stored in response to actuating said destination point icon.

36. The data processing system of claim 34, wherein said second source position corresponds to a position of a source point icon.

37. The data processing system of claim 34, wherein said pointing cursor locks to said destination point icon until said destination point icon is actuated by a user.

38. The data processing system of claim 34, wherein said pointing cursor locks to said destination point icon until a motion vector indicates a more likely destination point icon.

39. The data processing system of claim 33, further comprising:

circuitry for generating, within an application program, a first motion vector for said pointing cursor on said display as said pointing cursor moves from a second source position in response to a motion of said pointing device;

circuitry for predicting a destination point icon in response to a compare of said second source position with a corresponding stored source position or a stored proximate source position having a stored corresponding said first motion vector or a proximate motion vector; and

circuitry for modifying a motion of said pointing cursor to follow ideal motion vectors from said first source position to said destination point icon.

40. The data processing system of claim 39, wherein said motion of said pointing device proceeds from said first source position to said destination point icon corresponding to an ideal motion vector, said ideal motion vector motion changed only if a new destination point icon is determined.

41. The data processing system of claim 33, wherein said display corresponds to a graphic user interface (GUI).

42. The data processing system of claim 33, wherein said first source position is a position of a predetermined source point icon.

43. The data processing system of claim 33, wherein said first destination position is a position of a predetermined destination point icon.

44. The data processing system of claim 33, wherein another of said motion vectors is generated each time said motion starts from a motion stop.

45. The data processing system of claim 33, wherein said motion vector comprises parameters defining a pointing cursor average velocity, starting position, stopping position, and motion direction.

46. The data processing system of claim 33, wherein said set of motion vectors are associated with said first source position and source positions proximate to said first source position, and said first destination position and destination positions proximate to said first destination position.

47. A method for improving a selection of a graphic user interface (GUI) icon with a pointing device, comprising the step of:

predicting, within an application program, a destination point icon by comparing a motion vector imparted by a user to a pointing cursor to a previously acquired motion vector imparted by a user to a pointing cursor to a previously

highlighting said destination point icon in response to said prediction step until said predicted destination point icon is actuated by said user.

48. A computer program product, said computer program product embodied in a machine readable medium, including programming for a processor, said computer program comprising a program of instructions for performing the program step of:

predicting, within an application program, a destination point icon by comparing a motion vector imparted by a user to a pointing cursor to a previously acquired motion vector acquired from said user moving said pointing cursor;

highlighting said destination point icon in response to said prediction step until said predicted destination point icon is actuated by said user.

49. A data processing system comprising:

a central processing unit (CPU);

a random access memory (RAM);

a communications adapter coupled to a communication network;

an I/O adapter;

a bus system coupling said CPU to said PROM, said communications adapter, said I/O adapter, and said RAM, wherein said CPU comprises;

circuitry operable to predict, within an application program, a destination point icon by comparing a motion vector imparted by a user to a pointing cursor to a previously acquired motion vector acquired from said user moving said pointing cursor;

circuitry operable to highlight said predicted destination point icon until said predicted destination point icon is actuated by said user.