Tactile computer interface

• US 6,219,034 B1
• Filed: 02/23/1998
• Issued: 04/17/2001
• Est. Priority Date: 02/23/1998
• Status: Expired due to Term

• Current Assignee: Jonathan T. Foote, Kristofer E. Elbing
• Original Assignee: Jonathan T. Foote, Kristofer E. Elbing
• Inventors: Foote, Jonathan T., Elbing, Kristofer E.
• Primary Examiner(s): SAX, STEVEN PAUL
• Application Number:
  US09/028,069
• Time in Patent Office: 1,149 Days
• Field of Search: 345/158, 345/358, 345/157, 345/159, 345/160, 345/163, 345/165, 345/164, 345/166, 345/173, 345/174, 345/175, 345/177, 345/121, 345/123
• US Class Current: 345/158
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A computer system includes a computer processor, an operating system operative in connection with the computer processor, and a display responsive to the operating system. The system also has a pointing device that includes a position sensor and a tactile actuator. A pointing device driver is responsive to the position sensor, and the tactile actuator is responsive to the pointing device driver. A general-purpose application is responsive to the pointing device driver and to the operating system and in communication with the display, and the pointing device driver is also responsive to the general purpose application. The system further includes a profile that maps region changes associated with material displayed on the screen to tactile signals to be sent to the tactile actuator.

Claims

1. A computer system, comprising:

a computer processor,

an operating system operative in connection with the computer processor,

a display responsive to the operating system,

a pointing device including;

a position sensor having an output line, and

a tactile actuator having an input line,

a pointing device driver responsive to the output line of the position sensor and wherein the input line of the tactile actuator is responsive to the pointing device driver,

a general-purpose application responsive to the pointing device driver and to the operating system and in communication with the display, and wherein the pointing device driver is responsive to the general purpose application, and

a profile that maps region changes associated with material displayed on the screen to tactile signals to be sent to the tactile actuator.

2. The computer system of claim 1 wherein the system is operative to detect movement from one group of regions to another and change profiles based on the detected movement.

3. The computer system of claim 2 wherein the system is further operative to send a boundary actuation command to the tactile actuator upon detecting the movement from one group of regions to another.

4. The computer system of claim 2 wherein the groups of regions correspond to different display windows.

5. The computer system of claim 1 wherein the system is operative to automatically determine a range of region attributes and normalize the intensity of the tactile signals based on this determination.

6. The computer system of claim 1 wherein the system is operative to detect a guard band surrounding transitions between regions in the map.

7. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and provide tactile signals to the tactile actuator in anticipation of changes in the regions when the speed exceeds a certain value.

8. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and simplify tactile signals to the tactile actuator when the speed meets certain criteria.

9. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and eliminate tactile signals to the tactile actuator when the speed meets certain criteria.

10. The computer system of claim 1 wherein the profile includes a storage element that specifies whether heuristics are to be applied to determine a relationship between region changes and tactile signals.

11. The computer system of claim 1 wherein the system is operative to change display attributes of a cursor displayed on the screen when the position sensor indicates a change in position.

12. The computer system of claim 1 wherein the pointing device further includes a tactility control and wherein the system is operative to send different tactile signals to the actuator in response to user actuation of the tactility control.

13. The computer system of claim 1 further including a housing and wherein the tactile actuator is a pressure-wave generating tactile actuator mounted inside a portion of the pointing device housing.

14. The computer system of claim 13 wherein the pointing device is a mouse, wherein the housing is a housing of the mouse, and wherein the transducer is mounted inside the housing of the mouse.

15. The computer system of claim 13 wherein the system is operative to send finite duration pulses to the actuator that are no longer than ten cycles long for an individual change in regions.

16. The computer system of claim 1 wherein the position sensor is in a mouse and wherein the actuator is in a mouse pad.

17. The computer system of claim 1 wherein the actuator and the position sensor are in a touch pad.

18. The computer system of claim 1 wherein the profile maps regions that match display regions displayed on the display.

19. The computer system of claim 18 wherein the profile maps regions that correspond to absolute display intensity of the display regions.

20. The computer system of claim 18 wherein the profile maps regions that are arranged in a regularly spaced Cartesian grid.

21. The computer system of claim 18 wherein the profile maps at least some of the regions to correspond to cells each containing a single alphanumeric character.

22. The computer of claim 18 wherein the system is operative to translate a difference in a property value of two of the regions into an intensity of a tactile signal.

23. The computer system of claim 1 wherein the system further includes an audio device and is operative to provide an audio signal to the audio device, and wherein information transmitted by the audio signal corresponds to information transmitted by the tactile signal.

24. A method of operating a computer, comprising:

maintaining a map of a plurality of regions corresponding to regions displayed on a display screen,

responding to signals from a pointing device to define a cursor position relative to the regions expressed in the map,

displaying a cursor in a first of the regions displayed on the display screen,

detecting a signal from a pointing device that indicates user actuation of the pointing device corresponding to a movement of the cursor from a first of the regions expressed in the map to a second of the regions expressed in the map,

sending an actuation command request signal to an actuator in the pointing device in response to the detection of user actuation in the step of detecting, and

generating a tactile signal in the pointing device in response to the actuation command.

25. The method of claim 24 wherein the steps of detecting, sending, and generating cooperate to provide actuation request signals substantially only during displacement of the pointing device, delayed by processing overhead.

26. A computer memory for use with a computer system with a tactile user interface and a window-based operating system, comprising:

a boundary descriptor stored in the memory and operative to instruct the system whether a boundary between portions of a display layout within a first of a plurality of different general-purpose application windows is to be associated with tactile attributes to be presented to the user,

a heuristic flag stored in the memory and operative to instruct the system whether to use heuristics to determine how to associate the display layout within the first window with tactile attributes, and

at least one further mapping element stored in the memory and which defines a predefined relationship between the display layout within the first window and tactile attributes.

27. The computer memory of claim 26 wherein the further mapping element is a preferred element, and further including an additional further mapping element stored in the memory, the additional further element being a default element.