Cursor control with user feedback mechanism

• US 5,973,689 A
• Filed: 10/29/1997
• Issued: 10/26/1999
• Est. Priority Date: 10/30/1996
• Status: Expired due to Term

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Gallery, Richard D.
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): Thai, Cuong T.
• Application Number:
  US08/959,783
• Time in Patent Office: 727 Days
• Field of Search: 345/145, 345/157, 345/160, 345/339, 345/347, 345/336, 345/338
• US Class Current: 715/859
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/015 Force feedback applied to a joystick
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A feedback means is provided in conjunction with a cursor control mechanism for a two- or three-dimensional graphic user interface. Feedback levels are determined by tonal variation (grey scale or color component) at the pixel (P) currently indicated by the cursor. Suitably, the levels are set by generating differentials across a patch of pixels (A) surrounding the indicated pixel, with differential generation in mutually perpendicular directions (X and Y) providing for independent feedback in two or three directions. The technique enables interface features such as window boundaries (36) or textured patches to be identified to the user without specially authored software being required for those features to trigger feedback when indicated.

Claims

1. A cursor control system for controlling a cursor on a pixel display, comprising:

a control means for generating cursor control signals and transmitting said cursor control signals to said display;

a feedback means for indicating to an operator of said cursor control device a parameter setting; and

monitoring means arranged to determine a tone level for at least a first pixel of the display overlaid by the cursor, said parameter setting indicated to the user being derived by feedback control means at least partly from the determined tone level.

2. Apparatus as claimed in claim 1, wherein the feedback means is operable to output a continuously varying feedback level directly determined by the instantaneous tone level.

3. Apparatus as claimed in claim 1, wherein the monitoring means is arranged to determine tone level in one or more further areas surrounding the first area, to determine a differential for tone variation in at least one direction across the first and further areas, and to generate the feedback to the user at a level determined by the instantaneous differential.

4. Apparatus as claimed in claim 3, wherein the monitoring means is arranged to determine differentials in two mutually perpendicular directions across the first and further areas, and the feedback means comprises two independently operated feedback means respectively indicating tone variation in the two directions.

5. Apparatus as claimed in claim 3, wherein the monitoring means includes cursor pixel storage means arranged to maintain a record of overwritten display pixel values, and the differential for tone variation is derived from the tone variation along the line of the cursors recent movement.

6. Apparatus as claimed in claim 1, wherein the display represents a three-dimensional computer-generated environment and the cursor is an icon movable under user control in said three dimensions, the apparatus including collision detection means operable to determine when the cursor is in contact with features of the virtual environment, with the feedback means becoming operable while such contact is maintained.

7. Apparatus as claimed in claim 1, wherein the feedback means includes force generation means arranged to apply a force to the body of a user of the apparatus at a level determined by a predetermined external condition and modulated by an amount derived from the determined tone level.

8. A computer system, comprising:

a pixel display for displaying a cursor;

a host computer coupled to said pixel display;

cursor control means for generating cursor control signals coupled to said host computer,

said host computer receiving said cursor control signals, generating cursor display signals and sending said cursor display signals to said pixel display, and

said cursor control means comprising a feedback means for indicating to an operator of said cursor control means a parameter setting; and

monitoring means arranged to determine a tone level for at least a first pixel of the display overlaid by the cursor, said parameter setting indicated to the user being derived by feedback control means at least partly from the determined tone level.

9. Apparatus as claimed in claim 8, wherein the tone level determined is the grey level for the said at least one pixel.

10. Apparatus as claimed in claim 8, wherein the tone level determined is the level of one or more pixel color components for the said at least one pixel.

11. Apparatus as claimed in claim 8, wherein the feedback means operates when the determined tone level exceeds a first threshold value.

12. Apparatus as claimed in claim 8, wherein the feedback means is operable to output a continuously varying feedback level directly determined by the instantaneous tone level.

13. Apparatus as claimed in claim 8, wherein the monitoring means is arranged to determine tone level in one or more further areas surrounding the first area, to determine a differential for tone variation in at least one direction across the first and further areas, and to generate the feedback to the user at a level determined by the instantaneous differential.

14. Apparatus as claimed in claim 13, wherein the monitoring means is arranged to determine differentials in two mutually perpendicular directions across the first and further areas, and the feedback means comprises two independently operated feedback means respectively indicating tone variation in the two directions.

15. Apparatus as claimed in claim 13, wherein the monitoring means includes cursor pixel storage means arranged to maintain a record of overwritten display pixel values, and the differential for tone variation is derived from the tone variation along the line of the cursors recent movement.

16. Apparatus as claimed in claim 8, wherein the display represents a three-dimensional computer-generated environment and the cursor is an icon movable under user control in said three dimensions, the apparatus including collision detection means operable to determine when the cursor is in contact with features of the virtual environment, with the feedback means becoming operable while such contact is maintained.

17. Apparatus as claimed in claim 8, wherein the feedback means includes force generation means arranged to apply a force to the body of a user of the apparatus at a level controlled by the determined tone level.

18. Apparatus as claimed in claim 8, wherein the feedback means includes force generation means arranged to apply a force to the body of a user of the apparatus at a level determined by a predetermined external condition and modulated by an amount derived from the determined tone level.

19. Apparatus as claimed in claim 8, further comprising audio feedback means arranged to generate a user-audible indication of the determined cursor pixel tone level.