Multiuser/multi pointing device graphical user interface system

• US 5,694,150 A
• Filed: 09/21/1995
• Issued: 12/02/1997
• Est. Priority Date: 09/21/1995
• Status: Expired due to Term

• Current Assignee: Elo Touch Solutions, Inc.
• Original Assignee: Elo Touchsystems Incorporated (Elo Touch Solutions, Inc.)
• Inventors: Winner, Anthony, Sigona, Michael R.
• Primary Examiner(s): Liang, Regina D.
• Assistant Examiner(s): Osorio, Ricardo
• Application Number:
  US08/531,426
• Time in Patent Office: 803 Days
• Field of Search: 345/145, 345/146, 345/157, 345/160, 395/340, 395/650
• US Class Current: 715/856
• CPC Class Codes: G06F 2200/1632 Pen holder integrated in the computer
• CPC Class Codes: G06F 2203/0382 Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls

Abstract

A graphical user interface system is provided having an event-driven control program with a unified user input pointing event stream without distinction of source and a graphical user interface having a virtual display space containing objects. The control program processing events related to a plurality of user inputs representing different locations within the virtual display space, and operates optionally in two modes. A first mode permits the plurality of user inputs to interact, allowing an object in the virtual display space at a first location specified by an initial user input to be associated with a second location specified by a concurrent and subsequently terminating user input. In this case, the control program has a counter which increments on activity of any user input and decrements on cessation of activity of any user input, for determining an initial user input condition, temporal concurrence of a plurality of user inputs, and a terminal user input condition. A second mode processes a series of events related to a first user input without apparent functional interference with a concurrent series of events related to a second user input.

Claims

1. In a computer system including a processor, and employing a graphic user interface having a virtual display space, executing an event-driven control program, with a unified user pointing input event stream processing system, the improvement comprising:

the control program receiving at least first and second user inputs representing different locations within said virtual display space, each of said user inputs being associated with the production of events of said control program and being processed without distinction between said first user input and said second user input; and

said control program having an operational mode for processing a series of events related to a first user input without apparent functional interference with a concurrent series of events related to a second user input.

2. The computer system according to claim 1, wherein said event-driven control program is a graphical user interface system selected from the group consisting of Windows, Windows for Workgroups, Windows NT, Windows 95, OS/2 and Macintosh operating system.

3. The computer system according to claim 1, further comprising a plurality of displays, each displaying a portion of the virtual display space.

4. The computer system according to claim 3, wherein at said plurality of displays each display a differing portion of the virtual display space.

5. The computer system according to claim 1, wherein at least one of said user inputs comprises absolute position coordinates.

6. The computer system according to claim 5, wherein said user input receives absolute position coordinates from a touch-sensitive device superimposed on said display, so that a touch directed at a corresponding display location of said touch sensitive device directs a cursor to said display location.

7. The computer system according to claim 5, wherein said user input receives absolute position coordinates from a touchscreen.

8. The computer system according to claim 1, comprising at least two display devices, each displaying a differing portion of said virtual display space, and at least two user input devices.

9. The computer system according to claim 1, further comprising a plurality of display devices, each having an associated user input, wherein each display and associated user input set are provided with equivalent capabilities.

10. The computer system according to claim 1, wherein said virtual display space includes a plurality of objects, each user input being associated with one of said objects.

11. The computer system according to claim 10, wherein said plurality of objects comprises a plurality of application windows.

12. The computer system according to claim 10, wherein said control program supports applications having application windows, an application associated with an application window receiving events from the control program and further processing events relating to a user input associated with said application window.

13. The computer system according to claim 1, further comprising a plurality of displays, each displaying a differing portion of said virtual display space, said control program responding to WIN16, WIN32 or OS/2 API syntax.

14. The computer system according to claim 1, further comprising:

a processor, having;

a counter;

a memory for storing a state of said counter;

means for incrementing said counter upon an activate input status from any of said inputs and decrementing said counter upon an inactivate input status from any of said inputs;

point mode means for generating cursor move to said position, button down and button up messages in sequence if said counter is incremented; and

means for updating said stored state of said counter.

15. The computer system according to claim 1, further comprising:

a processor, having;

a counter;

a memory for storing a state of said counter;

means for incrementing said counter upon an activate input status from any of said inputs and decrementing said counter upon an inactivate input status from any of said inputs;

drag mode means for generating a button up message if said counter transitions to a value of zero, generating a button down message if said counter transitions to a value of one and said stored initial state transitions to a value of zero, and otherwise maintaining a button down message state; and

means for updating said stored state of said counter.

16. The computer system according to claim 1, further comprising a system for converting an output of a relative pointing position user input to a display coordinate position, and a system for displaying a user cursor, based on said relative pointing position user input and independent of said control program, on said display.

17. An event-driven graphical user interface system having a virtual display space including a plurality of objects, comprising:

a user input interface, being responsive to a plurality of user inputs from identified user input devices, said user inputs each being associated with at least one object, and being associated with the production of events substantially undistinguished by a user input device identification;

said interface system having a mode for processing a time series of events related to a first user input relating to a first object and a concurrent time series of events related to a second user input relating to a second object, without mutual interference.

18. The event-driven graphical user interface according to claim 17, further comprising a control program for controlling said graphical user interface, having a single system cursor, a system for converting events generated by an output of a relative pointing position user input to a display coordinate position, and a system for displaying a user cursor, based on said relative pointing position user input and independent of said system cursor, on said graphical user interface.

19. An event-driven graphical user interface system having a unified virtual display space including a plurality of objects, comprising:

a user input interface producing events relating to a plurality of user inputs from at least one identified user input device;

said interface system concurrently processing a series of events substantially without reference to an user input device identification, related to a first of said plurality of user inputs and a series of events related to a second of said plurality of user inputs, without mutual interference.

20. The event-driven graphical user interface according to claim 19, wherein said interface system has a single system cursor, further comprising a system for converting events generated by an output of a relative pointing position user input to a display coordinate position, and a system for displaying a user cursor, based on said relative pointing position user input and independent of said system cursor, on said graphical user interface.

32. The event-driven graphical user interface according to claim 19, wherein:

each event is associated with a location and a touch status within said virtual display space independent of other inputs;

said interface system having a mode for processing a series of events associated with a plurality of different inputs, wherein an object at a location associated with an initial input is transferred to a location associated with a coexistent terminal input, comprising a counter for tracking a touch status to determine a beginning of said initial input and an end of said terminal input.

21. An input processor for a graphical user interface system having a unified virtual display space, comprising:

an input for receiving inputs from a plurality of user pointing device inputs, defining a position and an input status; and

a processor, having;

a counter;

a memory for storing a state of said counter;

means for incrementing said counter upon an activate input status from any of said inputs and decrementing said counter upon an inactivate input status from any of said inputs;

point mode means for generating cursor move to said position, button down and button up messages in sequence if said counter is incremented; and

means for updating said stored state of said counter.

22. The system according to claim 21, wherein said processor further comprises:

means for selecting a mode of operation, selecting between said point mode means; and

drag mode means for generating a button up message if said counter transitions to a value of zero, generating a button down message if said counter transitions to a value of one and said stored initial state transitions to a value of zero, and otherwise maintaining a button down message state.

23. The system according to claim 21, wherein said processor further comprises a control program having a system cursor, a system for converting said relative position pointing device input to a display coordinate position, and a system for displaying a user cursor, based on said relative position pointing device input and independent of said system cursor, in said unified virtual display space.

24. An input processor for a graphical user interface system having a unified virtual display space, comprising:

an input for receiving inputs from a plurality of user pointing device inputs, defining a position and an input status; and

a processor, having;

a counter;

a memory for storing a state of said counter;

means for incrementing said counter upon an activate input status from any of said inputs and decrementing said counter upon an inactivate input status from any of said inputs;

drag mode means for generating a cursor move to said position and button down message in sequence if said counter transitions to one, generating a button up message if said counter transitions to a value of zero, and otherwise maintaining a drag state with move with button down messages; and

means for updating said stored state of said counter.

25. The system according to claim 24, wherein said processor further comprises:

means for selecting a mode of operation, selecting between said drag mode means and point mode; and

means for generating "cursor move to said position", "button down" and "button up" messages in sequence if said counter is incremented.

26. The system according to claim 24, wherein said processor further comprises a control program having a system cursor, a system for converting said relative position pointing device input to a display coordinate position, and a system for displaying a user cursor, based on said relative position pointing device input and independent of said system cursor, in said unified virtual display space.

27. In a graphical user interface system having an event-driven control program with a unified user input pointing event stream without distinction of source and a graphical user interface having a virtual display space containing objects, the improvement comprising:

the control program processing events related to a plurality of user inputs representing different locations within the virtual display space;

the control program having one or more modes selected from the group consisting of;

(a) an operational mode for permitting said plurality of user inputs interact to allow an object in the virtual display space at a first location specified by an initial user input to be associated with a second location specified by a concurrent and subsequently terminating user input, the control program having a counter which increments on activity of any user input and decrements on cessation of activity of any user input, for determining an initial user input condition, temporal concurrence of a plurality of user inputs, and a terminal user input condition; and

(b) a second operating mode for processing a series of events related to a first user input without apparent functional interference with a concurrent series of events related to a second user input.

28. The graphical user interface system according to claim 27, wherein the control program includes both mode (a) and mode (b).

29. The graphical user interface system according to claim 27, wherein the control program includes mode (a).

30. The graphical user interface system according to claim 27, wherein the control program includes mode (b).

31. The graphical user interface system according to claim 30, wherein the control system comprises a counter, incrementing on occurrence of an event related to a user input and decrementing on cessation of an event related to a user input.