Workstation conference pointer-user association mechanism

• US 6,072,463 A
• Filed: 04/17/1995
• Issued: 06/06/2000
• Est. Priority Date: 12/13/1993
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Glaser, Howard Justin
• Primary Examiner(s): CHANG, KENT WU
• Application Number:
  US08/425,309
• Time in Patent Office: 1,877 Days
• Field of Search: 379/262, 395/200, 395/153, 395/155, 395/157, 395/159, 395/160, 395/650, 395/800, 345/145, 345/157, 345/163, 345/2, 345/330, 345/329, 345/333, 345/334, 345/335, 348/15, 364/228.3, 364/228.4
• US Class Current: 715/753
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

A conference communication system that includes multiple user terminals, each of which includes a display screen with a common working area, provides each user with a pointer icon that can be moved across all the display screens with a pointing device, provides the display screen of each user with a representation of all the conference participants, and, for each user, displays a line connecting each pointer icon of the other conference participants to the displayed representation of the user controlling the icon. Each user controls a pointer icon with a display mouse device having buttons, and the pointer icon and line connecting a user with the user'"'"'s pointer icon is only displayed on the screens of the other conference participants if the user has pressed and held down a button of the user'"'"'s mouse device. In this way, each user has control of a pointer icon and each pointer icon is readily associated with the user controlling it, while the number of objects displayed in the work area is kept to a minimum.

Claims

1. A communication conference support system for use with a first workstation of a computer system having a plurality of user workstations connected over a network and participating in a conference, including at least the first user workstation and a second user workstation, each workstation having a display device with a display screen on which is displayed a pointer icon and a mouse pointer device that controls movement of the pointer icon on the display device as the mouse pointer device is moved and that includes a mouse button, the support system of the first workstation comprising:

position means for generating a signal that indicates the position of the pointer icon on the display device of the first user workstation and indicates the status of the workstation mouse button;

picture means for generating a representation of the system users in a conference window of the display device of the first user workstation;

designator means for generating a signal that identifies the first user workstation and indicates the location of the pointer icon and system user representation on the display device of the first user workstation;

a system interface that receives the position means signal, picture means representation, and designator means signal of the first workstation and arranges them in an information packet for transmission over the network; and

association means for receiving an information packet containing a position means signal, picture means representation, and designator means signal from the second workstation and any other workstations connected to the network and participating in the conference, and for drawing a line on the display device of the first user workstation connecting the display device location of a pointer icon identified by the designator means signal to the representation of the corresponding system user generated by the picture means signal for the second workstation and for all other conference participating user workstations of the system, thereby displaying a connecting line between the representations of all conference participants and their respective pointer icons except for the representation of a viewing participant and that participant'"'"'s pointer icon.

2. A system as defined in claim 1, wherein the picture means comprises a workstation video camera that generates a video image of the first workstation user and provides it to the association means for transmission to all conference participant workstations.

3. A system as defined in claim 2, wherein the picture means generates a digital representation of the video image.

4. A system as defined in claim 1, wherein the position means comprises a network message information packet.

5. A system as defined in claim 4, wherein the information packet includes a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse button status.

6. A system as defined in claim 5, wherein the data field further provides the mouse pointer icon location on the display device of the respective workstation.

7. A system as defined in claim 6, wherein the data field further provides conference window position information.

8. A system as defined in claim 1, wherein the network server maintains a conference participant table that contains an identification of each workstation participating in the conference and of the mouse pointer icon location on the display device of the respective workstation.

9. A system as defined in claim 8, wherein each workstation generates a network information packet message when the mouse button of its respective mouse device is pressed, the information packet including a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse button status.

10. A system as defined in claim 9, wherein the data field further provides the mouse pointer icon location on the display device of the respective workstation.

11. A system as defined in claim 10, wherein the data field further provides conference window position information.

12. A system as defined in claim 8, wherein each workstation generates a network information packet message when the mouse button of its respective mouse device is pressed, the information packet including a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse pointer icon location.

13. A system as defined in claim 1, wherein the designator means comprises a conference participant table maintained by the network server.

14. A system as defined in claim 1, wherein the association means comprises a workstation conference interface.

15. A system as defined in claim 14, wherein the conference interface displays a pointer arrow on the display devices of the remaining conference participants that is different in appearance from the mouse pointer icon of the button pressing first conference participant.

16. A video conference support system for use in a first user workstation and at least a second user workstation connected by a network server that controls communications between the workstations, each user workstation having a video display device with a display screen on which is displayed a pointer icon and having a mouse pointer device that includes a mouse button and controls movement of the pointer icon on the display device as the mouse pointer device is moved, the conference support system comprising:

an image generator in each workstation that provides a video representation signal of the user at each system workstation;

a communication interface in each workstation that digitizes the video representation signal provided by each respective image generator and that transmits information packets over the network;

a pointer icon indicator in each workstation that generates a signal indicating the position of the pointer icon on the display device of each respective user workstation as the pointer icon of the user workstation is moved;

a mouse device detector in each workstation that generates a signal identifying each respective user workstation and pointer icon location on the display device when the pointer button of the respective user workstation is pressed;

a line generator in each user workstation that draws respective lines on the display device of the respective user workstation that connects a pointer icon identified by the button detector of each other respective workstation to the representation of the corresponding user of the workstation generated by the image generator for all of the other user workstations of the system; and

a conference interface in each workstation that generates information packets containing the user workstation identification and mouse pointer icon position information when a user presses the mouse button of the user'"'"'s workstation mouse device.

17. A system as defined in claim 16, wherein the network server maintains a conference participant table that contains an identification of each workstation participating in the conference and of the mouse pointer icon location on the display device of the respective workstation.

18. A system as defined in claim 16, wherein each workstation responds to pressing of its respective mouse button by generating a network information packet that includes a header field identifying a message source workstation and a message target workstation and a data field providing the mouse button status.

19. A system as defined in claim 18, wherein the data field further provides the mouse pointer icon location on the display device of the respective workstation.

20. A system as defined in claim 19, wherein the data field further provides conference window position information.

21. A system as defined in claim 16, wherein each workstation generates a network information packet message when the mouse button of its respective mouse device is pressed, the information packet including a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse pointer icon location.

22. A method of maintaining communications between users at conference workstations of a network, wherein each workstation in the network includes a display device on which is displayed a conference window having a pointer icon and includes a mouse pointer device having a mouse button and controlling a pointer icon on the display device as the workstation mouse pointer device is moved, the method comprising the steps of:

generating a display representation of each conference participant;

displaying the conference participant representations in the conference window of the display device of each conference participant workstation;

determining when a first conference participant has pressed the mouse button of the participant'"'"'s workstation mouse device;

determining the display device location of the pointer icon of the button pressing first conference participant at the time of the button pressing; and

displaying a pointer arrow in the conference window of the display devices of all the remaining conference participants extending from each respective display device representation of the button pressing first conference participant to the determined pointer icon location of the button pressing first conference participant, thereby displaying a connecting line between the representations of all conference participants and their respective pointer icons except for the representation of a viewing participant and that participant'"'"'s pointer icon.

23. A method as defined in claim 22, further including the step of maintaining a conference participant table that contains an identification of each workstation participating in the conference and of the mouse pointer icon location on the display device of the workstation.

24. A method as defined in claim 22, wherein the step of determining the pressing of a mouse button comprises generating a network information packet message including a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse button status.

25. A method as defined in claim 24, wherein the step of determining the display device pointer icon location comprises generating a network information packet that further comprises generating a data field that also provides the mouse pointer icon location.

26. A method as defined in claim 24, wherein the step of generating a data field further comprises providing conference window position information in the data field.

27. A method as defined in claim 22, wherein the step of determining the display device pointer icon location comprises generating a network information packet message including a header field that identifies a message source workstation and a message target workstation and a data field that provides the mouse pointer icon location.

28. A method as defined in claim 22, wherein the step of displaying a pointer arrow comprises displaying a pointer arrow on the display devices of the remaining conference participants that is different in appearance from the mouse pointer icon of the button pressing first conference participant.

29. A method as defined in claim 22, wherein the step of generating a representation of each conference participant comprises producing a video image of each conference participant and transmitting the video images over the network to the workstation of each conference participant.

30. A method as defined in claim 29, wherein the step of producing a video image comprises generating a digital representation of the video image.

31. A communication conference support system for use with a first workstation that communicates with a plurality of other workstations under control of a network server while participating in a network conference, each user conference workstation having a display device on which is displayed a pointer icon of the respective workstation and a mouse pointer device that controls movement of the pointer icon on the display device as the mouse pointer device is moved and that includes a mouse button;

the support system of the first workstation comprising;

position means for generating a signal that indicates the position of the pointer icon on the display device of the first workstation and indicates the status of the mouse button;

an image capture device that generates a representation of the user at the first workstation;

designator means for generating a signal that identifies the user at the first workstation and indicates the location of a pointer icon and a workstation representation displayed on the display device of the first workstation; and

association means for drawing a line on the display device of the first workstation that connects the pointer icon of each respective other workstation identified by the designator means to the representation of the corresponding workstation.

32. A system as defined in claim 31, wherein the image capture device comprises a workstation video camera that generates a video image signal of the first workstation user and provides it to the network server for transmission to all respective other communicating workstations.

33. A system as defined in claim 32, wherein the image capture device generates a digital representation of the video image signal.

34. A system as defined in claim 31, wherein the position means comprises a network message information packet.

35. A system as defined in claim 34, wherein the information packet includes a header field that identifies the first workstation as the source workstation, identifies a message target workstation, and includes a data field that provides the mouse button status of the first workstation.

36. A system as defined in claim 35, wherein the data field further provides the mouse pointer icon location on the display device of the first workstation.

37. A system as defined in claim 36, wherein the data field further provides conference window position information.

38. A system as defined in claim 31, wherein the association means comprises a workstation conference interface.

39. A communication conference support system for use in a first workstation that communicates with a plurality of respective other conference participating workstations through a network server that controls communications between the workstations, the first and respective other workstations each having a display device on which is displayed a pointer icon and a mouse pointer device that controls movement of the pointer icon on the display device as the mouse pointer device is moved and that includes a mouse button;

the conference support system of the first workstation comprising;

an image generator that provides a video representation of the user at the first workstation;

a communication interface that digitizes the video representation provided by the image generator and that transmits information packets over the network;

a pointer icon indicator that generates a signal indicating the position of the pointer icon on the display device of the first workstation as the pointer icon is moved;

a mouse device detector that generates a signal identifying the first workstation and the pointer icon location on the display device of the first workstation when the pointer button of the first workstation is pressed;

a conference interface that generates information packets containing the first workstation identification and mouse pointer icon position information when the first workstation user presses the mouse button of the first workstation mouse device and receives corresponding information packets from the respective other workstations; and

a line generator that draws a line on the first workstation display device that connects the pointer icon identified by the button detector to the representation of the corresponding system user generated by the image generator.

40. A system as defined in claim 39, wherein the first workstation generates a network information packet message when the mouse button of the first workstation mouse device is pressed, the information packet including a header field that identifies the first workstation as the source workstation and identifies a message target workstation and includes a data field that provides the mouse pointer icon location.

41. A method of maintaining conference communication by a first workstation participating with respective other workstations of a network during a user conference, wherein each workstation includes a display device on which is displayed a conference window with a pointer icon and a mouse pointer device that includes a mouse button and controls movement of the pointer icon as the first workstation mouse pointer device is moved, the method comprising the steps of:

generating a signal representation of each conference participant workstation user for display on the first workstation and respective other workstation display devices;

displaying the conference participant representations in the conference window of the first workstation and respective other workstation display devices;

determining when one of the other respective conference participants has pressed the mouse button of that participant'"'"'s workstation mouse device;

determining the display device pointer icon location of the button pressing conference participant; and

displaying a pointer arrow on the display device of the first workstation from the display device representation of the button pressing conference participant to the determined display pointer icon location of the button pressing conference participant.

42. A method as defined in claim 41, wherein the step of determining when a conference participant has pressed the mouse button comprises generating a network information packet message including a header field that identifies the respective other user workstation as the message source and identifies a message target workstation and includes a data field that provides the mouse button status.

43. A method as defined in claim 42, wherein the step of determining the display device pointer icon location comprises the step of generating a network information packet that includes a data field that indicates the mouse pointer icon location.

44. A method as defined in claim 43, wherein the step of generating a data field further comprises providing conference window position information in the data field.

45. A method as defined in claim 42, wherein the step of determining the display device pointer icon location comprises the step of generating a network information packet message including a header field that identifies the message source workstation and identifies a message target workstation and a data field that provides the mouse pointer icon location.

46. A method as defined in claim 41, wherein the step of generating a signal representation of each conference participant comprises producing a video image of the conference participant and providing it over the network to each workstation.

47. A method as defined in claim 46, wherein the step of producing a video image comprises generating a digital representation of the video image.

48. In a system having a first workstation and a plurality of other workstations comprising a network, the workstations communicating with each other during a user conference, wherein each workstation includes a display device on which is displayed a conference window with a representation of a user at each workstation, a pointer icon, and a mouse pointer device that includes a mouse button and controls movement of the pointer icon as the first workstation mouse pointer device is moved, a method of associating the pointer icons of the respective user representations on the display with the respective user representations, the method comprising the steps of:

generating a signal representation of each workstation user for display on the first workstation and respective other workstation display devices;

displaying the conference participant representations in the conference window of the first workstation and respective other workstation display devices;

determining when one of the respective conference participants other than the user at the first workstation has pressed the mouse button of that participant'"'"'s workstation mouse device;

determining the display device pointer icon location of the button pressing conference participant; and

displaying a pointer arrow on the display device of the first workstation from the display device representation of the button pressing conference participant to the determined display pointer icon location of the button pressing conference participant, thereby displaying a connecting line between the representations of all conference participants and their respective pointer icons except for the representation of a viewing participant and that participant'"'"'s pointer icon.

49. A method as defined in claim 48, wherein the step of determining when a conference participant has pressed the mouse button comprises generating a network information packet message including a header field that identifies the respective other user workstation as the message source and identifies a message target workstation and includes a data field that provides the mouse button status.

50. A method as defined in claim 49, wherein the step of determining the display device pointer icon location comprises the step of generating a network information packet that includes a data field that indicates the mouse pointer icon location.

51. A method as defined in claim 50, wherein the step of generating a data field further comprises providing conference window position information in the data field.

52. A method as defined in claim 49, wherein the step of determining the display device pointer icon location comprises the step of generating a network information packet message including a header field that identifies the message source workstation and identifies a message target workstation and a data field that provides the mouse pointer icon location.

53. A method as defined in claim 48, wherein the step of generating a signal representation of each conference participant comprises producing a video image of the conference participant and providing it over the network to each workstation.

54. A method as defined in claim 53, wherein the step of producing a video image comprises generating a digital representation of the video image.