Method for real-time on-demand interactive graphic communication for computer networks

• US 5,886,707 A
• Filed: 06/27/1996
• Issued: 03/23/1999
• Est. Priority Date: 11/20/1990
• Status: Expired due to Fees

• Current Assignee: David A. Berg
• Original Assignee: David A. Berg
• Inventors: Berg, David A.
• Primary Examiner(s): Hong, Stephen S.
• Application Number:
  US08/670,525
• Time in Patent Office: 999 Days
• Field of Search: 395/200.34, 395/200.6, 395/200.31, 395/133, 395/329, 395/330, 395/331, 395/335, 395/610
• US Class Current: 345/619
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

The simultaneous, real time graphical information is shared between two or more intelligent work stations linked together in conversation via a network. Transmission of the essence of a graphical image is accomplished by fixed and variable length portions. The fixed portion describes the type of command and the size or length of the variable length portion. The variable length portion describes the detailed information need to properly process. Thus, the complete length of data is known a priori. While a network is constipated or congested and a drawing operation is being performed by a user, the communication endpoints are configured as non-blocking, commands are stored in a FIFO (first-in, first-out) queue, and the operating system reports how much of the drawing operation was transferred. After the network becomes unconstipated, writing of any partially written command or stored commands in the queue are completed. The graphical image may be displayed in a window or canvas designated for drawing. By transmitting the parameters defining the object and its commands, the speed of the transmission is increased over pixel-by-pixel transmission.

Claims

1. A method for the real-time intercommunication of information between at least any two computers among a plurality of networked computers, wherein each said computer may be a different type of computer including computers having different processor and system architecture, computers running different operating systems, and computers running different application program for generating and displaying said information, said method comprising:

executing, within each said networked computer, a computer program that controls operations within said networked computer, said computer program being adapted to control operations within each said networked computer;

each said computer adapted to transmit information in real time to any other of said computers as said information change;

each said computer adapted to asynchronously receive said information in real-time that is transmitted from any other of said computers without said receiving computer request said information;

said computer program of each said networked computer having a particular memory storage area reserved for storing information received from any particular one of each other of said networked computers;

said information received from said any particular one of said computers being stored in said memory storage area upon receipt and being retained in said memory until itercommunication between said computers is terminated so that there is no need to retransmit any of said information once received;

said computer program executing in each said networked computer having said memory storage area designated for each said networked computer, so that information received from each networked computer will be separately stored in the receiving computer for recall and usage by said receiving computer;

each said computer program associated with each said networked computer including a protocol which may be different for each said computer to promote the interpretation of information received from any of said networked computers.

2. A method as described in claim 1, wherein each said protocol includes a plurality of commands, each said command having a fixed length portion and a variable length portion.

3. A method as described in claim 2, wherein said variable length portion of said command includes a fixed length subportion and a variable length subportion,

said fixed length subportion including information regarding the identification of a particular object and information identifying the length of said variable length portion, and

wherein said variable length subportion contains information regarding parameters which define or identify said object.

4. A method as described in claim 2, wherein said variable length portion of at least one of said commands consists of information identifying the object and parameters describing a detail of an operation upon said object.

5. A method as described in claim 2, wherein each said networked computer includes an identical protocol having identical commands having an object identifier and an operation identifier and object description parameters so that information regarding the display or processing operation upon an object may be conveyed between said networked computers on an object-by-object basis by means of said commands.

6. The method in claim 1, wherein said information receiving computer is coupled to said network in a client-to-client manner to asynchronously receive information from a different computer on said network without having made a request for said information.

7. The method in claim 6, each said computer on said network exchanges information with at least one other computer on said network including performing an initial parameter exchange with said at least one other computer comprising the steps of exchanging a list of other computers already involved in said information exchange.

8. The method in claim 7, further comprising exchanging the program identity and program revision level each computer is using, and exchanging details such as the size of the canvas (virtual drawing area) each is computer is using locally.

9. The method in claim 6, wherein said information receiving computer is coupled to said network during an interactive session in a client-to-client manner.

10. The method in claim 1, further comprising adding a new computer to the interactive conversational session and for each newly added computer, sending to said newly added computer a complete description of all objects on the screen of each other one of said computers already involved in said conversation so that new computers not previously involved with said conversation can be included in the conversation in a real-time on-demand basis, and so that all information is available to represent said information.

11. The method in claim 1, wherein said computer program executing in at least a first one of said computers further performs the steps of:

receiving the input of an item of information into said first one of said plurality of computers;

reducing each said item of information to an object description at the time said item is received, said object description comprising a description of said information item and an identifier assigned to said item minimal set of descriptors as said item is input;

formulating a command comprising said object description and a manipulative object operation;

transmitting said command over said network to other ones of said plurality of computers engaged in interactive conversation with said first computer;

receiving said transmitted command by said other ones of said plurality of computers engaged in interactive conversation with said first computer;

storing said information in said command in memory of said other ones of said plurality of computers engaged in interactive conversation with said first computer, said memory portion being temporarily associated exclusively with information received from transmitting computer; and

displaying said information from said command on the local display of said other one of said computers.

12. The method in claim 11, wherein each command involves a division of instructions into a command type portion having a fixed length and a variable length portion, in order to transmit data structures that describe objects and operations on those objects.

13. The method in claim 12, wherein said description and transmission uses object descriptors in a plurality of commands which describe the type of object manipulation that is being conducted, the object upon which it is being conducted and the location of the screen display bits at which it is being conducted, such that each of the computers in the network are provided with sufficient information to replicate the information production of the generating computers, and wherein said description is substantially a non-pixel-by-pixel representation of said information such that the representation increases the speed with which said information may be transmitted as compared to a pixel-by-pixel representation.

14. The method in claim 13, wherein said commands comprise commands for creation, resizing, moving, aggregating, and deleting an object.

15. The method in claim 14, wherein said command for creating comprises sending an indication to every computer engaged in said conversation that an object has been created on the transmitting computer;

said indication of creation comprising sending a description of the object, and a unique object identifier, said object identifier being used in a subsequent reference to said object if any;

upon receiving said indication by each said other computer, each said other computer adding said object to the list of objects it maintains in memory for said generating computer and drawing that object on its screen that represents the output of said generating computer; and

wherein when said operation is a move object type command, constructing a command specifying the object identifier of the object moved, and the relative displacement of the new location of the object;

transmitting said move object command to said other computers; and

upon receipt of said command by said receiving computer, recalling said object based on said stored object identifier, and updating the object location maintained in the object description data structure in memory of said receiving computer, erasing the depiction of the object in the old location, and redrawing the depiction of the object in the new location; and

wherein when said operation is a resize object type command, constructing a command specifying the object identifier of the object, and information describing the new object size and shape;

transmitting said resize object command to said other computers; and

upon receipt of said command by said receiving computer, recalling said object based on said stored object identifier, and updating the object size information maintained in the object description data structure in memory of said receiving computer, erasing the depiction of the object in the old location, and redrawing the depiction of the resized object; and

wherein when said operation is a delete object type command, constructing a command specifying the object identifier of the object;

transmitting said delete object command to said other computers; and

upon receipt of said command by said receiving computer, recalling said object based on said stored object identifier, erasing the depiction of the object from the screen, and removing the object from the generating computer'"'"'s list of objects; and

freeing the memory associated with said deleted object; and

wherein when said operation is an aggregate object type command, constructing a command specifying the object identifier of the objects to be combined, and information describing the aggregation;

transmitting said aggregate object command to said other computers; and

upon receipt of said command by said receiving computer, recalling said objects based on said stored object identifiers for each object to be combined, and adding said aggregate object to the list of objects for said generating computer, and deleting the objects from which said aggregate object has been created; and

wherein when said operation is a disaggregate object type command, constructing a command specifying the object identifier of the aggregate objects to be separated, and information describing the disaggregation;

transmitting said disaggregate object command to said other computers; and

upon receipt of said command by said receiving computer, recalling said object based on said stored object identifier, and adding as independent objects to the list of objects for said generating computer, and deleting the object from which said dis aggregate object has been created.

16. The method in claim 12, wherein said variable length portion includes an object identifier.

17. The method in claim 12, wherein said variable length portion includes an object description.

18. The method in claim 12, wherein said variable length portion includes a command.

19. The method in claim 12, wherein said description and transmission uses object descriptors in a pluality of commands which describe the manipulation that is being conducted and the information upon which it is being conducted, such that each of the computers in the network are provided with sufficient information to replicate the information on the generating computer, and wherein said description has operational benefits including increases the speed with which said information may be transmitted and providing computer architecture, computer hardware and computer operating system independence.

20. The method in claim 19, wherein said information is graphical information, each command involves a division of instructions into a command type portion having a fixed length and a graphical object description portion having a variable length portion, said description uses object descriptors in a plurality of commands which describe the type of graphical object manipulation that is being conducted, the type of graphical object upon which it is being conducted and the location of the screen display bits at which it is being conducted, such that each of the computers in the network are provided with sufficient information to replicate the graphical information production of the generating computer, and wherein said description is substantially a non-pixel-by-pixel representation of said information such that the representation.

21. The method in claim 1, further comprising generating said graphical information within one of said computers, wherein said generation comprises.

defining a graphical object in terms of predetermined object dependent information;

reducing said information to a minimal object description and passing an object identifier to said object;

combining said object description and object identifier information into an add new object command;

transmitting said new object command via the network to all other computers engaged in the interactive conversation; and

when said other computers in the conversation receive the information over the network, each said computer storing said information in a portion of memory reserved for information received from said particular computer.

22. The method in claim 21, further comprising preventing a receiving computer from modifying a received information on the computer which transmitted the information, but allowing said receiving computer to copy said information from memory and modify said copied information.

23. The method in claim 22, further comprising, when a first computer copies the information of another computer to the local memory of said first computer and depicts said information on the local display of said first computer, removing the preexisting drawing depiction of said information from the local display.

24. The method in claim 23, further comprising, prior to removing said preexisting drawing, storing the sequence of commands that were utilized to create the to be erased drawing in memory storage for subsequent retrieval and use.

25. The method in claim 21, further comprising depicting said stored information from the command on the local display in an area designated for said depiction.

26. The method in claim 1, wherein said method providing greater concession by parametrically describing each information instead of a bit-mapped representation and thereby reducing the amount of data to transmit over said network.

27. The method in claim 1, wherein said information comprises graphical information.

28. The method in claim 1, wherein said real-time inter communication between said plurality of networked computers is accomplished by multi-casting over said network, said multi-casting including transmit said information to at least one other of said computers but fewer than all of said networked computers.

29. The method in claim 1, wherein said method further comprises:

generating, by one of said computers, an animated sequence of graphical information by defining a set of objects;

providing commands which describe manipulations of said objects, said manipulations including movements of said objects and changes to said objects, said changes to said objects including removal, resizing, and rotation.

30. The method in claim 1, wherein said information is a graphical information, said method further comprising parametrically describing each graphical information instead of a bit-mapped graphical description of said graphical information, such that greater concession is achieved and the amount of data transmitted over said network is reduced as compared to a bit-mapped representation.

34. A method as described in claim 24, wherein said variable length portion of at least one of said commands comprises information identifying the object and parameters describing a detail of an operation upon said object.

31. A method for the real-time interactive on-demand inter communication of information between a plurality of computers in a client-to-client network, wherein each said computer may be a different type of computer including computers having different processor and system architecture, computers running different operating systems, and computers running different application programs for generating or displaying said information, said method comprising the steps of:

defining a command protocol that provides a set of information to represent an object so that each object is separately identifiable and can be processed independently from other objects within or among any of said networked computers, including objects that may be displayed concurently on the same display screen, said command protocol representing each said object in a form that is indepedent of the type of computer or display device on which said object may be rendered for viewing;

storing said set of information characterizing each said object in said command protocol;

transmitting said information characterizing each said object to another of said networked computers in real-time when said information is generated independent of any request for such information by any other one of said computers; and

receiving said information characterizing each said object from another of said networked computers when said information is transmitted, each said computer adapted to asynchronously receive said information in real-time after it is transmitted from another of said computers without said receiving computer requesting said information; and

storing said received information according to said protocol in a memory area in said computer reserved for the storage and optional recall and usage of information received from each other of said networked computers specifying said object characteristics, said information received from said any particular one of said computers being stored in said memory storage area upon receipt and being retained in said memory until intercommunication between said computers is terminated so that there is no need to retransmit any of said information once received.

32. The method as in claim 31, further comprising the step of converting said received information to said predefined command protocol when said received information does not conform to said protocol.

33. A method as described in claim 31, wherein said protocol includes a plurality of commands, each said command having a fixed length portion and a variable length portion.

35. A method as in claim 31, wherein said characterization of objects comprises the steps of:

identifying a set of parameters that uniquely describe each type of object to be generated;

establishing an identification parameter that is associated with each type of object;

whereby the selection by a user of a particular one of said object identifiers provides an associated set of descriptive parameters for each of said object which will uniquely enable said computer to manipulate said object.

36. A method as in claim 35, wherein one of said objects is a circle, said parameters associated therewith includes the radius of said circle, and said location point parameter is the center of said circle.

37. A method as in claim 35, wherein said fixed length portion contains information related to said identification parameter, and the length of said variable length portion;

and said variable length portion includes information related to said parameters.

38. The method in claim 35, wherein said object manipulation includes optionally displaying an image of said object upon a computer display screen.

39. A system for the bi-directional simultaneous real-time interactive manipulation of information including at least one object among a plurality of interconnected computers and for communicating said information between a plurality of networked computers, said system comprising:

a command protocol stored in said computer to define the interpretation of information received from any of said networked computers, said protocol including a command format that identifies characteristics of said objects in a parameterized form different from a bit-mapped graphical representation;

said command protocol providing a basis set of information to represent said information so that when said information includes more than one object each said object is separately identifiable and can be processed independently from other of said objects within or among any of said networked computers, said command protocol representing each said object in a form that is independent of the type of device on which said object may be rendered for viewing;

a first memory area defined in each said computer for storing said characterics of said objects generated on said computer according to interpretation of said command protocol;

a plurality of seperate memory areas defined in each said computer for storing and optionally recalling and using information received from each other of said networked computers specifying said object characteristics;

means for asynchronously receiving information substantially in real-time without requesting said information from another of said networked computers; and

means for storing said received information in said seperate memory areas devoted to information received from any particular one of said plurality of computer according to interpretation of said protocol, and for maintaining storage of all such data received until inter communication between said computers terminates.

40. A system as in claim 39, wherein a plurality of said independently identifiable object can be processed to join said plurality of objects into a new independently identifiable object.

41. A system as in claim 40, wherein said information in said protocol command format comprises:

information identifying a set of parameters that uniquely describe each type of object to be generated; and

information establishing an identification parameter that is associated with each type of object;

said information in said command format including a fixed length portion and a variable length portion;

said fixed length portion including information related to said identification parameter and the length of said variable length portion, and said variable length portion including information related to said parameters.

42. A system as in claim 41, further comprising a user interface to each said networked computer for generating objects within a particular one of said networked computers.

43. A method for the inter communication of information between at least two interconnected computers, each said computer having an arbitrary architecture, executing an arbitrary operating system, and executing arbitrary application programs for manipulating said information, said method comprising:

executing, within each said computer, a computer program that controls operations within said computer;

each said computer adapted to transmit and/or receive information substantially in real time to any other of said computers as said information changes;

at least one of said computers adapted to asynchronously receive said information substantially in real-time that is transmitted from any other of said computers without said receiving computer requesting said information;

said computer program of each said interconnected computers having a particular memory storage area reserved for storing information received from any particular one of each other of said computers;

said information received from said any particular one of said computers being stored in said memory storage area upon receipt;

said computer program executing in each said computer having said memory storage area designated for each said computer, so that information received from each said computer will be separately stored in the receiving computer for recall and usage by said receiving computer;

each said computer program associated with each said computer including a protocol which may be different for each said computer to promote the interpretation of information received from any of said other computers.