Method to provide for virtual screen overlay

• US 5,577,188 A
• Filed: 05/31/1994
• Issued: 11/19/1996
• Est. Priority Date: 05/31/1994
• Status: Expired due to Term

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Future Labs, Inc. (Gen Digital Inc.)
• Inventors: Zhu, Min
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): HO, RUAY L
• Application Number:
  US08/252,791
• Time in Patent Office: 903 Days
• Field of Search: 395/157, 395/160, 395/161, 395/158, 395/164, 395/650, 345/201, 364/419.1
• US Class Current: 715/745
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

The present invention in the form of a computer software program provides for a method for annotating over static images or annotating over active application programs. In the case of static images, user-created objects can be created, manipulated and placed over static images. In the case of annotating over application programs in a structured system environment such as in a windows environment, an overlay program embodying the present invention provides an overlaying method allowing the user to switch back and forth between the active application programs and the overlay program. When the overlay program has control, a screen-size, transparent window is created and annotations are created in this window. This transparent window allows the user to see the application programs on the screen. Thus, when creating annotations on this window, a visual perception is created that the annotations are on the images displayed by the application programs. When the user finishes annotating, the user can switch back to the active application programs with the option to hide the annotations or to display the annotations over the active application programs.

Claims

1. In a computer system, a method for displaying user-created objects over images on a computer screen to simulate annotations and pointers over said images by one or more users, wherein said images are generated, controlled, and manipulated by one or more active application programs and the user-created objects include annotation objects and pointer objects where the annotation objects and pointer object for a particular user is of a particular color wherein an annotation object highlights a part of said images and a pointer objects directs to an area of said images, comprising the steps of:

a) creating a transparent window appearing to be displayed over said images, said transparent window providing an environment for creation, manipulation, and deletion of user-created objects;

b) creating and displaying one or more of said user-created objects at user specified locations in said transparent window and storing data representing said user-created objects;

c) determining any overlapping portion of said user-created objects and displaying said overlapping portion of said user-created objects according to a predetermined hierarchy;

d) repeating step b and c until a first user command to close said transparent window is received; and

e) responding to said first user command by closing said transparent window and returning to said application programs.

2. A method as recited in claim 1 wherein before step e) data representing said images and said user-created objects is transmitted to at least one remote computer having a computer screen, said images and said user-created objects being displayed on the computer screen of said remote computer in the same fashion as in said computer system.

3. A method as recited in claim 2 and further including the step of:

retrieving the stored data and redrawing the user-created objects over the images generated by the application programs after said transparent window is closed.

4. A method as recited in claim 3, wherein a second user command to remove said user-created objects from the screen is provided after returning to said application programs, and further including a step of removing all said user-created objects from the screen upon activation of said second user command.

5. A method as recited in claim 4, wherein after returning to said application programs, the following steps are implemented:

retrieving the stored data and using it to display said user-created objects over the images generated by the application programs;

capturing write-to-screen commands and write-to-screen data issued by the application programs and displaying the write-to-screen data on the computer screen;

determining any overlap of the write-to-screen data and said user-created objects; and

if there is overlap of the write-to-screen data and said user-created objects, redrawing the overlapping portion of said user-created objects on the computer screen.

6. A method as recited in claim 5, wherein said user-created objects include pointer objects and annotation objects.

7. A method as recited in claim 6, wherein said images are stored in a first layer storage area, said annotation objects are stored in a second layer storage area, said pointer objects are stored in a third layer storage area, wherein the pointer objects are displayed over the annotation objects and the images, wherein the annotation objects are displayed over the images, and wherein said overlap determination step includes the sub-steps of:

i) ascertaining said user-created object type and the associated layer storage area for said user-created object type;

ii) setting a current-layer-pointer to point to the associated layer storage area;

iii) if the current-layer-pointer is not pointing to the third layer storage area,

advancing the current-layer-pointer to point to the next layer storage area;

searching for objects stored in the layer storage area pointed to by the current-layer-pointer;

determining if the stored objects and the user-created object occupy the same location on the screen; and

drawing any overlapping portion of the stored objects on the computer screen; and

iv) repeating step ii) until the current layer pointer points to the third layer storage area.

8. A method as recited in claim 1 and further including the step of:

retrieving the stored data and redrawing the user-created objects over the images generated by the application programs after said transparent window is closed.

9. A method as recited in claim 1, wherein a second user command to remove said user-created objects from the screen is provided after returning to said application programs, and further including a step of removing all said user-created objects from the screen upon activation of said second user command.

10. A method as recited in claim 1, wherein after returning to said application programs, the following steps are implemented:

retrieving the stored data and using it to display said user-created objects over the images generated by the application programs;

capturing write-to-screen commands and write-to-screen data issued by the application programs and displaying the write-to-screen data on the computer screen;

determining any overlap of the write-to-screen data and said user-created objects; and

if there is overlap of the write-to-screen data and said user-created objects, redrawing the overlapping portion of said user-created objects on the computer screen.

11. A method as recited in claim 1, wherein said user-created objects include pointer object type and annotation object type.

12. A method as recited in claim 11, wherein said images are stored in a first layer storage area, said annotation objects are stored in a second layer storage area, said pointer objects are stored in a third layer storage area, wherein the pointer objects are displayed over the annotation objects and the images, wherein the annotation objects are displayed over the images, and wherein said overlap determination step includes the sub-steps of:

i) ascertaining said user-created object type and the associated layer storage area for said user-created object type;

ii) setting a current-layer-pointer to point to the associated layer storage area;

iii) if the current-layer-pointer is not pointing to the third layer storage area,

advancing the current-layer-pointer to point to the next layer storage area;

searching for objects stored in the layer storage area pointed to by the current-layer-pointer;

determining if the stored objects and the user-created object occupy the same location on the screen; and

drawing any overlapping portion of the stored objects on the computer screen; and

iv) repeating step ii) until the current layer pointer points to the third layer storage area.

13. In a teleconferencing system providing an environment on a host computer wherein at least one remote computer at a different site can be electronically and communicative linked to pass data between said remote computer and said host computer, and including means for establishing at least one communication link between said host computer and said remote computer, user-interface means responsive to user commands for loading previously created frames of data for transmission to the remote computer and for allowing user creation of new frames of data, means for transmitting said frames of data from the host computer to said remote computer via said communication link, an improved control means for controlling said user-interface means, said improved control means implementing a method comprising the steps of:

a) creating a transparent window appearing to be displayed over said images, said transparent window providing an environment for creation, manipulation, and deletion of one or more user-created objects;

b) creating and displaying one or more of said user-created objects at user specified locations in said transparent window and storing data representing said user-created objects;

c) determining any overlapping portion of said user-created objects and displaying said overlapping portion of said user-created objects according to a predetermined hierarchy;

d) repeating step b and c until a first user command to close said transparent window is received; and

e) responding to said first user command by closing said transparent window and returning to said application programs.

14. In a system as recited in claim 13 wherein before step e) data representing said images and said user-created objects is transmitted to at least one remote computer having a computer screen, said images and said user-created objects being displayed on the computer screen of said remote computer in the same fashion as in said computer system.

15. In a system as recited in claim 14 and further including the step of:

retrieving the stored data and redrawing the user-created objects over the images generated by the application programs after said transparent window is closed.

16. In a system as recited in claim 15, wherein a second user command to remove said user-created objects from the screen is provided after returning to said application programs, and further including a step of removing all said user-created objects from the screen upon activation of said second user command.

17. In a system as recited in claim 16, wherein after returning to said application programs, the following steps are implemented:

retrieving the stored data and using it to display said user-created objects over the images generated by the application programs;

capturing write-to-screen commands and write-to-screen data issued by the application programs and displaying the write-to-screen data on the computer screen;

determining any overlap of the write-to-screen data and said user-created objects; and

if there is overlap of the write-to-screen data and said user-created objects, redrawing the overlapping portion of said user-created objects on the computer screen.

18. In a system as recited in claim 17, wherein said user-created objects include pointer objects and annotation objects.

19. In a system as recited in claim 18, wherein said images are stored in a first layer storage area, said annotation objects are stored in a second layer storage area, said pointer objects are stored in a third layer storage area, wherein the pointer objects are displayed over the annotation objects and the images, wherein the annotation objects are displayed over the images, and wherein said overlap determination step includes the sub-steps of:

i) ascertaining said user-created object type and the associated layer storage area for said user-created object type;

ii) setting a current-layer-pointer to point to the associated layer storage area;

iii) if the current-layer-pointer is not pointing to the third layer storage area,

advancing the current-layer-pointer to point to the next layer storage area;

searching for objects stored in the layer storage area pointed to by the current-layer-pointer;

determining if the stored objects and the user-created object occupy the same location on the screen; and

drawing any overlapping portion of the stored objects on the computer screen; and

iv) repeating step ii) until the current layer pointer points to the third layer storage area.

20. In a system as recited in claim 13 and further including the step of:

retrieving the stored data and redrawing the user-created objects over the images generated by the application programs after said transparent window is closed.

21. In a system as recited in claim 13, wherein a second user command to remove said user-created objects from the screen is provided after returning to said application programs, and further including a step of removing all said user-created objects from the screen upon activation of said second user command.

22. In a system as recited in claim 13, wherein after returning to said application programs, the following steps are implemented:

retrieving the stored data and using it to display said user-created objects over the images generated by the application programs;

capturing write-to-screen commands and write-to-screen data issued by the application programs and displaying the write-to-screen data on the computer screen;

determining any overlap of the write-to-screen data and said user-created objects; and

if there is overlap of the write-to-screen data and said user-created objects, redrawing the overlapping portion of said user-created objects on the computer screen.

23. A system as recited in claim 13, wherein said user-created objects include pointer object type and annotation object type.

24. In a system as recited in claim 23, wherein said images are stored in a first layer storage area, said annotation objects are stored in a second layer storage area, said pointer objects are stored in a third layer storage area, wherein the pointer objects are displayed over the annotation objects and the images, wherein the annotation objects are displayed over the images, and wherein said overlap determination step includes the sub-steps of:

i) ascertaining said user-created object type and the associated layer storage area for said user-created object type;

ii) setting a current-layer-pointer to point to the associated layer storage area;

iii) if the current-layer-pointer is not pointing to the third layer storage area,

advancing the current-layer-pointer to point to the next layer storage area;

searching for objects stored in the layer storage area pointed to by the current-layer-pointer;

determining if the stored objects and the user-created object occupy the same location on the screen; and

drawing any overlapping portion of the stored objects on the computer screen; and

iv) repeating step ii) until the current layer pointer points to the third layer storage area.