Fractal computer user centerface with zooming capability

• US 5,341,466 A
• Filed: 05/09/1991
• Issued: 08/23/1994
• Est. Priority Date: 05/09/1991
• Status: Expired due to Term

• Current Assignee: Open Invention Network LLC
• Original Assignee: New York University
• Inventors: Schwartz, Jacob, Perlin, Kenneth
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): FEILD, JOSEPH H
• Application Number:
  US07/698,016
• Time in Patent Office: 1,202 Days
• Field of Search: 395/145, 395/128, 395/139, 395/157, 395/158, 395/159, 395/155, 382/47, 382/56
• US Class Current: 345/668
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06T 3/053 Detail-in-context presentations fisheye or wide-angle transformations G06T3/047

Abstract

A computer user interface that represents information stored in a computer as reprentation objects located on at least one reference surface is disclosed. A user can magnify or reduce the displayed information by "zooming" in or out. The magnification operation displays a smaller portion of a particular surface, but each object that remains in view is displayed in greater size and/or detail. Similarly, the reduction operation displays a larger portion of a given surface, but each object within such surface is displayed in a smaller size and/or less detail. In order to view one part of the surface from another part of the surface or from another surface, a special type of an object, called a representation portal object, is provided. A graphical description of each object is physically stored in computer memory essentially as a sequence of compressed image representations. The first image in the sequence is a bit-mapped representation of an object as it was created, and each subsequent image is a reduced copy of the first image.

Claims

1. A method of visually displaying, on a display area, items of information stored in computer memory, by displaying representation objects, which represent the items of information, on a reference surface, each of which representation objects has a predetermined size and position on such reference surface and is comprised of groups of pixels, comprising:

storing a data object, in the computer memory, for each of the representation objects having a predetermined size and position on such reference surface, each of which data objects comprises a sequence of image representations of such representation object, which sequence includes reduced copies of such representation object, and an address of such representation object on the reference surface;

deriving and storing a plurality of reduced copies of the representation objects by successively representing the information in the pixel groups forming such representation object by smaller pixel groups, so as to provide the sequence of image representations of successively smaller representation objects;

displaying at least a portion of the reference surface on such display area;

displaying a different portion of the reference surface in response to control signals to display different representation objects; and

substituting representation objects of different size for displayed representation objects in order to effectively enlarge or reduce the magnification of the information displayed on the display area.

2. The method of claim 1 further comprising the step of providing at least one portal data object defining a portion of the reference surface and a portal scale at which the portion of the reference surface is to be displayed and for providing a portal representation object at a predetermined size, shape and position on the reference surface.

3. The method of claim 2 further comprising the step of displaying at least one portal representation object whereby the portion of the reference surface is displayed within the shape of such portal representation object on the display area.

4. The method of claim 3 wherein the step of displaying at least one portal representation object comprises:

allocating a block of memory for an intermediate image;

selecting a set of the data objects that correspond to the representation objects that are on the portion of the reference surface which will be displayed within a particular portal representation object;

determining images that represent each of the representation objects that will be displayed within the particular portal;

copying the images that represent the representation objects in the set into the block of memory allocated for the intermediate image; and

displaying on the display area data stored in the block of memory allocated for the intermediate image.

5. The method of claim 4 wherein the step of determining the images comprises:

determining whether a particular representation object stored as the data object in the set is enlarged, reduced or unchanged and determining a scale of such enlargement or reduction; and

if the particular representation object is magnified or unchanged, selecting a first image representation, which is not reduced, in the sequence of image representations stored for providing the particular representation object, otherwise selecting one of the subsequent images.

6. The method of claim 5 further comprising the step of deleting certain scan lines and certain bits of the selected image representation if the scale of the particular representation object is reduced by a factor which is not a power of two.

7. The method of claim 3 further comprising the step of compressing each image representation in the sequence stored for each data object such that bytes of imaging information, in which at least one bit does not have a zero value, are stored.

8. A method of visually displaying, on a display area, items of information stored in computer memory, by displaying representation objects, which represent the items of information, on a reference surface, each of which representation objects has a predetermined size and position on such reference surface and is comprised of groups of pixels, comprising:

storing a data object for each of the representation objects having a predetermined size, shape and position on such reference surface;

storing at least one portal data object defining a portion of the reference surface and a portal scale at which the portion of the reference surface is to be displayed and for providing a portal representation object at a predetermined size, shape and position on the reference surface;

displaying at least one portal representation object in the display area, whereby the portion of the reference surface defined by such portal data object is displayed in the display area; and

varying at least one of (1) the portion of the reference surface displayed in such portal representation object in response to control signals to display different representation objects therein, and (2) the portal scale in response to control signals to display the representation objects at a different scale.

9. The method of claim 8 wherein the portal representation object corresponds to the entire display area.

10. The method of claim 8 wherein each of the data objects comprises a sequence of image representations of a corresponding representation object and an address of the corresponding representation object on the reference surface.

11. The method of claim 10 wherein the step of displaying at least one portal representation object comprises:

allocating a block of memory for an intermediate image;

selecting a set of the data objects that correspond to the representation objects that are on the portion of the reference surface which will be displayed within a particular portal representation object;

determining images that represent each of the representation objects that will be displayed within the particular portal;

copying the images of each of the representation objects in the set into the block of memory allocated for the intermediate image; and

displaying on the display area data stored in the block of memory allocated for the intermediate image.

12. The method of claim 11 wherein the step of determining the images comprises:

determining whether a particular representation object is stored as the data object in the set is enlarged, reduced or unchanged and determining a scale of such enlargement or reduction; and

if the particular representation object is magnified or unchanged, selecting a first image, which is not reduced, representation in the sequence of image representations stored for providing the particular representation object, otherwise selecting one of the subsequent image representations.

13. The method of claim 12 further comprising the step of deleting certain scan lines and certain bits of the selected image representation if the scale of the particular representation object is reduced by a factor which is not a power of two.

14. The method of claim 10 further comprising the step of compressing each image representation in the sequence stored for each data object such that bytes of imaging information, in which at least one bit does not have a zero value, are stored.

15. The method of claim 10 wherein the step of varying the portal scale comprises:

determining an innermost representation portal, which does not contain other portals within its shape;

storing image representation of the innermost portal in a first block of memory;

storing image representations of representation objects located within a bounding rectangle that confines the innermost portal in a second block of memory; and

copying the second block of memory to a third block of memory such that only the image representations of the representation objects within the innermost portal are copied.

16. An apparatus for visually displaying items of information stored in computer memory, by displaying representation objects, which represent the items of information, on a reference surface, each of which representation objects has a predetermined size and position on such reference surface and is comprised of groups of pixels, comprising:

a computer having a display area;

means for storing a data object for each of the representation objects having a predetermined size and position on such reference surface, each of which data objects comprises a sequence of image representations of such representation object, which sequence includes reduced copies of such representation object, and an address of such representation object on the reference surface;

means for deriving and storing a plurality of reduced copies of representation objects by successively representing the information in the pixel groups forming such representation object by smaller pixel groups, so as to provide the sequence of image representations of successively smaller representation objects;

means for displaying at least a portion of the reference surface on such display area;

means for displaying a different portion of the reference surface in response to control signals to display different representation objects; and

means for substituting representation objects of different size for displayed representation objects in order to effectively enlarge or reduce the magnification of the information displayed n the display area.

17. The apparatus of claim 16 further comprising

means for providing at least one portal data object defining a portion of the reference surface and a portal scale at which the portion of the reference surface is to be displayed and for providing a portal representation object at a predetermined size, shape and position on the reference surface.

18. The apparatus of claim 17 further comprising

means for displaying at least one portal representation object whereby the portion of the reference surface is displayed within the shape of such portal representation object on the display area.

19. The apparatus of claim 18 wherein the means for displaying at least one portal representation object comprises:

means for allocating a block of memory for an intermediate image;

means for selecting a set of the data objects that correspond to the representation objects that are on the portion of the reference surface which is displayed within a particular portal representation object;

means for determining images that represent each of the representation objects that will be displayed within the particular portal object;

means for copying the images that represent the representation objects in the set into the block of memory allocated for the intermediate image; and

means for displaying on the display area data stored in the block of memory allocated for the intermediate image.

20. The apparatus of claim 19 wherein the means for determining the images comprises:

means for determining whether a particular representation object stored as the data object in the set is enlarged, reduced or unchanged and determining a scale of such enlargement or reduction; and

means for selecting a first image, which is not reduced, representation in the sequence of image representations stored for providing the particular representation object if the particular representation object is magnified or unchanged; and

means for selecting one of the subsequent image representations if the particular representation object is reduced.

21. The apparatus of claim 20 further comprising means for deleting certain scan lines and certain bits of the selected image representation if the scale of the particular representation object is reduced by a factor which is not a power of two.

22. The apparatus of claim 21 further comprising means for compressing each image representation in the sequence stored for each representation object such that bytes of imaging information, in which at least one bit does not have a zero value, are stored.

23. An apparatus for visually displaying items of information stored in computer memory, by displaying representation objects, which represent the items of information, on a reference surface, each of which representation objects has a predetermined size and position on such reference surface and is comprised of groups of pixels, comprising:

a computer having a display area;

means for storing a data object for each of the representation objects having a predetermined size, shape and position on such reference surface;

means for storing at least one portal data object defining a portion of the reference surface and a portal scale at which the portion of the reference surface is to be displayed and for providing a portal representation object at a predetermined size, shape and position on the reference surface;

means for displaying at least one portal representation object in the display area, whereby the portion of the reference surface defined by such portal data object is displayed in the display area; and

means for varying at least one of (1) the portion of the reference surface displayed in such portal representation object in response to control signals to display different representation objects therein, and (2) the portal scale in response to control signals to display the representation objects at a different scale.

24. The apparatus of claim 23 wherein the portal representation object corresponds to the entire display area.

25. The apparatus of claim 23 wherein each of the data objects comprises a sequence of image representations of a corresponding representation object and an address of the corresponding representation object on the reference surface.

26. The apparatus of claim 25 wherein the means for displaying at least one portal representation object comprises:

means for allocating a block of memory for an intermediate image;

means for selecting a set of the data objects that correspond to the representation objects that are on the portion of the reference surface which will be displayed within a particular portal representation object;

means for determining images that represent each of the representation objects that will be displayed within the particular portal object;

means for copying the images of each of the representation objects in the set into the block of memory allocated for the intermediate image; and

means for displaying on the display area data stored in the block of memory allocated for the intermediate image.

27. The apparatus of claim 26 wherein the means of determining the images comprises:

means for determining whether a particular representation object stored as the data object in the set is enlarged, reduced or unchanged and determining a scale of such enlargement or reduction;

means for selecting a first image, which is not reduced, representation in the sequence of image representations stored for providing the particular representation object if the particular representation object is magnified or unchanged; and

means for selecting one of subsequent image representations if the particular representation object is reduced.

28. The apparatus of claim 27 further comprising means for deleting certain scan lines and certain bits of the selected image representation if the scale of the particular representation object is reduced by a factor which is not a power of two.

29. The apparatus of claim 28 further comprising means for compressing each image representation in the sequence stored for each representation object such that bytes of imaging information, in which at least one bit does not have a zero value, are stored.

30. The apparatus of claim 24 wherein means for varying the portal scale comprises:

means for determining an innermost representation portal, which does not contain other portals within its shape;

means for storing image representation of the innermost portal in a first block of memory;

means for storing image representations of representation objects located within a bounding rectangle that confines the innermost portal in a second block of memory; and

means for copying the second block of memory to a third block of memory such that only the image representations of the representation objects within the innermost portal are copied.