Coupling a display object to a viewpoint in a navigable workspace

• US 5,689,628 A
• Filed: 04/14/1994
• Issued: 11/18/1997
• Est. Priority Date: 04/14/1994
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Robertson, George G.
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): BURWELL, JOSEPH RICHARD
• Application Number:
  US08/227,763
• Time in Patent Office: 1,314 Days
• Field of Search: 395/118-121, 395/127, 395/133, 395/134, 395/155, 395/157, 395/158, 395/160, 395/161
• US Class Current: 345/427
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/10 Geometric effects

Abstract

A method and system are disclosed for maintaining a view of a selected display object while navigating in an n-dimensional, navigable workspace. Objects perceptible in the workspace are perceptible as viewed from one of a plurality of viewpoints of the workspace. In response to the system user selecting a display object for coupling, the selected display object is moved to a preferred viewing position and coupled to a first viewpoint into the workspace that is the viewpoint into the workspace at the time the object is selected. In response to the user'"'"'s subsequent requests to change viewpoints into the workspace to perform navigation therein, the display object appears to maintain the same relative position to the first viewpoint. This results in the selected display object always being easily perceptible and accessible in the workspace even if the selected display object would not otherwise be perceptible from one of the changed viewpoints in the workspace. The display object coupling technique is useful in large 2D, 21/2D and 3D visualization workspaces, such as, for example, to carry a display object that serves as a tool or that contains information that needs to be referenced to a portion of the workspace that is presently not clearly perceptible. The selected display object may either be perceptible in the workspace at the time of selection, or it may be made perceptible in response to the user'"'"'s selection of an operation or function available in the workspace. In response to receiving a decoupling signal, the selected display object is returned to its original position in the workspace. An implementation of the coupling technique in a 3D information visualization environment is described.

Claims

1. A method of operating a system including a display, a user input device for producing signals indicating actions of a system user, memory for storing data, and a processor connected for receiving signals and for presenting images on the display;

the method comprising;

presenting a first image on the display that is perceptible as viewed from a first viewpoint in a navigable workspace;

the first workspace including a first display object;

receiving a first signal from the user input device indicating selection by the system user of the first display object as a selected display object;

coupling the selected display object to the first viewpoint in the navigable workspace in response to the first signal;

receiving a sequence of next viewpoint signals from the user input device requesting viewpoint motion in the navigable workspace;

each next viewpoint signal indicating a next viewpoint in the navigable workspace that is displaced in the workspace from the next viewpoint of a preceding next viewpoint signal in the sequence of signals; and

presenting on the display, in response to each next viewpoint signal, a respective next image including the selected display object;

the respective next image being perceptible as viewed from the next viewpoint in the navigable workspace;

the selected display object being perceptible as a moved continuation of the selected display object in a preceding respective next image;

when the selected display object is coupled to the first viewpoint, the selected display object being presented in each respective next image so that the selected display object is perceptible as viewed from the first viewpoint in the navigable workspace.

2. The method of claim 1 further including, in response to the first signal from the system user indicating the selected display object,

determining a preferred viewing position for the selected display object in the navigable workspace;

and

presenting on the display a second image of the navigable workspace including the selected display object in the preferred viewing position therein;

the second image and the selected display object being perceptible as viewed from the first viewpoint in the navigable workspace.

3. The method of claim 2 wherein the preferred viewing position of the selected display object in the navigable workspace is determined using a predetermined distance from the first viewpoint along an axis orthogonal to an image surface of the display.

4. The method of claim 1 wherein the step of presenting each next respective image includes

(a) storing viewpoint coordinate data indicating the first viewpoint;

(b) determining an updated display object position in the navigable workspace for the selected display object using the stored viewpoint coordinate data and the next viewpoint;

(c) presenting the selected display object in the next respective image in the updated display object position in the navigable workspace;

(d) after receiving the next viewpoint signal indicating the next viewpoint, modifying the viewpoint coordinate data to indicate the next viewpoint of the preceding next viewpoint signal; and

(e) repeating steps (b), (c) and (d) while the selected display object is coupled to the first viewpoint and until all signals in the sequence of next viewpoint signals requesting viewpoint motion have been received.

5. The method of claim 4 wherein

the selected display object is positioned in an original position in the navigable workspace;

the selected display object being included in the first image; and

the method further includes, after presenting the respective next images on the display in response to the next viewpoint signals,

receiving a second signal indicating completion of selected display object coupling; and

in response to the second signal,

uncoupling the selected display object from the first viewpoint in the navigable workspace; and

modifying the updated display object position for the selected display object to indicate the original position thereof in the navigable workspace.

6. The method of claim 1 wherein the navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position in the 3D workspace and a first viewpoint orientation of the first viewpoint in the 3D workspace.

7. The method of claim 6 wherein each next viewpoint signal indicates a next viewpoint position and a next viewpoint orientation of the next viewpoint in the 3D navigable workspace;

each next viewpoint position and each next viewpoint orientation being displaced in the workspace from the next viewpoint position and the next viewpoint orientation of the preceding next viewpoint signal in the sequence of signals.

8. The method of claim 1 wherein the navigable workspace is a 3D navigable workspace, and wherein the first viewpoint includes a first viewpoint position in the 3D workspace and a first viewpoint scale of the first viewpoint in the 3D workspace.

9. The method of claim 1 wherein the navigable workspace is a two dimensional (2D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position in the 2D workspace.

10. The method of claim 1 wherein the selected display object is an operation display object representing an operation the system user may select for execution.

11. The method of claim 10 wherein

the selected display object is not perceptible in the first workspace;

the selected display object being selected by the system user from a plurality of available operations; and

the method further includes, after presenting the respective next images on the display in response to the next viewpoint signals,

receiving a second signal indicating completion of selected display object coupling; and

in response to the second signal,

making the selected display object imperceptible in the navigable workspace; and

uncoupling the selected display object from the first viewpoint in the navigable workspace.

12. A method of operating a system including a user input device for receiving signals indicating actions and requests of a system user;

a display device having a display area for presenting images;

a processor connected for receiving the signals from the user input device, and connected for providing images to the display device; and

memory for storing data;

the processor being further connected for accessing the data stored in the memory;

the method comprising;

presenting a first image in the display area of the display device that is perceptible as viewed from a first viewpoint position and from a first viewpoint orientation in a three-dimensional (3D) navigable workspace (hereafter, the workspace);

the workspace including a first display object;

receiving a first signal from the user input device selecting the first display object as a selected display object;

in response to the first signal,

determining a preferred viewing position and a preferred viewing orientation for the selected display object in the workspace;

presenting on the display a second image of the workspace including the selected display object in the preferred viewing position and in the preferred viewing orientation therein;

the second image and the selected display object being perceptible as viewed from the first viewpoint position and from the first orientation in the workspace; and

storing display object coupling data indicating that the selected display object is coupled to the first viewpoint position and to the first orientation;

the selected display object indicating the display object coupling data;

receiving a sequence of next viewpoint signals from the user input device requesting viewpoint motion in the workspace;

each next viewpoint signal indicating a next viewpoint and a next orientation in the workspace that is displaced in the workspace from the next viewpoint and from the next orientation of a preceding next viewpoint signal in the sequence of signals; and

in response to receiving each next viewpoint signal, while the display object coupling data indicates that the selected display object is coupled to the first viewpoint position and to the first orientation,

storing viewpoint coordinate data indicating the next viewpoint and the next orientation of the preceding next viewpoint signal;

determining an updated display object position and an updated display object orientation in the workspace for the selected display object using the stored viewpoint coordinate data, the next viewpoint and the next orientation; and

presenting on the display, a respective next image including the selected display object;

the respective next image being perceptible as viewed from the next viewpoint and from the next orientation in the workspace;

the selected display object being presented in each respective next image so that the selected display object is perceptible as a moved continuation of the selected display object in a preceding respective next image and is perceptible as being viewed from the first viewpoint position and from the first orientation in the workspace;

the selected display object being presented in the updated display object position and in the updated display object orientation in the workspace.

13. The method of claim 12 wherein the first display object is included in the first image and has an original position and an original orientation in the workspace;

and wherein the method further includes, after presenting the respective next images on the display in response to the next viewpoint signals,

receiving a second signal indicating completion of display object coupling;

and in response to the second signal,

modifying the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint position and to the first viewpoint orientation; and

modifying the updated display object position and the updated display object orientation for the selected display object to indicate respectively the original position and the original orientation thereof in the navigable workspace.

14. The method of claim 12 wherein the selected display object is an operation display object representing an operation the system user may select for execution.

15. The method of claim 14 wherein the selected display object is not perceptible in the workspace;

and wherein the method further includes,

making the selected display object perceptible in the preferred viewing position and in the preferred viewing orientation in the workspace in a second image;

and, after presenting the respective next images on the display in response to the next viewpoint signals,

receiving a second signal indicating completion of display object coupling;

and in response to the second signal,

making the selected display object imperceptible in the workspace;

and modifying the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint position and to the first viewpoint orientation.

16. The method of claim 12 wherein the preferred viewing position of the selected display object in the workspace is determined using a predetermined distance from the first viewpoint position along an axis orthogonal to an image surface of the display;

and wherein the preferred viewing orientation of the selected display object in the workspace is a front surface view of the selected display object.

17. A system comprising:

input circuitry, connected to a user input device, for receiving signals indicating actions and requests of a system user;

output circuitry connected to a display device having a display area for presenting images;

a processor connected for receiving the signals from the input circuitry, and connected for providing images to the output circuitry for presentation by the display device; and

memory for storing data;

the data stored in the memory including instruction data indicating instructions the processor can execute;

the processor being further connected for accessing the data stored in the memory;

the processor, in executing the instructions, presenting a first image on the display that is perceptible as viewed from a first viewpoint in an n-dimensional navigable workspace (hereafter, the workspace);

the workspace including a first display object;

the processor further in executing the instructions, receiving a first signal from the system user selecting the first display object as a selected display object;

the processor, further in executing the instructions, storing display object coupling data indicating that the selected display object is coupled to the first viewpoint in response to the first signal;

the processor, further in executing the instructions, receiving a sequence of next viewpoint signals from the user input device requesting viewpoint motion in the workspace;

each next viewpoint signal indicating a next viewpoint in the workspace that is displaced in the workspace from the next viewpoint of a preceding next viewpoint signal in the sequence of signals; and

the processor, further in executing the instructions, presenting on the display, in response to each next viewpoint signal, a respective next image including the selected display object;

the respective next image being perceptible as viewed from the next viewpoint in the workspace;

the selected display object being presented in each respective next image so that the selected display object is perceptible as a moved continuation of the selected display object in a preceding respective next image;

when the display object coupling data indicates that the selected display object is coupled to the first viewpoint, the selected display object being presented in each respective next image so that the selected display object is perceptible as being viewed from the first viewpoint in the workspace.

18. The method of claim 17 wherein the n-dimensional navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position in the 3D navigable workspace and a first viewpoint orientation in the 3D navigable workspace.

19. The system of claim 17 wherein the processor, further in executing the instructions, after presenting the respective next images on the display in response to the next viewpoint signals,

receives a second signal indicating completion of display object coupling;

and in response to the second signal,

modifies the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint.

20. The system of claim 17 wherein the first display object is not perceptible in the workspace;

wherein the processor, further in executing the instructions in response to the first signal, makes the selected display object perceptible in a second image; and

wherein the processor, further in executing the instructions after presenting the respective next images on the display in response to the next viewpoint signals,

receives a second signal indicating completion of display object coupling; and

in response to the second signal,

makes the selected display object imperceptible in the workspace; and

modifies the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint.

21. An article of manufacture for use in a system that includes a display having a display area for presenting images to a system user;

a user input device for receiving signals indicating actions and requests of the system user;

memory for storing data;

a storage medium access device for accessing a medium that stores data; and

a processor connected for receiving data from the user input device, for providing data defining images to the display, and for accessing the data stored in the memory;

the processor further being connected for receiving data from the storage medium access device;

the article comprising;

a data storage medium that can be accessed by the storage medium access device when the article is used in the system; and

data stored in the data storage medium so that the storage medium access device can provide the stored data to the processor when the article is used in the system;

the stored data comprising

signal receiving instruction data indicating input instructions the processor can execute to receive signal data from the user input device;

the signal data including signals for selecting a first display object included in a navigable workspace and for performing viewpoint motion in the navigable workspace;

a first image of the navigable workspace displayed in the display area being perceptible as viewed from a first viewpoint in the navigable workspace; and

operation performing instruction data indicating response instructions the processor can execute to perform operations in response to the signal data;

when a first signal indicates the system user'"'"'s selection of the first display object as a selected display object, execution of the response instructions causing the processor to store display object coupling data indicating that the selected display object is coupled to the first viewpoint; and

when a sequence of next viewpoint signals including a series of next viewpoints indicates the system user'"'"'s request for viewpoint motion in the navigable workspace, execution of the response instructions causing the processor to store viewpoint coordinate data indicating a position of the first viewpoint in the first workspace, and, in response to each next viewpoint signal, to present a respective next image including the selected display object in the display area;

the respective next image being perceptible as viewed from the next viewpoint;

when the display object coupling data indicates that the selected display object is coupled to the first viewpoint, the selected display object being presented in the respective next image using the viewpoint coordinate data and the next viewpoint so that the selected display object is perceptible as viewed from the first viewpoint.