Transporting a display object coupled to a viewpoint within or between navigable workspaces

• US 5,608,850 A
• Filed: 04/14/1994
• Issued: 03/04/1997
• Est. Priority Date: 04/14/1994
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Robertson, George G.
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): BURWELL, JOSEPH RICHARD
• Application Number:
  US08/227,762
• Time in Patent Office: 1,055 Days
• Field of Search: 395/118-121, 395/127, 395/133, 395/134, 395/155, 395/157, 395/158, 395/160, 395/161
• US Class Current: 345/427
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

A method and processor-controlled system are disclosed for transporting a selected display object, presented in a graphical image of an n-dimensional, navigable workspace where the selected display object is perceptible as viewed from one of a plurality of viewpoints in the workspace, by coupling the selected display object to a first viewpoint of the workspace. A display object perceptible as viewed from a first viewpoint and selected for transport is coupled to the first viewpoint so that the display object appears to maintain the same relative position to the first viewpoint as the system user changes viewpoints in the workspace, while other display objects in the workspace are perceptible as viewed from the changed viewpoints. This results in the selected display object always being perceptible in the workspace even if the selected display object would not have been perceptible from one of the changed viewpoints in the workspace. In addition, several selected display objects are always perceptible in their original relationship to each other and to the first viewpoint while being transported. The display object coupling technique is useful in large 2D or 3D visualization workspaces, for example to move or copy display objects to portions of the workspace that are presently not perceptible, and to move or copy display objects from a first workspace perceptible on the display to a second workspace presently not perceptible on the display. An implementation of the transport technique in a multiple workspace, 3D information visualization environment is described.

Claims

1. A method of operating a system including a display, a user input device for producing signals indicating actions of a system user, memory for storing data, and a processor connected for receiving signals and for presenting images on the display;

the method comprising;

presenting a first image on the display that is perceptible as viewed from a first viewpoint in a first navigable workspace;

the first image including a first display object;

receiving a first signal from the user input device indicating a transport request from the system user to transport a selected display object;

the first signal further indicating a selection of the first display object as the selected display object;

coupling the selected display object to the first viewpoint in response to the first signal indicating the transport request;

receiving a second signal from the user input device indicating a selection of a second viewpoint by the system user;

presenting a second image including the selected display object on the display in response to the second signal;

the second image being perceptible as viewed from the second viewpoint;

the selected display object being presented in the second image so that the selected display object is perceptible as being viewed from the first viewpoint;

receiving a third signal from the user input device indicating that transporting the selected display object is completed; and

uncoupling the selected display object from the first viewpoint in response to the third signal.

2. The method of claim 1 wherein the first navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position and a first viewpoint orientation in the 3D workspace.

3. The method of claim 1 wherein the first navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position and a first viewpoint scale in the 3D workspace.

4. The method of claim 1 wherein the first navigable workspace is a two dimensional (2D) navigable workspace, and wherein the first viewpoint includes a first viewpoint position in the 2D workspace.

6. The method of claim 1 wherein the transport request is a request selected by the system user from a plurality of requests including a move object request and a copy object request.

7. The method of claim 1 wherein

the step of coupling the selected display object to the first viewpoint includes storing display object coupling data indicating that the selecting display object is coupled to the first viewpoint;

and

the step of presenting the second image includes

storing first viewpoint coordinate data indicating the first viewpoint;

when the display object coupling data indicates that the selected display object is coupled to the first viewpoint, determining an updated display object position in the first navigable workspace for the selected display object using the stored first viewpoint coordinate data and the second viewpoint; and

presenting the selected display object in the second image in the updated display object position in the first navigable workspace.

8. The method of claim 7 wherein

the selected display object is represented by a first object data structure stored in the memory of the system;

the first object data structure including first object absolute position data indicating an original position of the selected display object; and

the step of presenting the second image further includes modifying the first object absolute position data to indicate the updated display object position of the selected display object in the second image.

9. The method of claim 8 wherein, when the first navigable workspace is a 3D navigable workspace wherein the first viewpoint includes a first viewpoint position and a first viewpoint orientation, the first object data structure further includes first object absolute orientation data indicating an original orientation of the selected display object;

and the step of modifying the first object absolute position data further includes modifying the first object absolute orientation data to indicate an updated display object orientation of the selected display object in the second image.

10. The method of claim 8 wherein, when the first navigable workspace is a 3D navigable workspace wherein the first viewpoint includes a first viewpoint position and a first viewpoint scale, the first object data structure further includes first object absolute scale data indicating an original scale of the selected display object;

and the step of modifying the first object absolute position data further includes modifying the first object absolute scale data to indicate an updated display object scale of the selected display object in the second image.

11. The method of claim 1 wherein the second viewpoint selected by the system user is in a second navigable workspace;

the second image being presented in the second navigable workspace on the display in response to the second signal.

12. The method of claim 11 wherein

the second navigable workspace is represented by a workspace data structure stored in the memory of the system;

and

the step of presenting the second image of the second navigable workspace further includes modifying the workspace data structure to indicate that the selected display object is included in the second navigable workspace.

13. The method of claim 1 wherein

the selected display object presented in the second image includes a selection-highlight display feature indicating to the system user that the selected display object has been selected for transporting;

and

the selected display object is presented in the third image without the selection-highlight display feature indicating to the system user that the selected display object is no longer selected for transporting.

5. The method of claim I further including, after coupling the selected display object to the first viewpoint in response to the first signal indicating the transport request,

receiving a plurality of next viewpoint displacement signals requesting viewpoint motion;

each viewpoint displacement signal indicating the system user'"'"'s selection of a next viewpoint displaced from a preceding viewpoint; and

presenting on the display, in response to each next viewpoint displacement signal, a respective image including the selected display object;

the respective image being perceptible as viewed from the next viewpoint;

the selected display object being presented in each respective image so as to be perceptible as viewed from the first viewpoint of the first navigable workspace;

the selected display object being perceptible by the system user during the requested viewpoint motion in each respective image as being coupled to the first viewpoint while the selected display object is being transported.

14. A method of transporting display objects between three-dimensional (3D) navigable workspaces in a system;

the system including a user input device for receiving signals indicating actions of a system user;

a display device having a display area for presenting images;

a processor connected for receiving the signals from the user input device, and connected for providing images to the display device; and

memory for storing data;

the processor being further connected for accessing the data stored in the memory;

the method comprising;

presenting a first image in the display area of the display device that is perceptible as viewed from a first viewpoint and from a first orientation in a first 3D navigable workspace;

the first image including a first display object;

receiving a first signal from the user input device indicating a request by the system user to transport a selected display object;

the first signal further indicating a selection by the system user of the first display object as the selected display object;

storing display object coupling data indicating that the selected display object is coupled to the first viewpoint and to the first orientation in response to the first signal;

receiving a second signal from the user input device indicating the system user'"'"'s selection of a second 3D navigable workspace;

responding to the second signal by

storing in the system memory first viewpoint coordinate data indicating the first viewpoint and the first orientation; and

presenting a second image including the selected display object therein in the second 3D navigable workspace in the display area;

the second image being perceptible as viewed from a second viewpoint and from a second orientation in the second 3D navigable workspace;

the selected display object being presented using the display object coupling data and the first viewpoint coordinate data so that the selected display object is perceptible in the second image as being viewed from the first viewpoint and from the first orientation of the first 3D navigable workspace;

receiving a third signal from the user input device indicating that transporting the selected display object is completed; and

modifying the display object coupling data, in response to the third signal, to indicate that the selected display object is not coupled to the first viewpoint and to the first orientation.

15. The method of claim 14 wherein the request to transport the selected display object is selected by the system user from a plurality of requests including a move object request and a copy object request.

16. The method of claim 14 further including, after storing the display object coupling data indicating that the selected display object is coupled to the first viewpoint and to the first orientation,

receiving a plurality of next viewpoint displacement signals requesting viewpoint motion;

each viewpoint displacement signal indicating the system user'"'"'s selection of a next viewpoint and a next orientation displaced from a preceding viewpoint and from a preceding orientation; and

presenting in the display area, in response to each next viewpoint displacement signal, a respective image including the selected display object;

the respective image being perceptible as viewed from the next viewpoint and the next orientation;

the selected display object being presented in each respective image using the display object coupling data and the first viewpoint coordinate data so that the selected display object is perceptible as being viewed from the first viewpoint and from the first orientation of the first 3D navigable workspace;

the selected display object being perceptible by the system user during the requested viewpoint motion in each respective image as being coupled to the first viewpoint and first orientation while the selected display object is being transported.

17. The method of claim 14 wherein the step of presenting the second image further includes

determining an updated display object position and an updated display object orientation in the second 3D navigable workspace for the selected display object using the stored first viewpoint coordinate data, the second viewpoint and the second orientation;

and

presenting the selected display object in the second image in the updated display object position and having the updated display object orientation in the second 3D navigable workspace.

18. The method of claim 14 wherein the step of responding to the second signal indicating the system user'"'"'s selection of a second 3D navigable workspace further includes modifying a second workspace data structure representing the second 3D navigable workspace to indicate that the selected display object is included in the second 3D navigable workspace.

19. A system comprising:

input circuitry, connected to a user input device, for receiving signals indicating actions and requests of a system user;

output circuitry connected to a display device having a display area for presenting images;

a processor connected for receiving the signals from the input circuitry, and connected for providing images to the output circuitry for presentation by the display device; and

memory for storing data;

the data stored in the memory including instruction data indicating instructions the processor can execute;

the processor being further connected for accessing the data stored in the memory;

the processor, in executing the instructions, presenting a first image on the display that is perceptible as viewed from a first viewpoint in a first n-dimensional navigable workspace;

the first image including a first display object;

the processor, further in executing the instructions, receiving a first signal from the system user to transport a selected display object;

the first signal further indicating a selection by the system user of the first display object as the selected display object;

the processor, further in executing the instructions, storing display object coupling data indicating that the selected display object is coupled to the first viewpoint in response to the first signal;

the processor, further in executing the instructions, receiving a second signal from the system user indicating the system user'"'"'s selection of a second viewpoint;

the processor storing first viewpoint coordinate data indicating the first viewpoint;

the processor further, in executing the instructions, responding to the second signal by presenting a second image including the selected display object in the display area;

the second image being perceptible as viewed from the second viewpoint;

the selected display object being presented in the second image using the display object coupling data, the first viewpoint coordinate data, and the second viewpoint so that the selected display object is perceptible as viewed from the first viewpoint;

the processor further, in executing the instructions, receiving a third signal from the system user indicating that transporting of the selected display object is complete; and

the processor, in responding to the third signal, modifying the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint;

the selected display object being perceptible to the system user as viewed from the second viewpoint.

20. The system of claim 19 wherein the first n-dimensional navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint coordinate data includes first viewpoint position data indicating a position of the first viewpoint in the 3D navigable workspace and first viewpoint orientation data indicating the orientation of the first viewpoint in the 3D navigable workspace.

21. The system of claim 19 wherein the first n-dimensional navigable workspace is a three dimensional (3D) navigable workspace, and wherein the first viewpoint coordinate data includes first viewpoint position data indicating a position of the first viewpoint in the 3D navigable workspace and first viewpoint scale data indicating the scale of the first viewpoint in the 3D navigable workspace.

22. The system of claim 19 wherein the first n-dimensional navigable workspace is a two dimensional (2D) navigable workspace, and wherein the first viewpoint coordinate data includes first viewpoint position data indicating a position of the first viewpoint in the 2D navigable workspace.

23. The system of claim 19 wherein the processor further, in executing the instructions, after storing the display object coupling data indicating that the selected display object is coupled to the first viewpoint,

receiving a plurality of next viewpoint displacement signals requesting viewpoint motion;

each viewpoint displacement signal indicating the system user'"'"'s selection of a next viewpoint displaced from a preceding viewpoint; and

presenting in the display area, in response to each next viewpoint displacement signal, a respective image including the selected display object;

the respective image being perceptible as viewed from the next viewpoint;

the selected display object being presented in each respective image using the display object coupling data, the first viewpoint coordinate data and the next viewpoint so that the selected display object is perceptible as being viewed from the first viewpoint of the first n-dimensional navigable workspace;

the selected display object being perceptible by the system user during the requested viewpoint motion in each respective image as being coupled to the first viewpoint while the selected display object is being transported.

24. The system of claim 19 wherein the first signal further includes a signal selected from a move object signal and a copy object signal.

25. The system of claim 19 wherein the processor, in executing the instructions for responding to the second signal, further

determines an updated display object position in the first n-dimensional navigable workspace for the selected display object using the stored first viewpoint coordinate data and the second viewpoint;

and

presents the selected display object in the second image in the updated display object position.

26. The system of claim 25 wherein

the selected display object is represented by a first object data structure stored in the memory of the system;

the first object data structure including first object absolute position data indicating an original position of the selected display object; and

the processor, in executing the instructions for presenting the second image, further modifies the first object absolute position data to indicate the updated display object position of the selected display object in the first n-dimensional navigable workspace.

27. The system of claim 26 wherein, when the first n-dimensional navigable workspace is a 3D navigable workspace wherein the first viewpoint includes a first viewpoint position and a first viewpoint orientation,

the processor, in executing the instructions for determining the updated display object position, further determines an updated display object orientation in the 3D navigable workspace for the selected display object using the stored first viewpoint coordinate data and the second viewpoint;

the first object data structure further includes first object absolute orientation data indicating an original orientation of the selected display object; and

the processor, in executing the instructions for modifying the first object absolute position data, further modifies the first object absolute orientation data to indicate the updated display object orientation of the selected display object in the second image.

28. The system of claim 26 wherein, when the first n-dimensional navigable workspace is a 3D navigable workspace wherein the first viewpoint includes a first viewpoint position and a first viewpoint scale,

the processor, in executing the instructions for determining the updated display object position, further determines an updated display object scale in the 3D navigable workspace for the selected display object using the stored first viewpoint coordinate data and the second viewpoint;

the first object data structure further includes first object absolute scale data indicating an original scale of the selected display object; and

the processor, in executing the instructions for modifying the first object absolute position data, further modifies the first object absolute scale data to indicate the updated display object scale of the selected display object in the second image.

29. The system of claim 19 wherein the second viewpoint selected by the system user is in a second navigable workspace;

the processor presenting the second image of the second navigable workspace on the display in response to the second signal.

30. The system of claim 29 wherein

the second navigable workspace is represented by a workspace data structure, stored in the memory of the system;

and

the processor, in executing the instructions for responding to the second signal, further modifies the workspace data structure to indicate that the selected display object is included in the second navigable workspace.

31. A method of transporting display objects between three-dimensional (3D) navigable workspaces in a system;

the system including a user input device for receiving signals indicating actions and requests of a system user;

a display device having a display area for presenting images;

a processor connected for receiving the signals from the user input device, and connected for providing images to the display device; and

memory for storing data;

the processor being further connected for accessing the data stored in the memory;

the method comprising;

(a) presenting a first image in the display area of the display device that is perceptible as viewed from a first viewpoint and from a first orientation in a first 3D navigable workspace;

the first image including a first display object;

the first 3D navigable workspace being represented by a first workspace data structure stored in the system memory indicating that the first display object is included in the first 3D navigable workspace;

(b) receiving a first signal from the user input device indicating a request by the system user to transport a selected display object;

the first signal further indicating a selection by the system user of the first display object as the selected display object;

(c) in response to the first signal, modifying a display object coupling data item to indicate that the selected display object is coupled to the first viewpoint and to the first orientation;

the selected display object indicating the display object coupling data item;

(d) receiving a second signal from the user input device indicating the system user'"'"'s selection of a second viewpoint and a second orientation in a second 3D navigable workspace;

the second 3D navigable workspace being represented by a second workspace data structure stored in the system memory;

(e) storing in the system memory, in response to the second signal, first viewpoint coordinate data indicating the first viewpoint and the first orientation;

(f) when the display object coupling data item indicates that the selected display object is coupled to the first viewpoint and to the first orientation, determining an updated display object position and an updated display object orientation in the second 3D navigable workspace for the selected display object using the stored first viewpoint coordinate data, the second viewpoint and the second orientation;

(g) presenting a second image of the second 3D navigable workspace in the display area;

the second image being perceptible as viewed from the second viewpoint and the second orientation;

the second image including the selected display object in the updated display object position and having the updated display object orientation in the second 3D navigable workspace so that the selected display object is perceptible in the second image as being viewed from the first viewpoint and the first orientation of the first 3D navigable workspace;

(h) modifying, in response to the second signal, the first and second workspace data structures to indicate that the first display object is included in the second 3D navigable workspace;

(i) receiving a third signal from the user input device indicating that transporting the selected display object is completed; and

(j) in response to the third signal, modifying the display object coupling data item to indicate that the selected display object is not coupled to the first viewpoint and to the first orientation.

32. The method of claim 31 further including, after step (c) of storing the display object coupling data, performing viewpoint motion in the first 3D navigable workspace;

the step of performing viewpoint motion including

receiving a plurality of next viewpoint displacement signals requesting viewpoint motion;

each next viewpoint displacement signal indicating the system user'"'"'s selection of a next viewpoint and a next orientation in the first 3D navigable workspace displaced from a preceding viewpoint and from a preceding orientation in the first 3D navigable workspace;

storing in the system memory, in response to each next viewpoint displacement signal, prior viewpoint coordinate data indicating the preceding viewpoint and the preceding orientation;

determining an updated display object position and an updated display object orientation in the first 3D navigable workspace for the selected display object using the stored prior viewpoint coordinate data, the next viewpoint and the next orientation; and

presenting a next image of the first 3D navigable workspace in the display area;

the next image being perceptible as viewed from the next viewpoint and from the next orientation;

the next image including the selected display object in the updated display object position and having the updated display object orientation in the first 3D navigable workspace so that the selected display object is perceptible in the next image as being viewed from the first viewpoint and the first orientation of the first 3D navigable workspace.

33. The method of claim 31 further including, after step (c) of storing the display object coupling data, performing viewpoint motion in the second 3D navigable workspace;

the step of performing viewpoint motion including

receiving, as the second user signal, a plurality of next viewpoint displacement signals requesting viewpoint motion in the second 3D navigable workspace;

each viewpoint displacement signal indicating the system user'"'"'s selection of a next viewpoint and a next orientation displaced from a preceding viewpoint and from a preceding orientation; and

repeating steps (e), (f) and (g) in response to each next viewpoint displacement signal;

each second image presented being perceptible as viewed from the next viewpoint and the next orientation;

the selected display object presented in each second image being perceptible as being viewed from the first viewpoint and from the first orientation of the first 3D navigable workspace.

34. The method of claim 31 wherein the transport request is selected by the system user from a plurality of requests including a move object request and a copy object request.

35. An article of manufacture for use in a system that includes a display having a display area for presenting images to a system user;

a user input device for receiving signals indicating actions and requests of the system user;

memory for storing data;

a storage medium access device for accessing a medium that stores data; and

a processor connected for receiving data from the user input device, for providing data defining images to the display, and for accessing the data stored in the memory;

the processor further being connected for receiving data from the storage medium access device;

the article comprising;

a data storage medium that can be accessed by the storage medium access device when the article is used in the system; and

data stored in the data storage medium so that the storage medium access device can provide the stored data to the processor when the article is used in the system;

the stored data comprising

signal receiving instruction data indicating input instructions the processor can execute to receive signal data from the user input device;

the signal data including first, second and third signals for selecting a first display object included in a first image displayed in the display area for transporting to a destination location;

the first image being perceptible as viewed from a first viewpoint in a first navigable workspace; and

operation performing instruction data indicating response instructions the processor can execute to perform operations in response to the signal data;

when the first signal indicates the system user'"'"'s selection of the first display object as a selected display object, execution of the response instructions causing the processor to store display object coupling data indicating that the selected display object is coupled to the first viewpoint;

when the second signal indicates the system user'"'"'s selection of a second viewpoint, execution of the response instructions causing the processor to store first viewpoint coordinate data indicating a position of the first viewpoint in the first workspace, and to present a second image including the selected display object in the display area;

the second image being perceptible as viewed from the second viewpoint;

the selected display object being presented in the second image using the first viewpoint coordinate data so that the selected display object is perceptible as viewed from the first viewpoint; and

when the third signal indicates that transporting the selected display object has been completed, execution of the response instructions causing the processor to modify the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint.

36. In an interactive system including a display device having a display area for presenting graphical images of a navigable workspace, a user interaction device that permits a user to interact with display objects positioned in the workspace and to perform viewpoint motion in the workspace, a processor for executing instructions, and a memory having instructions stored therein indicating instructions the processor executes for producing and presenting the graphical images;

each graphical image being perceptible as viewed from one of a plurality of viewpoints in the navigable workspace;

the improvement wherein

the processor, in executing the instructions in response to a first signal from the system user for transporting a selected display object included in a first graphical image in the workspace, stores display object coupling data indicating that the selected display object is coupled to a first viewpoint in the navigable workspace;

the processor, in executing instructions in response to a second signal indicating selection of a second viewpoint, stores first viewpoint coordinate data indicating the first viewpoint, and presents a second graphical image perceptible as viewed from the second viewpoint;

the second graphical image including the selected display object;

when the display object coupling data indicates that the selected display object is coupled to a first viewpoint, the selected display object being presented in the second graphical image using the stored first viewpoint coordinate data so that the selected display object is perceptible as viewed from the first viewpoint; and

the processor, in executing the instructions in response to a third signal indicating that transporting the selected display object has been completed, modifies the display object coupling data to indicate that the selected display object is not coupled to the first viewpoint.

37. The improvement in the interactive system of claim 36 wherein

the second viewpoint is in a second navigable workspace;

the second navigable workspace being represented by a workspace data structure stored in the memory of the interactive system;

the second graphical image being a view of the second navigable workspace; and

the processor, further in executing the instructions in response to the second signal, modifies the workspace data structure to indicate that the selected display object is included in the second navigable workspace.

38. The improvement in the interactive system of claim 36 wherein the processor, in response to a series of next viewpoint request signals indicating system user requests for viewpoint motion in the workspace received before the third signal is received, presents a respective next graphical image in response to each of the series of next viewpoint request signals;

each respective next graphical image being perceptible as viewed from a next viewpoint;

when the display object coupling data indicates that the selected display object is coupled to the first viewpoint, the selected display object being presented in each respective next graphical image using the stored first viewpoint coordinate data so that the selected display object is perceptible as being viewed from the first viewpoint.