User interface technique for producing a second image in the spatial context of a first image using a model-based operation
First Claim
1. A method of operating a machine;
- the machine including;
a signal source for producing signals indicating image display requests;
output circuitry connected to an output utilization device;
the output utilization device producing human perceptible output;
the output utilization device including a display having a display area for presenting images in response to receiving image definition data from the output circuitry;
the display area having a first image displayed in a present image position therein;
a processor connected for receiving the signals from the signal source, and connected for providing data defining human perceptible output to the output circuitry; and
memory for storing data;
the data stored in the memory including;
a first image model data structure;
the first image being produced using the first image model data structure; and
instruction data indicating instructions the processor executes;
the instruction data including a model-based output operation for use in operating on the first image model data structure;
the processor further being connected for accessing the data stored in the memory;
the method comprising;
operating the processor to receive request signal data from the signal source;
the request signal data indicating a display request to present an output producing region in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image;
the output producing region having the model-based output operation associated therewith; and
operating the processor to respond to the request signal data indicating the display request bydetermining an input portion of the first image model data structure using the present viewing position of the output producing region;
producing output signal data defining human perceptible output using the model-based output operation and using the input portion of the first image model data structure; and
providing the output signal data defining the human perceptible output to the output circuitry connected to the output utilization device so that the output utilization device presents the human perceptible output in response to the display of the output producing region substantially at the same time as the first image is being displayed in the display area;
whereby presentation of the human perceptible output produced using the first image model data structure in response to the display request gives the perception to a machine user of providing information related to the first image segment.
4 Assignments
0 Petitions
Accused Products
Abstract
A technique for producing a second image for display in the context of an original image uses a model data structure, in contrast to an image-based data structure, and a model-based operation, called a viewing operation, in contrast to an image-based operation, to produce the second image. The second image is displayed in the spatial context of the original image, as that context is defined by a viewing operation region, or VOR, at the same time as the original image is being displayed, giving the perception to a machine user of providing information related to the original image in the spatial context of the original image. The VOR functions as a type of "visual filter", binding the second view of the original image to the display area defined by the VOR. In one illustrated embodiment, the method operates within the environment of a rendering application executing in a graphical user interface environment. A machine user moves the VOR over a portion of a rendered image, and in response to the user'"'"'s movement action, a viewing operation associated with the VOR invokes the renderer that produced the original rendered image to produce a second modified view of the original image using a new value for a global parameter in the scene description. The second image is then clipped to the size and shape of the VOR, and is then presented in the VOR, showing the second modified view.
-
Citations
33 Claims
-
1. A method of operating a machine;
- the machine including;
a signal source for producing signals indicating image display requests; output circuitry connected to an output utilization device;
the output utilization device producing human perceptible output;
the output utilization device including a display having a display area for presenting images in response to receiving image definition data from the output circuitry;
the display area having a first image displayed in a present image position therein;a processor connected for receiving the signals from the signal source, and connected for providing data defining human perceptible output to the output circuitry; and memory for storing data;
the data stored in the memory including;a first image model data structure;
the first image being produced using the first image model data structure; andinstruction data indicating instructions the processor executes;
the instruction data including a model-based output operation for use in operating on the first image model data structure;the processor further being connected for accessing the data stored in the memory; the method comprising; operating the processor to receive request signal data from the signal source;
the request signal data indicating a display request to present an output producing region in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image;
the output producing region having the model-based output operation associated therewith; andoperating the processor to respond to the request signal data indicating the display request by determining an input portion of the first image model data structure using the present viewing position of the output producing region; producing output signal data defining human perceptible output using the model-based output operation and using the input portion of the first image model data structure; and providing the output signal data defining the human perceptible output to the output circuitry connected to the output utilization device so that the output utilization device presents the human perceptible output in response to the display of the output producing region substantially at the same time as the first image is being displayed in the display area; whereby presentation of the human perceptible output produced using the first image model data structure in response to the display request gives the perception to a machine user of providing information related to the first image segment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
- the machine including;
-
12. A method of operating a machine;
- the machine including;
input circuitry connected to a user input device;
the input circuitry receiving signals indicating requests of a machine user;output circuitry connected to a display having a display area for presenting images;
the display area having a first image displayed in a present image position therein;a processor connected for receiving the signals from the input circuitry, and connected for providing image definition data defining images to the output circuitry; and memory for storing data;
the data stored in the memory including;instruction data indicating instructions the processor executes; and a first image model data structure;
the first image being produced from the first image model data structure;the processor further being connected for accessing the data stored in the memory; the method comprising; operating the processor to receive request signal data from the input circuitry indicating a display request by the machine user to display a viewing operation region in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image;
the viewing operation region having a model-based viewing operation associated therewith for mapping the first image model data structure to image definition data defining a second image for display in the viewing operation region; andoperating the processor to respond to the request signal data indicating the display request by producing image definition data defining the second image according to the model-based viewing operation using the first image model data structure;
the second image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region; andproviding the image definition data defining the second image to the output circuitry connected to the display so that the display presents the second image in the viewing operation region in response to the image definition data;
the second image being displayed substantially at the same time as the first image is being displayed in the display area;whereby replacing the first image segment in the display area with the presentation of the second image in the viewing operation region in response to the display request by the machine user gives the perception to the machine user of producing a view of the first image according to the model-based viewing operation associated with the viewing operation region. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
- the machine including;
-
20. A method of operating a machine;
- the machine including;
a user input device for receiving signals indicating actions of a machine user; a display having a display area for presenting images;
the display area having a first image displayed in a present image position therein;
the first image including a first display feature;a processor connected for receiving the signals from the user input device, and connected for providing image definition data defining images to the display; and memory for storing data;
the data stored in the memory including;instruction data indicating instructions the processor executes; and a first image model data structure;
the first image being produced from the first image model data structure;
the first image model data structure including a display feature attribute data item represented by the first display feature included in the first image;
the display feature attribute data item having a present attribute value indicating the first display feature when displayed in the display area;the processor further being connected for accessing the data stored in the memory; the method comprising; operating the processor to provide image definition data defining a viewing operation region image to the display;
the display presenting the viewing operation region image in response to the image definition data;
the viewing operation region image showing a viewing operation region displayed in a first position in the display area;
the viewing operation region having a model-based viewing operation associated therewith for mapping the present attribute value of the display feature attribute data item to a new attribute value;operating the processor to receive user signal data from the user input device;
the user signal data indicating a movement action by the machine user moving the viewing operation region from the first position in the display area to a present viewing position coextensive with the present image position of a first image segment of the first image;
the first image segment including the first display feature; andoperating the processor to respond to the user signal data indicating movement of the viewing operation region by providing image definition data defining a second image to the display so that the display presents the viewing operation region in the present viewing position and presents the second image in the viewing operation region in response to the image definition data;
the second image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region;
the second image showing a modified first display feature representing the new attribute value for the display feature attribute data item included in the first model data structure;whereby presentation in the viewing operation region of the modified first display feature included in the second image replaces presentation of the first display feature included in the first image segment. - View Dependent Claims (21)
- the machine including;
-
22. A method of operating a machine;
- the machine including;
input circuitry connected to a user input device;
the input circuitry receiving signals indicating requests of a machine user;output circuitry connected to a display having a display area for presenting images;
the display area having a rendered image displayed in a present image position therein;a processor connected for receiving the signals from the input circuitry, and connected for providing image definition data defining images to the output circuitry; and memory for storing data;
the data stored in the memory including;a scene description model data structure used for producing the rendered image;
the scene description model data structure including a display feature attribute data item having a present attribute value for controlling the appearance of a plurality of image display features in the first image; andinstruction data indicating instructions the processor executes;
the instruction data including rendering operation instruction data defining a graphical image rendering operation capable of producing the rendered image from the scene description model data structure;the processor further being connected for accessing the data stored in the memory; the method comprising; operating the processor to receive request signal data from the input circuitry indicating a display request by the machine user to display a viewing operation region in a present viewing position in the display area coextensive with the present image position of a first image segment of the rendered image; and operating the processor to respond to the request signal data indicating the display request by obtaining a new attribute value for the display feature attribute data item;
the new attribute value indicating a plurality of modified image display features;obtaining second image size-and-position data from the present viewing position of the viewing operation region in the display area indicating size and position information about a second rendered image; executing the rendering operation instruction data defining the graphical image rendering operation to produce image definition data defining the second rendered image using the scene description model data structure, the new attribute value for the display feature attribute data item, and the second image size-and-position data;
the second rendered image including the plurality of modified image display features modified according to the new attribute value;
the second rendered image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region; andproviding the image definition data defining the second rendered image to the output circuitry connected to the display so that the display presents the second rendered image in the viewing operation region;
the second rendered image being displayed substantially at the same time as the rendered image is being displayed in the display area;whereby, in response to the display request by the machine user, the second rendered image displayed in the viewing operation region appears to replace the first image segment in the display area in the spatial context of the rendered image, giving the appearance to the machine user of replacing the plurality of image display features in the first image segment with the plurality of modified image display features.
- the machine including;
-
23. A machine comprising:
-
a signal source for producing signals indicating output operation requests; output circuitry connected to an output utilization device;
the output utilization device presenting human perceptible output;
the output utilization device including a display having a display area for presenting images;
the display area having a first image displayed in a present image position therein;a processor connected for receiving the signals from the signal source, and connected for providing data defining human perceptible output to the output circuitry for presentation by the output utilization device; and memory for storing data;
the data stored in the memory including;a first image model data structure;
the first image being produced using the first image model data structure; andinstruction data indicating instructions the processor can execute;
the instructions including a model-based output operation for use in operating on the first image model data structure;the processor being further connected for accessing the data stored in the memory; the processor, in executing the output operation instructions, receiving request signal data from the signal source;
the request signal data indicating a display request to present an output producing region displayed in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image;
the output producing region having the model-based output operation associated therewith;the processor further, in responding to the request signal data indicating the display request, determining an input portion of the first image model data structure using the present viewing position of the viewing operation region; producing output signal data defining human perceptible output using the model-based output operation and the input portion of the first image model data structure; and providing the output signal data defining the human perceptible output to the output circuitry connected to the output utilization device so that the output utilization device presents the human perceptible output in response to the output signal data;
the output utilization device presenting the human perceptible output in response to the display of the output producing region at the same time as the first image is being displayed in the display area;whereby presentation of the human perceptible output produced using the first image model data structure in response to the display request gives the perception to a machine user of providing information related to the first image segment.
-
-
24. A machine comprising:
-
input circuitry connected to a user input device;
the input circuitry receiving signals indicating requests of a machine user;output circuitry connected to a display having a display area for presenting images;
the display area having a first image displayed in a present image position therein;a processor connected for receiving the signals from the input circuitry, and connected for providing image definition data defining images to the output circuitry for presentation by the display; and memory for storing data;
the data stored in the memory including;a first image model data structure;
the first image being produced from the first image model data structure; andinstruction data indicating instructions the processor can execute;
the instruction data including a model-based viewing operation for operating on the first image model data structure;the processor being further connected for accessing the data stored in the memory; the processor, in executing the instructions, receiving request signal data from the input circuitry indicating a display request by the machine user to display a viewing operation region in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image;
the viewing operation region having the model-based viewing operation associated therewith;the processor further, in executing the instructions, responding to the request signal data indicating the display request by producing image definition data defining a second image using the model-based viewing operation and the first image model data structure;
the second image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region; andproviding the image definition data defining the second image to the output circuitry connected to the display so that the display presents the second image in the viewing operation region in response to the image definition data;
the second image being displayed substantially at the same time as the first image is being displayed in the display area;whereby the processor, in executing the instructions, causes the presentation of the second image in the viewing operation region to replace the presentation of the first image segment in the display area in response to the display request by the machine user. - View Dependent Claims (25)
-
-
26. An article of manufacture for use in a machine that includes:
-
a display having a display area for presenting images to a machine user;
the display area having a first image displayed in a first image position therein;a user input device for receiving signals indicating actions of the machine user; memory for storing data;
the data stored in the memory including a first image model data structure;
the first image being produced from the first image model data structure;a storage medium access device for accessing a medium that stores data; and a processor connected for receiving data from the user input device, for providing data defining images to the display, and for accessing the data stored in the memory;
the processor further being connected for receiving data from the storage medium access device;the article comprising; a data storage medium that can be accessed by the storage medium access device when the article is used in the machine; and data stored in the data storage medium so that the storage medium access device can provide the stored data to the processor when the article is used in the machine;
the stored data comprising instruction data indicating instructions the processor can execute;the processor, in executing the instructions, receiving request signal data from the user input device indicating a display request by the machine user to display a viewing operation region in a present viewing position in the display area coextensive with a present image position of a first image segment of the first image;
the viewing operation region having a model-based viewing operation associated therewith for operating on the first image model data structure;the processor, further in executing the instructions, responding to the display request by providing image definition data defining a second image to the display so that the display presents the second image in the viewing operation region in response to the image definition data;
the second image being produced according to the model-based viewing operation using the first image model data structure;
the second image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region;
the second image being displayed substantially at the same time as the first image is being displayed in the display area;whereby the processor, in executing the instructions indicated by the instruction data stored in the data storage medium, causes, in response to the display request by the machine user, presentation of the second image in the viewing operation region to replace presentation of the first image segment in the display area.
-
-
27. The article of manufacture according to 26 wherein,
in the machine that includes the display area having a first image displayed in a first image position therein, the first image including a first display feature; -
in the machine that includes the memory for storing the first image model data structure, the first image model data structure including a display feature attribute data item representing the first display feature in the first image; the processor, in receiving request signal data from the user input device indicating a display request by the machine user, displaying the viewing operation region so that the first image segment includes the first display feature; and the processor, further in executing the instructions, further responding to the display request by providing the image definition data defining the second image to the display, producing the image definition data defining the second image using a new attribute value for the display feature attribute data item included in the first model data structure;
the second image showing a modified first display feature representing the new attribute value;whereby the processor, in executing the instructions indicated by the instruction data stored in the data storage medium, causes, in response to the display request by the machine user, presentation of the second image including the modified first display feature in the viewing operation region to replace presentation of the first image segment including the first display feature in the display area.
-
-
28. A machine comprising:
-
input circuitry connected to a user input device;
the input circuitry receiving signals from the user input device indicating requests of a machine user;image output circuitry connected to a display having a display area for presenting images thereon; a memory for storing data; and a processor connected for receiving the signals from the input circuitry, and connected for providing image definition data defining images to the output circuitry connected to the display;
the output circuitry causing the display to present the images in the display area in response to receiving the image definition data;the data stored in the memory including; a model data structure indicating information; image definition data defining a first image;
the first image being produced using the model data structure and displayed in a present image position in the display area of the display;viewing operation interface instruction data indicating viewing operation region presentation instructions the processor can execute to produce image definition data defining a viewing operation region for display in the display area in a present viewing position;
the viewing operation region presentation instructions including input request instructions for receiving the request signal data from the input circuitry; andviewing operation instruction data indicating model-based viewing operation instructions the processor can execute to produce image definition data defining a second image using the model data structure;
the model-based viewing operation instructions determining an input portion of the model data structure for use in producing the second image by using the present viewing position of the viewing operation region to obtain a data item included in the model data structure;
the processor executing the model-based viewing operation instructions in response to executing the input request instructions for receiving the request signal data from the input circuitry;the processor being further connected for accessing the data stored in the memory; when request signal data is provided from the input circuitry indicating an image display request by the machine user to display the viewing operation region in the display area, execution of the viewing operation region presentation instructions causing the processor to receive the request signal data from the input circuitry and to display the viewing operation region in the present viewing position in the display area coextensive with the present image position of a first image segment of the first image; execution of the viewing operation region presentation instructions further causing the processor to execute the model-based viewing operation instructions to produce the second image using the model data structure; execution of the viewing operation instructions further causing the processor to display the second image in the viewing operation region substantially at the same time as the first image is being displayed in the display area so that the second image overlays and replaces the first image segment in the display area. - View Dependent Claims (29)
-
-
30. A method of operating a machine to provide multiple views of an information space;
- the machine including a display having a display area for presenting images;
a processor connected for providing image definition data defining images for presentation in the display area of the display; and
memory for storing data;
the data stored in the memory including instruction data indicating instructions the processor executes and a model data structure indicating information in the information space;
the processor further being connected for accessing the data stored in the memory;the method comprising; presenting a first image in a present image position in the display area of the display;
the first image being produced from the model data structure and representing a first view of the information space;providing a model-based viewing operation, stored in the memory of the machine, to produce a second image representing a second view of the information space using the model data structure; presenting a viewing operation region in a present viewing position in the display area coextensive with the present image position of a first image segment of the first image; determining an input portion of the model data structure for use in producing the second image;
the input portion of the model data structure being determined by using the present image position of the first image segment as determined by the present viewing position of the viewing operation region coextensively positioned therewith;producing the second image representing the second view of the information space using the model-based viewing operation and the input portion of the model data structure; and presenting the second image in the viewing operation region so that the second image overlays and replaces the first image segment in the display area;
the second image having size and shape dimensions substantially identical to size and shape dimensions of the viewing operation region, and being displayed substantially at the same time as the first image is being displayed in the display area. - View Dependent Claims (31, 32, 33)
- the machine including a display having a display area for presenting images;
Specification