Interactive system and related method for displaying data to produce a three-dimensional image of an object

• US 4,809,065 A
• Filed: 12/01/1986
• Issued: 02/28/1989
• Est. Priority Date: 12/01/1986
• Status: Expired due to Fees

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Harris, Lowell D., Smith, Charles R.
• Primary Examiner(s): Groody, James J.
• Assistant Examiner(s): Kostak, Victor R.
• Application Number:
  US06/936,156
• Time in Patent Office: 820 Days
• Field of Search: 358/88, 358/903, 358/3, 358/89, 358/104, 358/91, 358/92, 364/522, 364/521, 340/720, 340/723, 340/729, 273/313
• US Class Current: 348/51
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals

Abstract

A system for displaying data to produce a three-dimensional image, and interactively modifying and transforming the data and the resultant image in response to user commands comprises control circuitry, a high-speed processor linked to the control circuitry, a memory linked to the control circuitry and to the high-speed processor, and a raster-based display linked to the control circuitry and to the memory. The control circuitry is programmed to transfer data from the memory to the high-speed processor, to control the high-speed processor in modifying and transforming the data in response to, and in accordance with, the user command to obtain transformed data representative of a plurality of two-dimensional rasters of pixels, to transfer the transformed data from the high-speed processor to the memory, and to control the raster-based display in displaying the transformed data.

Claims

1. A system for selectively, interactively modifying and transforming image data of an object in response to user commands to generate transformed data from selected high-quality three-dimensional images of the object to be displayed on a display comprising:

user input means for inputting the user commands;

memory means for storing a plurality of arrays of image data, each of said image data arrays corresponding to a different plane of sample data associated with an attribute of the object;

high-speed processing means coupled to said memory means for selectively transforming said arrays of image data to produce corresponding arrays of transformed data and for storing said arrays of transformed data in said memory means;

a raster-based display means coupled to said memory means; and

control means coupled to said user input means, said memory means, said high-speed processing means, and said raster-based display means, for receiving and decoding the user commands from said input means and, in response to the decoded user commands, for controlling (1) said high-speed processing means to access selected image data arrays stored in said memory means, to modify said accessed image data arrays to produce corresponding modified image data arrays, and to transform said modified image data arrays to produce said transformed data arrays which correspond to the selected high-quality three-dimensional images of the object, and to store said transformed data arrays in said memory means, wherein each of said transformed data arrays stored in said memory means comprises a corresponding file including a plurality of transformed image datum to be displayed by said raster-based display means within an interval of time corresponding to a display cycle, each of said transformed image datum in a file being displayable by said raster-based display means within an interval of time corresponding to a pixel interval, and wherein each of said image datum comprises transformation control bits and sample magnitude bits, and wherein said control means further includes means for controlling said high-speed processing means to modify the values of said transformation control bits of said image datum in response to the received user commands to obtain a modified image datum, and wherein said high-speed processing means further includes means for transforming the values of said sample magnitude bits of said modified image datum under the control of said control means in accordance with the values of the transformation control bits of said modified image datum to obtain a corresponding transformed datum and (2) said raster-based display means to display said transformed data arrays stored in said memory means to display the selected high-quality three-dimensional images of the object.

2. A system according to claim 1, wherein said high-speed processing means includes a cache memory coupled to said memory means and to said control means, and a high-speed processor coupled to said control means and to said cache memory, wherein said control means includes means (1) for controlling the transfer of said image data arrays from said memory means to said cache memory, and (2) for controlling said high-speed processor to modify said image data arrays transferred to said cache memory to obtain said modified image data arrays to transform said modified image data arrays to obtain said transformed data arrays, and to transfer said transformed data arrays from said cache memory to said memory means.

3. A system of claim 2, wherein said control means further includes means for controlling the transfer of said transformed data arrays to said raster-based display means for display thereby.

4. A method for processing a plurality of two-dimensional arrays of input data wherein each array of input data corresponds to a plane of sample data in an object and each corresponds to the value of an attribute of the object at a particular location therein, the method for producing and displaying high-quality three-dimensional images of the object, and for interactively modifying and transforming the data to produce and display resultant transformed images in response to user commands comprising the steps of:

(a) initializing the system comprising the substeps of receiving the arrays of input data representing the two-dimensional planes of samples of an attribute of the object;

formatting the received arrays of input data to obtain image data arrays representative of the plurality of sample planes, each of said image data arrays including a plurality of image datum, each of said image datum corresponding to a different location within the object and including sample magnitude bits having a value determined by the sample of the attribute of the object at said corresponding location, and transformation control bits, and setting up look-up tables in accordance with the user commands;

(b) compressing each of said image data arrays at different degrees of compression to obtain a singly compressed data array and a doubly compressed data associated with each of said image data arrays;

(c) selecting detail level arrays comprising selected ones of said singly compressed data arrays or said double compressed data arrays in response to a user command to display selected corresponding image data arrays;

(d) modifying the values of the transformation control bits of said selected detail level arrays in response to, and in accordance with, said user commands to obtain modified image data arrays, each of said modified image data arrays comprising a plurality of modified image datum;

(e) transforming said modified image data arrays to obtain corresponding transformed data arrays, each of said transformed data arrays including a two-dimensional raster of pixel values, said step of transforming including the substeps of selecting for each modified image datum a look-up table and transforming the value of each of said modified image datum according to said selected look-up table to obtain a corresponding transformed image datum having a brightness magnitude value;

(f) forming a block of control data corresponding to a different one of each of said transformed data arrays wherein each of said control blocks comprises address data necessary to locate the transformed image data array representative of a corresponding raster, synchronization data indicative of a pixel display interval to begin displaying the transformed data representative of said corresponding raster, and deflection data necessary to correct for anomalous perspective in the display of said corresponding transformed image data array; and

(g) displaying a selected transformed image data array according to said corresponding block of control data.

5. A system for selectively, interactively modifying and transforming image data of an object in response to user commands to generate transformed data from selected high-quality three-dimensional images of the object to be displayed on a display comprising:

user input means for inputting the user commands;

memory means for storing a plurality of arrays of image data, each of said image data arrays corresponding to a different plane of sample data associated with an attribute of the object;

high-speed processing means coupled to said memory means for selectively transforming said arrays of image data to produce corresponding arrays of transformed data and for storing said arrays of transformed data in said memory means;

a raster-based display means coupled to said memory means; and

control means coupled to said user input means, said memory means, said high-speed processing means, and said raster-based display means, for receiving and decoding the user commands from said input means and, in response to the decoded user commands, for controlling (1) said high-speed processing means to access selected image data arrays stored in said memory means, to modify said accessed image data arrays to produce corresponding modified image data arrays, and to transform said modified image data arrays to produce said transformed data arrays which correspond to the selected high-quality three-dimensional images of the object, and to store said transformed data arrays in said memory means, and (2) said raster-based display means to display said transformed data arrays stored in said memory means to display the selected high-quality three-dimensional images of the object, wherein said high-speed processing means includes a cache memory coupled to said memory means and to said control means, and a high-speed processor coupled to said control means and to said cache memory, wherein said control means includes means (1) for controlling the transfer of said image data arrays from said memory means to said cache memory, and (2) for controlling said high-speed processor to modify said image data arrays transferred to said cache memory to obtain said modified image data arrays to transform said modified image data arrays to obtain said transformed data arrays, and to transfer said transformed data arrays from said cache memory to said memory means, and wherein said control means further includes means for controlling the transfer of said transformed data arrays to said raster-based display means for display thereby, and wherein said raster-based display means includes (1) a scratch-pad memory coupled to said control means, and (2) display control means coupled to said scratch-pad memory, said control means, and said memory means, and wherein said display control means includes means controlled by said control means for selectively retrieving said transformed data arrays stored in said memory means and for displaying said transformed data arrays in accordance with the user commands.

6. A system according to claim 5, wherein each of said transormed data arrays stored in said memory means comprises a corresponding file including a plurality of transformed image datum to be displayed by said raster-based display means within an interval of time corresponding to a display cycle, each of said transformed image datum in a file being displayable by said raster-based display means within an interval of time corresponding to a pixel interval.

7. A system according to claim 6, wherein each of said files corresponding to said transformed data arrays is stored in said memory means and represents an associated two-dimensional raster of display pixels, and wherein said control means further includes means for forming a different block of control data associated with each of said rasters comprising address data indicative of the locations in said memory means where the transformed data array representative of said associated raster is stored, synchronization data indicative of the pixel interval within the display cycle to begin displaying said transformed data array representative of said associated raster, and initial and increment values of horizontal and vertical deflection data for controlling said raster-based display means.

8. A system according to claim 7, wherein said raster-based display means further includes a CRT, and wherein said display control means further includes means for receiving a block of said control data from said control means, for retrieving the corresponding transformed data array stored at said locations in said memory means indicated by said address data of said control block, and for displaying said retrieved transformed data array beginning at the pixel interval within the display cycle indicated by the synchronization data of said control block to obtain a two-dimensional image on said CRT having a size determined by said horizontal and vertical deflection data.

9. A system according to claim 8, wherein said control means includes means for forming said plurality of files of transformed data in response to, and in accordance with, the received user commands, for storing said plurality of files in said memory means, for forming a plurality of files of associated control blocks of control data wherein each of said files of control blocks corresponds to a different one of said files of transformed image data and wherein each control block corresponds to a raster represented by the corresponding file of transformed data, for transferring said files of control blocks of control data to said raster-based display means, for selecting one of said files of transformed data in response to a user command, and for signalling said raster-based display means to display the transformed data included in said selected file in accordance with the corresponding file of control blocks.

10. A system according to claim 9, wherein said display control means further includes means for receiving said plurality of files of control blocks, for storing said received files in said scratch-pad memory, for choosing one of said files stored in said scratch-pad memory in response to said signal from said control means, for retrieving the corresponding file of transformed image data from said memory means, and for controlling said raster-based display means to display said retrieved data in accordance with said selected block of control data.

11. A system according to claim 10, wherein said control means further includes means for controlling said high-speed processing means to form a plurality of look-up tables in response to the received user commands, and wherein said high-speed processing means further includes a second scratch-pad memory coupled to said control means, to said cache memory, and to said high-speed processor for storing said look-up tables.

12. A system according to claim 11, wherein each of said image datum comprises transformation control bits and sample magnitude bits, and wherein said control means further includes means for controlling said high-speed processing means to modify the values of said transforming control bits of said image datum in response to the received user commands to obtain a modified image datum, and wherein said high-speed processor further includes means for transforming the values of said sample magnitude bits of said modified image datum under the control of said control means in accordance with the values of the transformation control bits of said modified image datum to obtain a corresponding transformed datum.

13. A system according to claim 12, wherein said high-speed processor further includes means for selecting one of said look-up tables according to the value of the transformation control bits of said modified image datum, and for setting the value of the sample magnitude bits of said modified image datum according to said selected look-up table to obtain a corresponding transformed datum.