Stereoscopically display three dimensional ultrasound imaging

• US 5,488,952 A
• Filed: 05/31/1994
• Issued: 02/06/1996
• Est. Priority Date: 02/24/1982
• Status: Expired due to Fees

• Current Assignee: Schoolman Scientific Corporation
• Original Assignee: Schoolman Scientific Corporation
• Inventors: Schoolman, Arnold
• Primary Examiner(s): Hayes, Gail O.
• Assistant Examiner(s): Thomas, Joseph
• Application Number:
  US08/250,933
• Time in Patent Office: 616 Days
• Field of Search: 364/413.22, 364/413.25, 348/42, 348/51, 348/53, 348/46, 128/660.04, 128/916, 128/653.1, 128/660.01, 128/660.05, 351/201
• US Class Current: 600/443
• CPC Class Codes: A61B 1/00048 Constructional features of the display
• CPC Class Codes: A61B 1/00193 adapted for stereoscopic vision
• CPC Class Codes: A61B 6/022 Stereoscopic imaging
• CPC Class Codes: A61B 6/4441 the rigid structure being a C-arm or U-arm
• CPC Class Codes: A61B 6/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/00 Diagnosis using ultrasonic, sonic or infrasonic waves imaging of objects using sonar G01S15/00
• CPC Class Codes: A61B 8/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: B25J 19/023 including video camera means
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G02B 30/35 using reflective optical elements in the optical path between the images and the observer
• CPC Class Codes: H04N 13/158 Switching image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/344 : with head-mounted left-right displays
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: Y10S 128/916 : Ultrasound 3-D imaging

Abstract

A stereoscopically displayed three dimensional ultrasound imaging system derives image data from an ultrasound imaging apparatus including a two dimensional ultrasound transducer array, reconstructs the image data into a three dimensional model, and displays right and left stereoscopic three dimensional image components of the model on corresponding right and left video display devices of a stereoscopic viewing unit. The system includes a system computer interfaced to the imaging apparatus and a pair of image channels, each including a three dimensional display processor, and a video display device. The three dimensional display processors receive polygon image data, reconstruct it into a three dimensional form, and select image data representing a three dimensional view from a selected perspective. The system computer controls the display processors to present mutually angularly displaced views of the same three dimensional image to form the stereoscopic image components.

Claims

1. A method of ultrasound imaging of anatomical structures of an organism comprising the steps of:

(a) providing ultrasound energy;

(b) propagating said energy through an organism having anatomical structures therein such that said energy is reflected from said anatomical structures;

(c) receiving said energy after reflection from said anatomical structures;

(d) measuring parameters of the reflected energy resulting from reflection from said anatomical structures;

(e) converting said parameters to three dimensional image data representing images of said anatomical structures, said three dimensional image data comprising a range of shades of display color;

(f) transforming said image data into independent, angularly displaced right and left three dimensional video signals representing right and left eye three dimensional stereoscopic components of an image of said anatomical structures from a first perspective, said transforming step including the steps of creating a three dimensional view from said first perspective of said three dimensional image data, said first perspective representing one of said right or left eye stereoscopic components and rotating said three dimensional image data from said first perspective to a second perspective and creating a second three dimensional view from said second perspective, said second perspective representing the other of said left and right eye stereoscopic components; and

(g) displaying said right and left stereoscopic components of said image on respective separate, independent right and left video displays to thereby provide a stereoscopic three dimensional view of said anatomical structures.

2. A method as set forth in claim 1 including the steps of:

(a) positioning said right and left video display devices in a head worn viewing harness in which said right and left video display devices are supported by the head of a person viewing said images.

3. A method as set forth in claim 1 and further including the steps of:

(a) causing said image of said anatomical structures as displayed to rotate about an axis from said first perspective to a third perspective; and

(b) repeating said transforming step with said third perspective representing said one of said right or left eye views.

4. A method as set forth in claim 1 including the steps of:

(a) correlating said range of shades of display color to a range of parameters of said energy as a result of reflection from said anatomical structures;

(b) selecting an inhibition range of said shades of display color; and

(c) causing the inhibition of the display of the inhibition range of said shades of display color to thereby enhance the view of remaining portions of said three dimensional image.

5. A method as set forth in claim 1 wherein:

(a) said propagating and receiving steps include propagating said energy through said organism and receiving said energy in such a manner as to obtain said image data as a data array of spatially related image data points having values related to said parameters; and

(b) said measuring and converting steps include interpolating to provide average image data point values between adjacent image data points to derive averaged image points interspersed among said image points to thereby create said three dimensional image.

6. A method as set forth in claim 1, wherein:

(a) said propagating and receiving steps include propagating said energy through said organism and receiving said energy in such a manner as to obtain said image data in a form of a plurality of closely spaced and sequential two dimensional cross sectional images of a segment of said organism; and

(b) said converting step includes assembling said image data in such a manner as to form a three dimensional model of said segment of said organism to thereby form said three dimensional image.

7. A method as set forth in claim 1 and further including the steps of:

(a) storing said three dimensional image data;

(b) recalling said three dimensional image data at a time remote from said generating step; and

(c) performing said transforming and displaying steps on said recalled three dimensional image data.

8. A method of three dimensionally imaging anatomical structures of an organism using ultrasound energy and stereoscopically displaying images of said structures comprising the steps

(a) providing said ultrasound energy;

(b) propagating said ultrasound energy through an organism having anatomical structures therein such that said energy is reflected from said anatomical structures;

(c) receiving said energy after reflection from said anatomical structures;

(d) measuring parameters of said energy resulting from reflection from said anatomical structures;

(e) converting said parameters to image data representing images of said anatomical structures, said image data comprising a range of shades of display color;

(f) performing said propagating, receiving, measuring, and converting steps in such a manner as to obtain said image data in a form of a plurality of closely spaced and sequential two dimensional data arrays of spatially related image data points having values related to said parameters of said energy, said data arrays forming cross sectional images of a segment of said organism;

(g) assembling said image data in such a manner as to form a three dimensional model;

(h) transforming said three dimensional model into independent, angularly displaced right and left three dimensional video signals representing right and left eye three dimensional stereoscopic components of said three dimensional model from a first perspective, said transforming step including the steps of creating a three dimensional view from said first perspective of said three dimensional image data, said first perspective representing one of said right or left eye stereoscopic components and rotating said three dimensional image data from said first perspective to a second perspective and creating a second three dimensional view from said second perspective, said second perspective representing the other of said left and right eye stereoscopic components;

(i) providing a stereoscopic display unit including separate, independent right left video displays;

(j) displaying said right three dimensional model stereoscopic image component of a three dimensional image of said three dimensional model on said right video display; and

(k) displaying said angularly displaced left three dimensional model stereoscopic image component of said three dimensional image of said three dimensional model on said left video display.

9. A method as set forth in claim 8 including the steps of:

(a) positioning said right and left video display devices in a head worn viewing harness in which said right and left video display devices are supported by the head of a person viewing said images.

10. A method as set forth in claim 8 and further including the steps of:

(a) causing said three dimensional model to rotate about an axis from said first perspective to a third perspective; and

(b) repeating said transforming step with said third perspective representing said one of said right or left eye views.

11. A method as set forth in claim 8 including the steps of:

(a) correlating said range of shades of display color to a range of said parameters;

(b) selecting an inhibition range of said shades of display color; and

(c) causing the inhibition of the display of the inhibition range of said shades of display color to thereby enhance the view of remaining portions of said image.

12. A method as set forth in claim 8, and further including the step of:

(a) interpolating said spatially related image data points to provide average image data point values between adjacent said spatially related image data points to derive averaged image points interspersed among said image data points.

13. A method as set forth in claim 8, and further including the steps of:

(a) storing said three dimensional model;

(b) recalling said three dimensional model at a time remote from said generating step; and

(c) performing said transforming and displaying steps on said recalled three dimensional model.

14. An apparatus for stereoscopic ultrasound imaging of anatomical structures and comprising:

(a) ultrasound imaging means propagating ultrasound energy through an organism, receiving said energy as reflected from anatomical structures of said organism, measuring parameters of said energy as reflected from said anatomical structures, and converting said parameters to image data, said image data comprising a range of shades of display color;

(b) image data storage means interfaced with said imaging means and storing said image data;

(c) computer means interfaced with said image data storage means for receiving said image data, assembling said image data in such a manner as to form a three dimensional model of said segment of said organism, generating independent right and left eye angularly displaced three dimensional stereoscopic image data representing respective right and left stereoscopic component images of said three dimensional model by rotating said three dimensional model to yield respective right and left eye perspective components from a selected perspective view of said three dimensional model; and

(d) stereoscopic display means interfaced with said computer means and including separate, independent right and left video displays, said display means receiving said right and left stereoscopic image data and transforming said into right and left video signals which are applied respectively to said right and left video displays to display said right and left stereoscopic component images respectively thereon.

15. An apparatus as set forth in claim 14 including:

(a) a viewing harness supporting said right and left video display devices on the head of a person viewing said images.

16. An apparatus as set forth in claim 14 wherein said computer means includes:

(a) right and left three dimensional display processors each receiving said three dimensional model image data and rotating said received image data in such a manner as to form a respective one of said right and left stereoscopic component images.

17. An apparatus as set forth in claim 16 wherein said computer means further includes:

(a) a system computer connected to said image data storage means and said right and left three dimensional display processors and providing said processors with said three dimensional model image data derived from said image data storage means, said system computer coordinating the operation of said right and left three dimensional display processors to display said right and left stereoscopic image components of said three dimensional model.

18. An apparatus as set forth in claim 14 wherein:

(a) said computer means is programmed to selectively cause said three dimensional model image data to rotate about an axis to allow stereoscopic viewing of said three dimensional image from a different perspective.

19. An apparatus as set forth in claim 14 wherein said computer means is programmed to:

(a) correlate said range of shades of display color to a range of variations in said parameters of said energy as a result of reflection from said anatomical structures;

(b) allow selection of an inhibition range of said shades of display color; and

(c) selectively cause the inhibition of the display of the inhibition range of said shades of display color to thereby enhance viewing of remaining portions of said image.

20. An apparatus as set forth in claim 14 wherein:

(a) said imaging means propagates said energy through said organism and receives said energy in such a manner as to obtain said image data as a data array of spatially related image data points having values related to variations in said parameters of said energy; and

(b) said computer means is programmed to;

(1) interpolate said spatially related image data points to provide average image data point values between adjacent image data points to derive averaged image points interspersed among said image data points to yield said three dimensional model image data.

21. An apparatus as set forth in claim 14 wherein:

(a) said imaging means propagates said energy through said organism and receives said energy in such a manner as to obtain said image data in a form of a plurality of closely spaced and sequential two dimensional cross sectional images of a segment said organism; and

(b) said computer means is programmed to;

(1) assemble said cross sectional images in such a manner as to form said three dimensional model image data of said segment of said organism.

22. An apparatus as set forth in claim 14 wherein said imaging means includes:

(a) a two dimensional element array of ultrasound transducers.

23. An apparatus as set forth in claim 14 wherein:

(a) said imaging means is operative to propagate and receive said energy in a scanned manner to thereby obtain said image data in a form of a plurality of closely spaced and sequential two dimensional data arrays of spatially related image data points having values related to said parameters of said energy, said data arrays forming cross sectional images of a segment of said organism.

24. An apparatus as set forth in claim 23 wherein:

(a) said computer means is programmed to assemble said two dimensional data arrays of spatially related image data points in such a manner as to form said three dimensional model image data of said segment of said organism.

25. An apparatus as set forth in claim 24 wherein said imaging means includes:

(a) a two dimensional element array of ultrasound transducers providing image data representing a selected plurality of cross sectional images of said organism;

(b) said element array and said organism being positioned for relative movement therebetween to provide image data representing a multiplicity of said plurality of cross sectional images of said organism; and

(c) array position sensing means coupled between said element array and said computer means, said array position sensing means sensing relative movement between said element array and said organism and providing a position signal to said computer means indicative of said relative movement whereby said computer means organizes said image data representing said cross sectional images of said organism for assembly into said three dimensional model of said segment of said organism.

26. An apparatus as set forth in claim 25 wherein said imaging means includes:

(a) array motor means operatively connected between said element array and said organism to cause selected relative movement therebetween.

27. An apparatus for stereoscopic ultrasound imaging of anatomical structures and comprising:

(a) ultrasound imaging means propagating ultrasound energy through an organism, receiving said energy as reflected from anatomical structures of said organism, measuring parameters of said energy as reflected from said anatomical structures, and converting said parameters to image data, said image data being in a form of a plurality of closely spaced and sequential two dimensional data arrays of spatially related image data points having values related to said energy, said data arrays forming cross sectional images of a segment of said organism;

(b) image data storage means interfaced with said imaging means and storing said image data;

(c) computer means interfaced with said image data storage means for receiving said image data and forming a three dimensional model of said image data, said computer means also generating independent right and left eye angularly displaced three dimensional stereoscopic image data representing respective right and left stereoscopic component images of said three dimensional model by rotating said three dimensional model to yield respective right and left eye perspective components from a selected perspective view of said three dimensional model;

(d) stereoscopic display means interfaced with said computer means and including separate, independent right and left video displays, said display means receiving said independent, angularly displaced right and left stereoscopic component images and transforming same into right and left video signals which represent said right and left stereoscopic component images, respectively;

(e) a right stereoscopic image component of a three dimensional image of said three dimensional model being displayed on said right video display; and

(f) an angularly displaced left stereoscopic image component of said three dimensional model being displayed on said left display.

28. An apparatus as set forth in claim 27 including:

(a) a viewing harness supporting said right and left video display devices on the head of a person viewing said images.

29. An apparatus as set forth in claim 27 wherein said computer means includes:

(a) right and left three dimensional display processors.

30. An apparatus as set forth in claim 27 wherein said imaging means includes:

(a) a two dimensional element array of ultrasound transducers providing image data representing a selected plurality of cross sectional images of said organism;

(b) said element array and said organism being positioned for relative movement therebetween to provide image data representing a multiplicity of said plurality of cross sectional images of said organism; and

(c) array position sensing means coupled between said element array and said computer means, said array position sensing means sensing relative movement between said element array and said organism and providing a position signal to said computer means indicative of said relative movement whereby said computer means organizes said image data representing said cross sectional images of said organism for assembly into said three dimensional model of said segment of said organism.

31. An apparatus as set forth in claim 30 wherein said imaging means includes:

(a) array motor means operatively connected between said element array and said organism to cause selected relative movement therebetween.