Synthesized stereoscopic imaging system and method

• US 5,510,832 A
• Filed: 12/01/1993
• Issued: 04/23/1996
• Est. Priority Date: 12/01/1993
• Status: Expired due to Fees

• Current Assignee: Denise Rich
• Original Assignee: Medi-Vision Technologies, Inc.
• Inventors: Garcia, Baxter J.
• Primary Examiner(s): Chin, Tommy P.
• Assistant Examiner(s): RAO, ANAND SHASHIKANT
• Application Number:
  US08/158,773
• Time in Patent Office: 874 Days
• Field of Search: 348/51, 348/52, 348/53, 348/54, 348/55, 348/56, 348/57, 348/58, 348/44, 348/45, 348/43, 348/42
• US Class Current: 348/56
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

An observer is presented, through a pair of viewing glasses, a field/frame multiplexed, synthesized three-dimensional or stereoscopic image on single monitor generated from a two-dimensional monocular video signal. The field/frame multiplexed, synthesized 3D image is generated in a converter. A controller controls the left and right eye vision of the glasses along an unobstructed path without need of any connecting wires. A wide range of input sources can provide the 2D input video signal for conversion. The resulting synthesized 3D image is especially suited for medical and other purposes which require realistic, accurate and visually comfortable 3D visualization of video images, as for example in minimally-invasive surgery to allow complex navigational and manipulational procedures carried out over a continuous period of many hours. The ability to transform a 2D image from a single source into an accurately portrayed synthesized 3D image displayed on a color monitor is also necessary in related biomedical fields including microscopy, medical telecommunications and medical education.

Claims

1. An imaging system for producing a synthesized stereoscopic image from a single two-dimensional monocular source video signal, which signal includes a sequence of video images, comprising:

a) means for receiving the single two-dimensional monocular source video signal;

b) means for i) digitally converting the single two-dimensional monocular source video signal to a three-dimensional video image signal by a first analog-to-digital step of acquiring a sequence of the video images from the two-dimensional monocular source video signal, storing these video images in a digital buffer memory, and therafter temporally displacing and horizontally offsetting the digital buffered video images, and for ii) then time-multiplexing the converted three-dimensional video images;

c) a single-screen video display receiving and displaying said time-multiplexed three-dimensional video image;

d) viewing glasses adapted for alternate left-eye, right-eye human viewing said video display by alternate shuttering; and

e) means for controlling said alternate left-eye, right-eye shuttering of said viewing glasses.

2. The system of claim 1, wherein the monocular source video signal is a field interlaced video signal and wherein said digital converting and time-multiplexing means is adapted for said field interlaced display signal.

3. The system of claim 1, wherein the monocular source video signal is a non-interlaced video signal and wherein said digital converting and time-multiplexing means is adapted for said non-interlaced display signal.

4. The system of claim 1, further comprising a computer having memory, storage, and video input/output capabilities associated therewith;

a program instruction set controlling two-dimensional--three-dimensional signal conversion in said computer.

5. The system of claim 1, wherein said viewing glasses are liquid crystal switching viewing glasses and said means for controlling is a switched infrared transmitter.

6. The system of claim 1, wherein the alternate left-eye, right-eye shuttering presents a sequence of left-eye and right-eye images, and wherein the left-eye and right-eye images are of substantially uniform brightness.

7. A method for synthesizing stereoscopic imaging of a single two-dimensional monocular source video signal, which signal includes a sequence of video images, comprising the steps of:

a) receiving the single two-dimensional monocular source video signal;

b) digitally converting the single two-dimensional monocular source video signal to a three-dimensional video image signal by acquiring a sequence of the video images from the two-dimensional monocular source video signal, analog-to-digital conversion of the video images and then storing these video images in a digital buffer memory, and thereafter temporally displacing and then horizontally offsetting the digital buffered video images and then time-multiplexing the converted three-dimensional video images;

c) displaying the time-multiplexed three-dimensional video images on a single-screen video display;

d) viewing said single-screen video display with viewing glasses adapted for alternate left-eye, right-eye human viewing; and

e) controlling alternate left-eye, right-eye shuttering of said viewing glasses in synchronism with display of the three-dimensional video image.

8. The method of claim 7, wherein steps b) and c) further include the additional sequential steps of:

acquiring first frame F1, storing first frame F1 in a storage buffer;

copying frame F1 to a copy buffer;

acquiring second frame F2, storing second frame F2 in the storage buffer;

copying frame F2 to the copy buffer;

acquiring third frame F3, storing third frame F1 in the storage bufer, applying left and right spatial offsets to frames F1, F2 for display;

copying frame F3 to the copy buffer;

acquiring fourth frame F4, storing frame F4 in the storage buffer, applying left and right spatial offsets to frames F2, F3 for display;

copying frame F4 to the copy buffer;

acquiring fifth frame F5, storing fifth frame F5 in the storage buffer, applying left and right spatial offsets to frames F3, F4 for display;

copying frame F5 to the copy buffer; and

acquiring fifth frame F5, storing fifth frame F5 in the storage buffer, applying left and right spatial offsets to frames F4, F5 for display.

9. The method of claim 7, wherein the steps of digitally converting and displaying are accomplished in substantially real-time.

10. The method of claim 7, wherein the two-dimensional monocular source video signal is a recorded signal, and the steps of digitally converting and displaying are accomplished from playing back the recorded two-dimensional monocular source video signal.

11. The method of claim 7, wherein the step of displaying is repeated on a plurality of additional single-screen video displays.

12. A mthod for synthesizing stereoscopic imaging of a single two-dimensional monocular source video signal, which signal includes a sequence of video images, comprising the steps of:

a) receiving the single two-dimensional monocular source video signal at a first location;

b) transmitting the single two-dimensional monocular source video signal to a second location remote from the first location;

c) receiving the transmitted single two-dimensional monocular source video signal at the second location;

d) digitally converting the received single monocular source video signal to a three-dimensional video image signal by acquiring a sequence of the video images from the two-dimensional monocular source video signal, analog-to-digital conversion of the video images and then storing these video images in a digital buffer memory, and therafter temporally displacing and horizontally offsetting the digital buffered video images and then time-multiplexing the converted three-dimensional video images;

e) displaying the time-multiplexed three-dimensional video images on at least one single-screen video display;

f) viewing said single-screen video display with viewing glasses adapted for alternate left-eye, right-eye human viewing; and

g) controlling alternate left-eye, right-eye shuttering of said viewing glasses in synchronism with display of the three-dimensional video images.

13. A medical imaging system for producing a synthesized stereoscopic image from a single two-dimensional monocular source video signal, which signal includes a sequence of video images, comprising:

a) means for receiving the single two-dimensional source video signal;

b) means for i) digitally converting the single two-dimensional monocular source video signal to a three-dimensional video image signal by a first analog-to-digital step of acquiring a sequence of the video images from the two-dimensional monocular source video signal, storing these video images in a digital buffer memory, and thereafter temporally displacing and horizontally offsetting the digital buffered video images, and for ii) then time-multiplexing the converted video images;

c) a single-screen video display receiving and displaying said time-multiplexed signals;

d) viewing glasses adapted for alternate left-eye, right-eye human viewing said video display by alternate shuttering; and

e) means for controlling alternate left-eye, right-eye shuttering of said viewing glasses.

14. The system of claim 13, wherein the monocular source video signal is a field interlaced video signal and wherein said digital converting and multiplexing means is adapted for said field interlaced display signal.

15. The system of claim 13, wherein the monocular source video signal is a non-interlaced video signal and wherein said digital converting and time-multiplexing means is adapted for said non-interlaced display signal.

16. The system of claim 13, wherein the digital converting means comprises a hybrid analog and digital two-dimensional--three-dimensional processor.

17. The system of claim 13, further comprising a computer having memory, storage, and video input/output capabilities associated therewith;

a program instruction set controlling two-dimensional--three-dimensional signal conversion in said computer.

18. The system of claim 13, wherein said viewing glasses are liquid crystal switching viewing glasses and said means for controlling is a switched infrared transmitter.

19. The method of claim 13, wherein the alternate left-eye, right-eye shuttering presents a sequence of left-eye and right-eye images, and wherein the left-eye and right-eye images are of substantially uniform brightness.

20. A method for synthesizing medical stereoscopic imaging of a single two-dimensional monocular source video signal, which signal includes a sequence of video images, comprising the steps of:

a) receiving the single two-dimensional monocular source video signal;

b) digitally converting the single two-dimensional monocular source video signal to a three-dimensional video image signal by acquiring a sequence of the video images from the two-dimensional monocular source video signal, analog-to-digital conversion of the video images and then storing these video images in a digital buffer memory, and thereafter temporally displacing and horizontally offsetting the digital buffered video images and then time-multiplexing the converted three-dimensional video images;

c) displaying the time-multiplexed three-dimensional video images on a single-screen video display;

d) viewing said single-screen video display with viewing glasses adapted for alternate left-eye, right-eye human viewing; and

e) controlling alternate left-eye, right-eye shuttering of said viewing glasses in synchronism with display of the three-dimensional video images.

21. The method of claim 20, wherein steps b) and c) further include the additional sequential steps of:

acquiring first frame F1, storing first frame F1 in a storage buffer;

copying frame F1 to a copy buffer;

acquiring second frame F2, storing second frame F2 in the storage buffer;

copying frame F2 to the copy buffer;

acquiring third frame F3, storing third frame F1 in the storage buffer, applying left and right spatial offsets to frames F1, F2 for display;

copying frame F3 to the copy buffer;

acquiring fourth frame F4, storing frame F4 in the storage buffer, applying left and right spatial offsets to frames F2, F3 for display;

copying frame F4 to the copy buffer;

acquiring fifth frame F5, storing fifth frame F5 in the storage buffer, applying left and right spatial offsets to frames F3, F4 for display;

copying frame F5 to the copy buffer; and

acquiring fifth frame F5, storing fifth frame F5 in the storage buffer, applying left and right spatial offsets to frames F4, F5 for display.

22. The method of claim 20, wherein the steps of digitally converting and displaying are accomplished in substantially real-time.

23. The method of claim 20, wherein display is of a medical procedure, wherein the display is accomplished substantially simultaneously as the medical procedure is conducted.

24. The method of claim 20, wherein the two-dimensional monocular source video signal is a recorded signal, and the steps of displaying and digitally converting are accomplished from playing back the recorded two-dimensional monocular source video signal.

25. The method of claim 20, wherein the step of displaying is repeated on a plurality of additional single-screen video displays.

26. The method of claim 20, wherein the monocular source video signal is an output from an endoscope.

27. The method of claim 20, wherein the monocular source video signal is an output from a laparoscope.

28. A method for synthesizing stereoscopic imaging of a single two-dimensional monocular source video signal of a medical procedure, which signal includes a sequence of video images, comprising the steps of:

a) receiving the single two-dimensional monocular source video signal of the medical procedure;

b) transmitting the single two-dimensional monocular source video signal to a second location remote from the first location;

c) receiving the transmitted single two-dimensional monocular source video signal at the second location;

d) digitally converting the received single two-dimensional monocular video signal to a three-dimensional video image signal by acquiring a sequence of the video images from the two-dimensional monocular source video signal, analog-to-digital conversion of the video images and then storing these video images in a digital buffer memory, and thereafter temporally displacing and then horizontally offsetting the digital buffered video images and then time-multiplexing the converted three-dimensional video images;

e) displaying the time-multiplexed three-dimensional video images on at least one single-screen video display;

f) viewing said single-screen video display with viewing glasses adapted for alternate left-eye, right-eye human viewing; and

g) controlling alternate left-eye, right-eye shuttering of said viewing glasses in synchronism with display of the three-dimensional video images.