Endoscopic viewing system for maintaining a surgeon's normal sense of kinesthesia during endoscopic surgery regardless of the orientation of the endoscope vis-a-vis the surgeon

• US 5,545,120 A
• Filed: 01/18/1995
• Issued: 08/13/1996
• Est. Priority Date: 01/18/1995
• Status: Expired due to Term

• Current Assignee: Ledyard National Bank (Ledyard Financial Group Incorporated)
• Original Assignee: Medical Media Systems
• Inventors: McKenna, Michael, Chen, David T., Pieper, Steven D.
• Primary Examiner(s): Cheng, Joe
• Assistant Examiner(s): Leubecker, John P.
• Application Number:
  US08/374,126
• Time in Patent Office: 573 Days
• Field of Search: 600/103, 600/117, 600/145, 600/921, 128/653.1, 128/903, 128/899, 606/130, 348/36, 348/39, 348/65, 348/61, 348/82, 348/116, 348/114, 348/142, 348/147, 348/169, 348/140, 348/583, 382/295, 382/296, 382/297, 382/293
• US Class Current: 600/117
• CPC Class Codes: A61B 17/00234 for minimally invasive surgery A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: Y10S 600/921 Manipulating image characteristics

Abstract

An endoscopic viewing system for maintaining a surgeon'"'"'s normal sense of kinesthesia during endoscopic surgery regardless of the orientation of the endoscope vis-a-vis the surgeon.

Claims

1. An endoscopic viewing system comprising:

an endoscope for capturing a first image of an object and for generating first video signals representative of said first image;

tracking means for determining the relative orientation between said endoscope and a surgeon and for generating tracking signals representative of the relative orientation between said endoscope and said surgeon;

signal processing means connected to said endoscope and said tracking means, said signal processing means being adapted to receive said first video signals from said endoscope and to modify the same as required based on said tracking signals received from said tracking means so as to provide second video signals representative of a second image of said object, wherein said second image of said object is arranged so as to maintain the surgeon'"'"'s normal sense of kinesthesia during endoscopic surgery regardless of the orientation of said endoscope vis-a-vis said surgeon; and

display means connected to said signal processing means for receiving said second video signals from said signal processing means and displaying said second image for viewing by said surgeon.

2. An endoscopic viewing system according to claim 1 wherein said signal processing means are arranged so that whenever said endoscope and said surgeon are oriented in substantially opposite directions, said signal processing means will flip said first image of said object about an axis when creating said second image of said object, whereby said second image of said object will be a mirror image of said first image of said object.

3. An endoscopic viewing system according to claim 1 wherein said signal processing means are arranged so that they will create said second image of said object by rotating said first image of said object about an axis, with the degree of rotation being determined by the relative orientation of said endoscope vis-a-vis said surgeon.

4. An endoscopic viewing system according to claim 3 wherein the axis of rotation is determined by the relative orientation of said endoscope vis-a-vis said surgeon.

5. An endoscopic viewing system comprising:

an endoscope for capturing a first image of an object and for generating first video signals representative of said first image;

endoscope tracking means for determining the orientation of said endoscope and for generating first tracking signals representative of the orientation of said endoscope;

surgeon tracking means for determining the orientation of a surgeon and for generating second tracking signals representative of the orientation of said surgeon;

signal processing means connected to said endoscope, said endoscope tracking means and said surgeon tracking means, said signal processing means being adapted to receive said first video signals from said endoscope and to modify the same as required based on said first tracking signals and said second tracking signals so as to provide second video signals representative of a second image of said object, wherein said second image of said object is arranged so as to maintain the surgeon'"'"'s normal sense of kinesthesia during endoscopic surgery regardless of the orientation of said endoscope vis-a-vis said surgeon; and

display means connected to said signal processing means for receiving said second video signals from said signal processing means and displaying said second image for viewing by said surgeon.

6. A method for maintaining a surgeon'"'"'s sense of kinesthesia during endoscopic surgery regardless of the orientation of the endoscope vis-a-vis the surgeon, said method comprising:

(1) providing an endoscopic viewing system comprising;

an endoscope for capturing a first image of an object and for generating first video signals representative of said first image;

tracking means for determining the relative orientation between said endoscope and a surgeon and for generating first tracking signals representative of the relative orientation between said endoscope and said surgeon;

signal processing means connected to said endoscope and said tracking means, said signal processing means being adapted to receive said first video signals from said endoscope and to modify the same as required based on said tracking signals received from said tracking means so as to provide second video signals representative of a second image of said object, wherein said second image of said object is arranged so as to maintain the surgeon'"'"'s normal sense of kinesthesia during endoscopic surgery regardless of the orientation of said endoscope vis-a-vis said surgeon; and

display means connected to said signal processing means for receiving said second video signals from said signal processing means and displaying said second image for viewing by said surgeon;

(2) generating said first video signals and said tracking signals and transmitting the same to said signal processing means;

(3) processing said first video signals so as to generate second video signals;

(4) transmitting said second video signals to said display means; and

(5) displaying said second image represented by said second video signals on said display means.

7. A method according to claim 6 wherein said signal processing means are arranged so that they will create said second image of said object by rotating said first image of said object about an axis, with the degree of rotation being determined by the relative orientation of said endoscope vis-a-vis said surgeon.

8. A method according to claim 7 wherein the axis of rotation is determined by the relative orientation of said endoscope vis-a-vis said surgeon.

9. A method according to claim 6 wherein said signal processing means are arranged so that whenever said endoscope and said surgeon are oriented in substantially opposite directions, said signal processing means will flip said first image of said object about an axis when creating said second image of said object, whereby said second image of said object will be a mirror image of said first image of said object.

10. A method for maintaining a surgeon'"'"'s sense of kinesthesia during endoscopic surgery regardless of the orientation of the endoscope vis-a-vis the surgeon, said method comprising:

(1) providing an endoscopic viewing system comprising;

an endoscope for capturing a first image of an object and for generating first video signals representative of said first image;

endoscope tracking means for determining the orientation of said endoscope and for generating first tracking signals representative of the orientation of said endoscope;

surgeon tracking means for determining the orientation of a surgeon and for generating second tracking signals representative of the orientation of said surgeon;

signal processing means connected to said endoscope, said endoscope tracking means and said surgeon tracking means, said signal processing means being adapted to receive said first video signals from said endoscope and to modify the same as required based on said first tracking signals and said second tracking signals so as to provide second video signals representative of a second image of said object, wherein said second image of said object is arranged so as to maintain the surgeon'"'"'s normal sense of kinesthesia during endoscopic surgery regardless of the orientation of said endoscope vis-a-vis said surgeon; and

display means connected to said signal processing means for receiving said second video signals from said signal processing means and displaying said second image for viewing by said surgeon;

(2) generating said first video signals, said first tracking signals and said second tracking signals and transmitting the same to said signal processing means;

(3) processing said first tracking signals and said second tracking signals so as to determine the orientation of said endoscope and the orientation of said surgeon, assigning the vector E to the orientation of said endoscope and the vector S to the orientation of said surgeon, and then calculating

space="preserve" listing-type="equation">A=arccos(S·

E)

and

space="preserve" listing-type="equation">B=(S×

E);

(4) processing said first video signals so as to generate second video signals corresponding to said first image rotated about vector B by the angle A;

(5) transmitting said second video signals to said display means; and

(6) displaying said second image represented by said second video signals on said display means.

11. A method according to claim 10 wherein vector S and vector E are projected into the X-Y plane and then normalized prior to calculating A and vector B.

12. A viewing system comprising:

a sensor for capturing a first image of an object and for generating first video signals representative of said first image;

tracking means for determining the relative orientation between said sensor and a viewer and for generating tracking signals representative of the relative orientation between said sensor and said viewer; and

signal processing means connected to said sensor and said tracking means, said signal processing means being adapted to receive said first video signals from said sensor and to modify the same as required based on said tracking signals received from said tracking means so as to provide second video signals representative of a second image of said object, wherein said second image of said object is arranged so as to maintain the viewer'"'"'s normal sense of kinesthesia during a procedure involving the object regardless of the orientation of said sensor vis-a-vis said viewer;

said signal processing means being adapted to be connected to display means whereby said second image of said object can be displayed to said viewer.