Endoscope device and navigation method for endoscope device

• US 7,641,609 B2
• Filed: 07/31/2003
• Issued: 01/05/2010
• Est. Priority Date: 07/31/2002
• Status: Active Grant

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: Moriya, Hiroshi, Akimoto, Shunya, Ohnishi, Junichi, Kobayashi, Eiichi, Asano, Fumihiro
• Primary Examiner(s): Leubecker; John P
• Assistant Examiner(s): SMITH, PHILIP ROBERT
• Application Number:
  US10/498,155
• Publication Number:
  US 20050020878A1
• Time in Patent Office: 2,350 Days
• Field of Search: 600/103, 600/114, 600/117, 600/118, 600/407
• US Class Current: 600/117
• CPC Class Codes: A61B 1/00009 of image signals during a use of endoscope
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/00147 Holding or positioning arrangements
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: A61B 1/2676 Bronchoscopes

Abstract

In an endoscope device 1 in accordance with the present invention, a navigation screen 51 is displayed. The navigation screen 51 includes: an endoscopic live image display area 52 in which a live image produced by a bronchoscope 2 is displayed; a VBS image display area 53 in which a VBS image is displayed; and a thumbnail VBS image area 54 in which images constructed by reducing VBS images that represent all branch points on a route are displayed as thumbnail VBS images representing branch points. Consequently, an endoscope can be reliably navigated to reach a target region using guide images that represent actual branch positions.

Claims

1. An endoscope device comprising:

three-dimensional image constructing means for constructing a three-dimensional image of an intracorporeal lumen of a subject on the basis of image data acquired from a three-dimensional field of the subject;

an endoscope for imaging the intracorporeal lumen of the subject;

a degree-of-insertion calculating means for calculating a degree-of-insertion to which the endoscope is inserted;

a route determination means that determines a route, which starts with a point at which the endoscope is inserted and ends with a point at which the endoscope reaches a target region of the subject based upon physical structure depicted in the three-dimensional image and that links the start and end points, so that the course of the endoscope to be steered in order to insert the endoscope can be presented;

and

navigation image constructing means for constructing a navigation image, which includes an endoscopic image that is produced by the endoscope and that represents the intracorporeal lumen of the subject, a plurality of reduced thumbnail images, each of the plurality of reduced thumbnail images is of the three-dimensional image constructed by the three-dimensional image constructing means and representing a branch point at which the intracorporeal lumen of the subject branches out, the plurality of reduced thumbnail images are displayed in series in an order from a point at which the endoscope is inserted to a point at which the endoscope reach a target region of the subject and the three-dimensional image, said three-dimensional image is adapted for being rotatably displayed, so that while presenting the course of the endoscope to be steered in order to insert the endoscope into the intracorporeal lumen of the subject, the endoscope device can help observe or treat the interior of the subject, wherein;

the navigation image constructing means displays the plurality of reduced thumbnail images in a manner that allows identification of which of the plurality of reduced thumbnail images corresponds to a branch point near a distal section of the endoscope based on the degree-of-insertion calculated by the degree-of-insertion calculating means, and which rotates and displays the three-dimensional image so that the endoscopic image and the three-dimensional image are matched with each other if a degree of similarity in images between a still image of the endoscopic image and the three-dimensional image corresponding to the identifiably displayed reduced thumbnail image is equal to or larger than a predetermined threshold value.

2. The endoscope device according to claim 1, wherein the navigation image constructing means comprises:

an image processing unit that constructs the plurality of reduced thumbnail images, each of said plurality of reduced thumbnail images is a three-dimensional image representing a branch point on the determined route, according to the result of determination performed by the route determination means, wherein the image processing units added the constructed plurality of reduced thumbnail images to the navigation image.

3. The endoscopic imaging system according to claim 2, further comprising image display control means that displays the navigation image, which is constructed by the image processing unit included in the navigation image constructing means, on a monitor.

4. The endoscope device according to claim 3, further comprising operational input means for use in giving an operational directive to the route determination means and image display control means.

5. The endoscope device according to claim 3, wherein the image display control means rotates the three-dimensional image contained in the navigation image displayed on a monitor, and displays it.

6. The endoscope device according to claim 2, wherein the route determination means determines a plurality of routes that starts with the point at which the endoscope is inserted and ends with the point at which the endoscope reaches the target region.

7. The endoscope device according to claim 2, wherein the route determination means displays a determined route by superimposing the determined route through a display screen image of the three-dimensional image that represents the intracorporeal lumen of the subject and that is constructed by the three-dimensional image constructing means.

8. The endoscope device according to claim 2, wherein:

the navigation image constructing means includes multi-screen reconstructed image constructing means that constructs a multi-screen reconstructed image, which represents the intracorporeal lumen of the subject, on the basis of the image data acquired from the three-dimensional field of the subject; and

the route determination means determines the route through a display screen image of the multi-screen reconstructed image constructed by the multi-screen reconstructed image constructing means.

9. The endoscope device according to claim 8, wherein:

the three-dimensional image is a virtual endoscopic image that represents the intracorporeal lumen of the subject and that is constructed based on CT image data which is the image data acquired from the three-dimensional field of the subject; and

the multi-screen reconstructed image represents the intracorporeal lumen of the subject and that is constructed based on the CT image data.

10. The endoscope device according to claim 9, wherein the image processing unit constructs plurality of reduced thumbnail images using the multi-screen reconstructed image, which is constructed by the multi-screen reconstructed image constructing means, according to the result of calculation performed by the route determination means.

11. The endoscope device according to claim 9, wherein the three-dimensional image constructing means constructs a succession of the virtual endoscopic images, which represent regions along the route determined by the route determination means, in units of a frame in synchronization with the endoscopic image.

12. The endoscope device according to claim 9, further comprising:

a fetching unit that fetches the CT image data;

a first storage unit in which the CT image data fetched by the fetching unit is stored; and

a second storage unit in which image data representing the virtual endoscopic images is stored.

13. An endoscope device, comprising:

three-dimensional image constructing means for constructing a three-dimensional image of an intracorporeal lumen of a subject on the basis of image data acquired from a three-dimensional field of the subject;

an endoscope that images the intracorporeal lumen of the subject;

a degree-of-insertion calculating means for calculating a degree-of-insertion to which the endoscope is inserted;

first navigation image constructing means for constructing a navigation image that includes an endoscopic image, which is produced by the endoscope and represents the intracorporeal lumen of the subject, and the three-dimensional image, which is rotated and displayed so that the endoscopic image and the three-dimensional image are matched with each other based if a degree of similarity in images between a still image of the endoscopic image and the three-dimensional image is equal to or larger than a predetermined threshold value;

route determining means for determining a route that starts with a point at which the endoscope is inserted and ends with a point at which the endoscope reaches a target region of the subject based upon physical structure depicted in the three-dimensional image and that links the start and end points, and that is used to present the course of the endoscope to be steered in order to insert the endoscope;

second navigation image constructing means for constructing a plurality of reduced thumbnail images, each of said plurality of reduced thumbnail images is of the three-dimensional image constructed by the three-dimensional image constructing means and representing a branch point on the determined route at which the lumen branches out, according to the result of calculation performed by the route determining means, and displaying the plurality of reduced thumbnail images on the navigation image in series in an order of the determined route from the start point to the end point in a manner allowing the identification of which one of said plurality of reduced thumbnail images corresponds to the displayed three-dimensional image where said three-dimensional image is an image of a branch point near a distal section of the endoscope, based upon the degree-to-insertion calculated by the degree-of-insertion calculating means; and

image display control means for displaying the navigation image, which is constructed by the second navigation image constructing means, on a monitor.

14. A navigation method implemented in an endoscope device, comprising:

a three-dimensional image constructing procedure for constructing a three-dimensional image of an intracorporeal lumen of a subject on the basis of image data acquired from a three-dimensional field of the subject;

a degree-of-insertion calculating procedure for calculating a degree-of insertion to which the endoscope device is inserted;

a first navigation image constructing procedure for constructing a navigation image that includes an endoscopic image, which represents the intracorporeal lumen of the subject and is produced by an endoscope that picks up images of an intracorporeal lumen of a subject, and the three-dimensional image, which is rotated and displayed so that the endoscopic image and the three-dimensional image are matched with each other based if a degree of similarity in images between a still image of the endoscopic image and the three-dimensional image is equal to or larger than a predetermined threshold value;

a route determining procedure for determining a route that starts with a point at which the endoscope is inserted and ends with a point at which the endoscope reaches a target region of the subject based upon physical structure depicted in the three-dimensional image and that links the start and end points, and that is used to present the course of the endoscope to be steered in order to insert the endoscope;

a second navigation image constructing procedure for constructing a plurality of reduced thumbnail images, each of said plurality of reduced thumbnail images is of the three-dimensional image constructed by the three-dimensional image constructing means and representing a branch point on the determined route at which the lumen branches out, according to the result of calculation performed according to the route determining procedure, and displaying the plurality of reduced thumbnail images on the navigation image in series in an order of the determined route from the start point to the end point in a manner allowing the identification of which one of said plurality of reduced thumbnail images corresponds to the displayed three-dimensional image, where said three-dimensional image is an image of a branch point near a distal section of the endoscope, based upon the degree-to-insertion;

an image display control procedure for displaying the navigation image, which is constructed according to the second navigation image constructing procedure, on a monitor.

15. The navigation method implemented in an endoscope device according to claim 14, wherein the rotation comprising:

generating a still image from the endoscopic image;

determining a degree of similarity of the still image of the endoscopic image and the three-dimensional image; and

rotating the three-dimensional image based upon the determining.

16. The navigation method implemented in an endo scope device according to claim 15, wherein the rotating of the three-dimensional image is automatically performed.