IMAGING APPARATUS, IMAGING SYSTEM, SURGICAL NAVIGATION SYSTEM, AND IMAGING METHOD

• US 20120016230A1
• Filed: 07/07/2011
• Published: 01/19/2012
• Est. Priority Date: 07/13/2010
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kishima, Koichiro, Yonemitsu, Tetsumasa, Fukushi, Gakuho
• Application Number:
  US13/178,155
• Publication Number:
  US 20120016230A1
• Time in Patent Office: Days
• US Class Current: 600/425
• CPC Class Codes: A61B 1/00186 with imaging filters
• CPC Class Codes: A61B 1/00188 with focusing or zooming features
• CPC Class Codes: A61B 1/002 having rod-lens arrangements A61B1/055 takes precedence
• CPC Class Codes: A61B 1/042 characterised by a proximal camera, e.g. a CCD camera
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/045 Control thereof
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/0646 with illumination filters
• CPC Class Codes: A61B 1/0655 Control therefor
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0086 using infrared radiation
• CPC Class Codes: A61B 5/415 the glands, e.g. tonsils, adenoids or thymus
• CPC Class Codes: A61B 5/418 lymph vessels, ducts or nodes

Abstract

An imaging apparatus includes: a first illumination unit to apply visible light to a subject having a fluorescent substance; a second illumination unit to apply excitation light to the subject so that fluorescence is generated from the fluorescent substance; an optical filter unit to cause the visible light and the fluorescence to pass therethrough, and shield the excitation light; an imaging unit including imaging elements to generate image signals, and an output unit to read the image signals from the imaging elements and output image information; an optical element to divide the visible light into component light beams, cause the divided light beams to be incident on the imaging elements, and cause the fluorescence to be incident on at least one imaging element; and a control means for alternately applying the visible light and the excitation light and alternately outputting image information of the visible light and the fluorescence.

Claims

1. An imaging apparatus, comprising:

a first illumination unit configured to apply visible light to a subject having a fluorescent substance;

a second illumination unit configured to apply excitation light to the subject so that fluorescence is generated from the fluorescent substance;

an optical filter unit configured to cause the visible light applied by the first illumination unit and the fluorescence generated from the fluorescent substance to pass therethrough, and shield the excitation light applied by the second illumination unit;

an imaging unit including;

a plurality of imaging elements capable of generating respective image signals based on incident light, and

an output unit to read the image signals from the plurality of imaging elements and output image information based on the read image signals;

an optical element configured to divide the visible light having passed through the optical filter unit into a plurality of component light beams, cause the divided component light beams to be incident on the respective imaging elements, and cause the fluorescence generated from the fluorescent substance to be incident on at least one of the plurality of imaging elements; and

a control means for alternately applying the visible light and the excitation light and alternately outputting image information of the visible light and image information of the fluorescence, the image information of the visible light being based on the image signals read from the plurality of imaging elements on which the respective component light beams are incident, the image information of the fluorescence being based on at least one of the image signals read from the at least one of the plurality of imaging elements on which the fluorescence is incident.

2. The imaging apparatus according to claim 1, wherein

the output unit is capable of reading the image signals from the respective imaging elements in an interlace system and outputting first field image information and second field image information that constitute frame image information based on the read image signals, and

the control means outputs the image information of the visible light as the first field image information and outputs the image information of the fluorescence as the second field image information.

3. The imaging apparatus according to claim 1, wherein

the plurality of imaging elements are complementary metal oxide semiconductor (CMOS) image sensors that generate the image signals in a rolling shutter system, and

the control means stops applying the visible light and the excitation light during a time in which the image signals are being read from the CMOS image sensors by the output unit.

4. The imaging apparatus according to claim 1, wherein

the subject has a first fluorescent substance to generate first fluorescence by first excitation light being applied, and a second fluorescent substance to generate second fluorescence by second excitation light being applied, the second excitation light being different from the first excitation light,

the second illumination unit includes a first excitation-light illumination unit to apply the first excitation light, and a second excitation-light illumination unit to apply the second excitation light,

the optical filter unit includes a first filter to cause the visible light and the first fluorescence to pass therethrough and shield the first excitation light, and a second filter to cause the visible light and the second fluorescence to pass therethrough and shield the second excitation light,

the optical element divides the visible light having passed through one of the first optical filter and the second optical filter into a plurality of component light beams, causes the divided component light beams to be incident on the respective imaging elements, and causes the first fluorescence and the second fluorescence to be incident on at least one of the plurality of imaging elements,

the control means switches between the visible light, the first excitation light, and the second excitation light to be applied, alternately switches, based on a timing of the switching, between the first optical filter and the second optical filter, and alternately outputs the image information of the visible light, image information of the first fluorescence, and image information of the second fluorescence, the image information of the first fluorescence being based on at least one of the image signals read from the at least one of the imaging elements on which the first fluorescence is incident, the image information of the second fluorescence being based on at least one of the image signals read from the at least one of the imaging elements on which the second fluorescence is incident.

5. An imaging system, comprising:

an illumination apparatus including

a first illumination unit configured to apply visible light to a subject having a fluorescent substance, and

a second illumination unit configured to apply excitation light to the subject so that fluorescence is generated from the fluorescent substance;

an imaging apparatus including;

an optical filter unit configured to cause the visible light applied by the first illumination unit and the fluorescence generated from the fluorescent substance to pass therethrough, and shield the excitation light applied by the second illumination unit,

an imaging unit including;

a plurality of imaging elements capable of generating respective image signals based on incident light, and

an output unit to read the image signals from the plurality of imaging elements and output image information based on the read image signals, and

an optical element configured to divide the visible light having passed through the optical filter unit into a plurality of component light beams, cause the divided component light beams to be incident on the respective imaging elements, and cause the fluorescence generated from the fluorescent substance to be incident on at least one of the plurality of imaging elements; and

a control means for alternately applying the visible light and the excitation light and alternately outputting image information of the visible light and image information of the fluorescence, the image information of the visible light being based on the image signals read from the plurality of imaging elements on which the respective component light beams are incident, the image information of the fluorescence being based on at least one of the image signals read from the at least one of the plurality of imaging elements on which the fluorescence is incident.

6. A surgical navigation system, comprising:

a display;

an illumination apparatus including;

a first illumination unit configured to apply visible light to an operated portion to which a fluorescent substance is given, and

a second illumination unit configured to apply excitation light to the operated portion so that fluorescence is generated from the fluorescent substance;

an imaging apparatus including;

an optical filter unit configured to cause the visible light applied by the first illumination unit and the fluorescence generated from the fluorescent substance to pass therethrough, and shield the excitation light applied by the second illumination unit,

an imaging unit including;

a plurality of imaging elements capable of generating respective image signals based on incident light, and

an output unit to read the image signals from the plurality of imaging elements and output image information based on the read image signals, and

an optical element configured to divide the visible light having passed through the optical filter unit into a plurality of component light beams, cause the divided component light beams to be incident on the respective imaging elements, and cause the fluorescence generated from the fluorescent substance to be incident on at least one of the plurality of imaging elements; and

a control means for alternately applying the visible light and the excitation light, alternately outputting image information of the visible light and image information of the fluorescence, the image information of the visible light being based on the image signals read from the plurality of imaging elements on which the respective component light beams are incident, the image information of the fluorescence being based on at least one of the image signals read from the at least one of the plurality of imaging elements on which the fluorescence is incident, and displaying a visible light image and a fluorescence image on the display based on the output image information of the visible light and the output image information of the fluorescence.

7. An imaging method, comprising:

alternately applying, to a subject having a fluorescent substance, visible light and excitation light for generating fluorescence from the fluorescent substance;

causing, an optical filter unit, the visible light applied to the subject and the fluorescence generated from the fluorescent substance to pass therethrough, and shielding the excitation light applied to the subject;

dividing the visible light having passed through the optical filter unit into a plurality of component light beams, causing the divided component light beams to be incident on a plurality of imaging elements capable of generating respective image signals based on incident light, and causing the fluorescence to be incident on at least one of the plurality of imaging elements, to thereby alternately output image information of the visible light and image information of the fluorescence, the image information of the visible light being based on the image signals read from the plurality of imaging elements on which the respective component light beams are incident, the image information of the fluorescence being based on at least one of the image signals read from the at least one of the plurality of imaging elements on which the fluorescence is incident.