Endoscope image processing apparatus

• US 5,956,416 A
• Filed: 09/08/1995
• Issued: 09/21/1999
• Est. Priority Date: 03/23/1989
• Status: Expired due to Fees

• Current Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Original Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Inventors: Nakamura, Kazunari, Tsuruoka, Takao
• Primary Examiner(s): COUSO, YON JUNG
• Application Number:
  US08/525,098
• Time in Patent Office: 1,474 Days
• Field of Search: 382/128, 382/130, 382/133, 382/134, 382/282, 382/173, 348/65, 348/68, 348/71
• US Class Current: 382/128
• CPC Class Codes: A61B 1/000094 extracting biological structures
• CPC Class Codes: A61B 1/043 for fluorescence imaging
• CPC Class Codes: A61B 1/0638 providing two or more wavelengths
• CPC Class Codes: A61B 1/0646 with illumination filters
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10068 Endoscopic image
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/136 involving thresholding
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The endoscope image processing apparatus comprises a processing apparatus for image-processing as predetermined at least one image signal and a discriminating apparatus for discriminating regions ineffective to image-processing by the processing apparatus or to the result of the image-processing from other effective regions. The image processing apparatus further comprises an outputting apparatus for outputting the results of processing images by the processing apparatus only on the effective regions discriminated by the discriminating apparatus and an image forming apparatus forming images based on the results of processing images by the processing apparatus only on the effective regions.

Claims

1. An endoscope image processing apparatus, comprising:

a processing means for inputting at least picture image signals of a picture plane from an endoscope unit to perform predetermined picture image processing for the input picture image signals and accordingly obtaining output picture image signals;

a discriminating means, operably coupled to said processing means, for discriminating regions having ineffective input picture image signals unsuitable for being processed by said processing means from effective functional information input picture image signals suitable for being processed by said processing means within a whole picture plane of said input picture image signals, wherein said ineffective input picture image signals represent images having overexposure levels which exceed an allowable maximum exposure level; and

a displaying means, operably coupled to said processing means, for displaying a picture image processed by said processing means, and operably coupled to said discriminating means, for displaying said discriminated regions as ineffective regions based on a signal specified for displaying said regions having ineffective input picture image signals, said picture image processed by said processing means and said discriminated regions being simultaneously displayed to thereby distinguish said discriminated regions as ineffective regions from said picture image processed by said processing means.

2. An endoscope image processing apparatus according to claim 1, wherein said discriminating means discriminates regions exceeding at least a predetermined maximum level of a luminance level of said input picture image signals.

3. An endoscope image processing apparatus according to claim 1, wherein said discriminating means discriminates a region less than at least a predetermined minimum level of a luminance level of said input picture image signals.

4. An endoscope image processing apparatus according to claim 1, wherein said processing means performs process of only effective regions other than regions discriminated by said discriminating means.

5. An endoscope image processing apparatus according to claim 1, wherein said processing means performs whole predetermined picture image process on input picture image signals of a picture plane being inputted and outputs output picture image signals of a picture plane corresponding to the input picture image signals.

6. An endoscope image processing apparatus according to claim 1, further comprising an output means for outputting a result of picture image process by said processing means only for effective regions discriminated from regions determined to be said unsuitable regions by said discriminating means.

7. An endoscope image processing apparatus according to claim 1, further comprising a picture image forming means for forming a picture image based on a result of the picture image process by said image processing means only for effective regions discriminated from said unsuitable regions by said discriminating means.

8. An endoscope image processing apparatus according to claim 7, wherein said discriminating means discriminates between ineffective regions and said effective regions before processing picture images by said processing means.

9. An endoscope image processing apparatus according to claim 7, wherein said picture image forming means includes ineffective regions picture image forming means for forming a predetermined picture image showing ineffective regions determined to be said unsuitable regions by said discriminating means.

10. An endoscope image processing apparatus according to claim 9, wherein said ineffective regions picture image forming means forms said predetermined picture image by replacing the result of the picture image process by said processing means with a predetermined picture image data on the ineffective regions determined to be said unsuitable regions by said discriminating means.

11. An endoscope image processing apparatus according to claim 9, wherein said ineffective regions picture image forming means forms said predetermined picture image by replacing the result of picture image process by said processing means with a picture image data of a result performing different process from the process of said processing means for original input picture image signals on the ineffective regions determined to be said unsuitable regions by said discriminating means.

12. An endoscope image processing apparatus according to claim 9, wherein said ineffective regions picture image forming means forms said predetermined picture image by replacing the result of picture image process by said processing means with original input picture image signals on the ineffective regions determined to be said unsuitable regions by said discriminating means.

13. An endoscope image processing apparatus according to claim 9, wherein said ineffective regions picture image forming means differently forms said predetermined picture images depending on a cause of the ineffective regions determined to be said unsuitable regions by said discriminating means.

14. An endoscope image processing apparatus according to claim 1, wherein said discriminating means makes said discriminating for input picture images before processing picture images by said processing means.

15. An endoscope image processing apparatus according to claim 1, wherein said discriminating means includes an operating means for executing an operation using a plurality of picture image signals corresponding to a same subject.

16. An endoscope image processing apparatus according to claim 15, wherein two picture image signals among said plurality of picture image signals correspond to images of two wavelength ranges where a difference of absorbance in two wavelength ranges varies by variation of a degree of saturation with oxygen of hemoglobin.

17. An endoscope image processing apparatus according to claim 15, wherein two picture image signals among said plurality of picture image signals correspond to images of two wavelength ranges where a difference of absorbance in two wavelength ranges varies by variation in quantity of hemoglobin.

18. An endoscope image processing apparatus according to claim 1, wherein said processing means includes means for executing a plurality of operations.

19. An endoscope image processing apparatus according to claim 18, wherein said discriminating means makes said discriminating based on at least one of output signals of said means for executing said plurality of operations.

20. An endoscope image processing apparatus according to claim 18, wherein said processing means includes a logarithmic-pressing means for logarithmic-pressing at least two of said input picture image signals.

21. An endoscope image processing apparatus according to claim 20, wherein said processing means includes a difference operation means for calculating a difference between signals pressed by said logarithmic-pressing means.

22. An endoscope image processing apparatus according to claim 21, wherein said discriminating means makes said discriminating based on one of output values of said logarithmic-pressing means and said operation means.

23. An endoscope image processing apparatus according to claim 18, wherein said displaying means displays a picture image in color processed by said processing means and said discriminated regions in achromatic color.

24. An endoscope image processing apparatus according to claim 1, wherein said displaying means displays said discriminated regions in a net pattern.

25. An endoscope image processing apparatus according to claim 1, wherein said processing means inputs R, G and B picture image signals as input picture image signals and includes a calculating means for calculating L* a* b* in L* a* b* coordinate systems from the input signals.

26. An endoscope image processing apparatus according to claim 25, wherein said processing means includes a means for executing color enhancement process based on said calculated L* a* b*.

27. An endoscope image processing apparatus according to claim 26, wherein said discriminating means performs discriminating process based on the L* calculated by said processing means.

28. An endoscope image processing apparatus according to claim 27, wherein said processing means performs said process only for regions except ineffective regions discriminated by said discriminating means.

29. An endoscope image processing apparatus according to claim 1, wherein said processing means performs differential process for the input picture image signals and includes a means for extracting an edge.

30. An endoscope image processing apparatus according to claim 1, wherein said discriminating means judges regions having inferior illumination to be said unsuitable regions.

31. An endoscope image processing apparatus according to claim 1, wherein said processing means includes a means for executing an operation using a plurality of picture image signals corresponding to different time of a same subject.

32. An endoscope image processing apparatus according to claim 31, wherein said discriminating means judges unreliable-accuracy regions caused by deviation of a location of said same subject between said plurality of picture image signals to be unsuitable regions.

33. An endoscope apparatus, comprising:

a light illuminating means for supplying light of different wavelength ranges to a body cavity sequentially;

an endoscope unit outputting endoscope picture images of respective wavelength ranges illuminated by said light illuminating means;

a processing means for inputting endoscope picture image signals from said endoscope unit to perform predetermined picture image processing for the input picture image signals and accordingly obtaining output picture image signals;

a discriminating means, operably coupled to said processing means, for discriminating regions having ineffective input picture image signals unsuitable for being processed by said processing means from effective functional information input picture image signals suitable for being processed by said processing means within a whole picture plane of said input picture image signal, wherein said ineffective input picture image signals represent images having over-exposure levels which exceed an allowable maximum exposure level; and

a displaying means, operably coupled to said processing means, for displaying a picture image processed by said processing means, and operably coupled to said discriminating means, for displaying said discriminated regions as ineffective regions based on a signal specified for displaying said regions having ineffective input picture image signals, said picture image processed by said processing means and said discriminated regions being simultaneously displayed to thereby distinguish said discriminated regions as ineffective regions from said picture image processed by said processing means.

34. An endoscope apparatus according to claim 33, wherein said light illuminating means includes a light source and a rotary filter having a plurality of filters letting light of different wavelength ranges pass and disposing the filters in front of said light source sequentially.

35. An endoscope apparatus according to claim 34, wherein said rotary filter includes filters letting light at least in a vicinity of 580 nm wavelength range and in a vicinity of 800 nm wavelength range pass.

36. An endoscope apparatus according to claim 35, wherein said processing means outputs output picture images showing a degree of saturation with oxygen of hemoglobin based on input picture images for at least said two wavelength ranges.

37. An endoscope apparatus according to claim 34, wherein said rotary filter includes three filters letting at least red, green and blue light pass, respectively.

38. An endoscope apparatus according to claim 37, wherein said processing means includes a calculating means for calculating L* a* b* of R, G and B signals for said red, green and blue illuminating light in L* a* b* coordinate systems.

39. An endoscope apparatus according to claim 38, wherein said processing means includes a means for performing color enhancement process based on said calculated L* a* b*.

40. An endoscope apparatus according to claim 38, wherein said discriminating means performs discriminating process based on the L* calculated by said processing means.

41. An endoscope apparatus according to claim 33, wherein said endoscope unit contains a CCD transforming a subject image into electric signals, and said endoscope apparatus stores endoscope picture images in respective wavelength ranges from said CCD between said endoscope unit and processing means and has a plurality of memory means for outputting endoscope picture images in the respective wavelength ranges to said processing means.

42. An endoscope picture image processing apparatus, comprising:

a processing means for performing predetermined picture image processing for at least one original endoscope picture image;

a judging means for judging ineffective regions from effective functional information image regions suitable for being processed by said processing means on results of performing a process for said original endoscope picture image and picture image process to be attributes; and

a displaying means, operably coupled to said processing means and said judging means, for displaying a result processed by said processing means with image regions determined ineffective by said judging means as ineffective regions, based on a signal specified for displaying said ineffective regions to thereby distinguish said ineffective regions determined ineffective from said result processed by said processing means,

wherein said image regions determined ineffective have over-exposure levels which exceed an allowable maximum exposure level.

43. An endoscope picture image processing apparatus according to claim 42, further comprising a mask signal generating circuit, the mask signal generating circuit generating mask signals in regions determined ineffective by said judging means and performing masking in said regions displayed by said displaying means.

44. An endoscope picture image processing apparatus according to claim 43, wherein said processing means inputs a plurality of picture images taken in by different timing for a same subject to process the images and said judging means judges regions having deviation between said plurality of picture images.

45. A living body function picture image displaying apparatus, comprising:

an illuminating means for supplying light of at least two wavelength ranges to a living body;

an image forming means for transforming a subject image illuminated by the illuminating means into at least a first and second electric image signals in said wavelength ranges, respectively;

an operating means for executing operation based on said first and second electric image signals and obtaining functional information picture images showing living body function information on said living body;

a picking up means, operably coupled to said operating means, for picking up regions of ineffective results unsuitable for being processed by said operating means, wherein said ineffective results are images having over-exposure levels which exceed an allowable maximum exposure level; and

a displaying means, operably coupled to said operating means, for displaying the image obtained by said operating means, and operably coupled to said picking up means, for displaying the image obtained by said picking up means as an ineffective picture image based on a signal specified for displaying said regions of ineffective results to thereby distinguish the ineffective picture image obtained by the picking up means from the functional information images obtained by said operating means.

46. A living body function picture image displaying apparatus according to claim 45, wherein said living body function information is blood information within a living body and said operating means includes a calculating means for calculating a difference between said first and second electric image signals.

47. A living body function picture image displaying apparatus according to claim 46, wherein said operating means executes said difference calculation after applying logarithms to said first and second electric image signals.

48. A living body function picture image displaying apparatus according to claim 46, wherein said picking up means includes a means for finding luminance of said subject and picks up one of regions where the luminance is too high and too low.

49. An endoscope picture image displaying apparatus, comprising:

an endoscope unit generating electric signals denoting a subject picture image;

a processing means for performing specific functional information picture image process based on said electric signals;

a detecting means for detecting at least high luminance regions having halation within said subject picture image unsuitable for being processed by said processing means; and

a displaying means, operably coupled to said processing means and said detecting means, for displaying an output picture image processed by said processing means with said high luminance regions as ineffective picture images, based on a signal specified for displaying said high luminance regions to thereby distinguish said high luminance regions as the ineffective picture images from said output functional information picture image processed by said processing means.

50. An endoscope picture image displaying apparatus according to claim 49, wherein said processing means processes to find a degree of saturation with oxygen of hemoglobin.

51. An endoscope picture image displaying apparatus according to claim 50, wherein said endoscope unit generates two electric signals denoting two subject images on at least two wavelength ranges and said processing means includes a means for acquiring at least a difference between said two electric signals.