Device for detecting and illuminating the vasculature using an FPGA

• US 10,568,518 B2
• Filed: 08/17/2017
• Issued: 02/25/2020
• Est. Priority Date: 08/02/2012
• Status: Active Grant

• Current Assignee: AccuVein LLC
• Original Assignee: AccuVein LLC
• Inventors: Zott, Joseph, Wood, Fred, Yavid, Dimitry, Kim, Seung P., Zietlow, Klaus
• Primary Examiner(s): Kish, James M
• Application Number:
  US15/679,277
• Publication Number:
  US 20180070832A1
• Time in Patent Office: 922 Days
• Field of Search: None
• CPC Class Codes: A61B 2090/366 using projection of images directly onto the body
• CPC Class Codes: A61B 5/0033 Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room image data processing or generation G06T
• CPC Class Codes: A61B 5/004 adapted for image acquisition of a particular organ or body part A61B5/0082 takes precedence; arrangements for optical scanning A61B5/0062
• CPC Class Codes: A61B 5/0062 Arrangements for scanning
• CPC Class Codes: A61B 5/0082 adapted for particular medical purposes
• CPC Class Codes: A61B 5/02007 Evaluating blood vessel condition, e.g. elasticity, compliance
• CPC Class Codes: A61B 5/1075 for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer A61B8/0858 takes precedence
• CPC Class Codes: A61B 5/1077 Measuring of profiles
• CPC Class Codes: A61B 5/1079 using optical or photographic means
• CPC Class Codes: A61B 5/489 Blood vessels
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/745 using a holographic display
• CPC Class Codes: A61M 5/427 Locating point where body is to be pierced, e.g. vein location means using ultrasonic waves, injection site templates
• CPC Class Codes: G02B 26/101 with both horizontal and vertical deflecting means, e.g. raster or XY scanners colour television using laser beams scanning a display screen H04N9/3129

Abstract

A laser based vascular illumination system utilizing a FPGA for detecting vascular positions, processing an image of such vasculature positions, and projecting the image thereof onto the body of a patient.

Claims

1. An image capture device configured to detect, process, and project an image using a field programmable gate array (FPGA), said image capture device comprising:

a first laser configured to output a beam of light at an infrared wavelength;

a second laser configured to output a beam of light at a visible red wavelength;

a combiner configured to combine said beams of light from said first and second lasers into a co-axial beam of light;

an x-direction mirror configured to reflect said coaxial beam of light, and to be pivotable about a first axis, in a first direction and in a second direction;

an x-direction mirror driver configured to drive said x-direction mirror to oscillate about said first axis, to cyclically reflect said coaxial beam of light in a line, in both said first and second directions;

a y-direction mirror configured to reflect said line of light received from said x-direction mirror, and to be pivotable about a second axis, in a third direction and a fourth direction;

a y-direction mirror driver configured to drive said y-direction mirror to oscillate about said second axis;

a FPGA configured to control said x-direction mirror driver and said y-direction mirror driver to control said oscillations about said first and second axes to form a pattern of said red and infrared wavelengths of light;

a feedback means configured for detecting a position of said x-direction mirror and said y-direction mirror, and for signaling said positions to said FPGA;

a photodiode configured to receive the image formed from said infrared light, said photodiode further configured to convert the received image into an analog signal;

wherein said second laser driver is further configured to receive said analog signal, and to drive said red laser to project the image using said analog signal;

a line correlator configured to measure a shift in convergence between said line of light in said first direction and said second direction, for each said oscillation of said X-direction mirror;

a mirror convergence control configured to receive said measured shift in convergence from said line correlator, and to adjust said control of said first mirror driver by said FPGA, for said line in said first direction to converge with said line in said second direction.

2. The image capture device according to claim 1, further comprising:

a second feedback means configured for detecting said output of said first and second lasers, and for signaling said detected output to said FPGA, for said FPGA to control said output of said first and second lasers.

3. The image capture device according to claim 2, further comprising:

an analog-to-digital converter configured to receive said analog signal from said photodiode, and to convert said analog signal into a digital image signal, and to communicate said digital image signal to said FPGA;

wherein said FPGA is configured to receive and process said digital image signal and to output a processed image signal; and

wherein said second laser driver is further configured to receive said processed image signal from said FPGA, and to drive said red laser to project said processed image using said x-direction mirror and said y-direction mirror.

4. The image capture device according to claim 3, wherein said photodiode comprises a top photodiode and a bottom photodiode each configured to receive a full frame of the image and to output a respective said analog signal.

5. The image capture device according to claim 4, further comprising:

a top front end circuit and a bottom front end circuit, each configured to respectively receive said analog signals of said top and bottom photodiodes;

said top and bottom front end circuits configured to control analog filtering, gain, and threshold of said respective analog signals;

wherein said analog-to-digital converter comprises a top analog-to-digital converter (ADC) and a bottom ADC configured to respectively receive said analog signals from said top and bottom front end circuits, and to convert said analog signals into respective digital image signals, and to communicate said respective digital image signals to said FPGA;

said FPGA further configured to receive each of said respective digital image signals from said top and bottom ADC, and to perform imaging processing within each of said respective images, to form respective enhanced images;

wherein said FPGA is further configured to form a single enhanced image signal from said respective enhanced images; and

wherein said second laser driver is further configured to receive said single enhanced image from said FPGA, and to drive said red laser to project said enhanced single image using said x-direction mirror and said y-direction mirror.

6. The image capture device according to claim 5, wherein said single enhanced image is formed from:

a merged signal formed by merging said respective digital image signals;

or

a selected best image signal selected from either of said respective digital image signals.

7. The image capture device according to claim 5, further comprising:

a top histogram generator and a bottom histogram generator, each of said top and bottom histogram generators configured to generate a respective histogram of characteristics of said analog signals from said top and bottom photodiodes; and

wherein said FPGA is further configured to receive and use said respective histograms to signal said infrared laser driver to adjust power to said infrared laser on a frame by frame basis until said histograms indicate a proper image.

8. The image capture device according to claim 7, wherein said histogram characteristics comprise contrast and intensity levels.

9. The image capture device according to claim 7, further comprising a CPLD configured to control an LCD to display an operating status of said system thereon.

10. The image capture device according to claim 9, wherein said CPLD is further configured to control an audio output to provide audible tones to a user.

11. The image capture device according to claim 10, wherein said CPLD is further configured to control one or more switches on said system for turning on and off said system, for selecting one or more user modes, and for entering data therein.

12. The image capture device according to claim 2, further comprising a microprocessor configured to redundantly receive and monitor said feedback signal for said first and second lasers, and said feedback signal for said X-direction mirror and Y-direction mirror, in conjunction with said FPGA.

13. An image capture device comprising:

means for outputting and scanning a beam of light comprising an infrared wavelength and a visible red wavelength in a first and a second direction, for forming respective lines in said first and second directions, and for scanning said lines in a third direction and a fourth direction;

a field programmable gate array (FPGA) configured to control said means for outputting and scanning to control said scanning in said first and second directions, and to control said scanning in said third and fourth directions, to form a pattern;

a photodiode configured to receive an image formed from said scanned pattern of said infrared wavelength of light, said photodiode further configured to convert the image into an analog signal;

wherein said means for outputting and scanning is further configured to receive said analog signal, and to scan said image using said visible red wavelength;

a line correlator configured to measure a shift in convergence between said respective lines in said first and second directions;

a mirror convergence control configured to receive said measured shift in convergence from said line correlator, and to adjust said control of said means for outputting and scanning by said FPGA, for said line in said first direction to converge with said line in said second direction.

14. The image capture device according to claim 13, further comprising:

a first feedback means configured for detecting a position of said x-direction mirror and said y-direction mirror, and for signaling said positions to said FPGA;

a second feedback means configured for detecting said output of said means for outputting and scanning, and for signaling said detected output to said FPGA, for said FPGA to control said output of said means for outputting and scanning;

an analog-to-digital converter configured to receive said analog signal from said photodiode, and to convert said analog signal into a digital image signal, and to communicate said digital image signal to said FPGA;

wherein said FPGA is configured to receive and process said digital image signal and to output a processed image signal; and

wherein said means for outputting and scanning is further configured to receive said processed image from said FPGA, and to scan said processed image using said red wavelength.

15. The image capture device according to claim 13, wherein said photodiode comprises a top photodiode and a bottom photodiode each configured to receive a full frame of said image and to output a respective said analog signal.

16. The image capture device according to claim 15, further comprising:

a top front end circuit and a bottom front end circuit, each configured to respectively receive said analog signals of said top and bottom photodiodes;

said top and bottom front end circuits configured to control analog filtering, gain, and threshold of said respective analog signals;

wherein said analog-to-digital converter comprises a top analog-to-digital converter (ADC) and a bottom ADC configured to respectively receive said analog signals from said top and bottom front end circuits, and to convert said analog signals into respective digital image signals, and to communicate said respective digital image signals to said FPGA;

said FPGA further configured to receive each of said respective digital image signals from said top and bottom ADC, and to perform imaging processing within each of said respective images, to form respective enhanced images;

wherein said FPGA is further configured to form a single enhanced digital image from said respective enhanced images; and

wherein said means for outputting and scanning is further configured to receive said single enhanced image from said FPGA, and to scan said single enhanced image using said visible red wavelength.

17. The image capture device according to claim 16, wherein said single enhanced image comprises:

a merged signal formed by merging said respective digital image signals;

or

a selected best image signal selected from either of said respective digital image signals.

18. The image capture device according to claim 16, further comprising:

a top histogram generator and a bottom histogram generator, each of said top and bottom histogram generators configured to generate a respective histogram of characteristics of said analog signals from said top and bottom photodiodes; and

wherein said FPGA is further configured to receive and use said respective histograms to adjust power to said means for outputting and scanning on a frame by frame basis until said histograms indicate a proper image.

19. The image capture device according to claim 18, wherein said histogram characteristics comprise contrast and intensity levels.

20. The image capture device according to claim 13, further comprising a microprocessor configured to redundantly monitor and control said means for outputting and scanning to control said scanning in said first and second directions, and said scanning in said third and fourth directions, to form a raster pattern.

21. An image capture device comprising:

means for outputting and scanning a beam of light comprising an infrared wavelength and a visible red wavelength in a first and a second direction, for forming respective lines in said first and second directions, and for scanning said lines in a third direction and a fourth direction;

an electronic component configured to control said means for outputting and scanning to control said scanning in said first and second directions, and to control said scanning in said third and fourth directions, to form a pattern;

a photodiode configured to receive an image formed from said scanned pattern of said infrared wavelength of light, said photodiode further configured to convert the image into an analog signal;

wherein said means for outputting and scanning is further configured to receive said analog signal, and to scan said image using said visible red wavelength;

a line correlator configured to measure a shift in convergence between said respective lines in said first and second directions;

a mirror convergence control configured to receive said measured shift in convergence from said line correlator, and to adjust said control of said means for outputting and scanning by said electronic component, for said line in said first direction to converge with said line in said second direction.

22. The image capture device according to claim 21, further comprising:

a feedback means configured for detecting said output of said means for outputting and scanning, and for signaling said detected output to said electronic component, for said electronic component to control said output of said means for outputting and scanning;

an analog-to-digital converter configured to receive said analog signal from said photodiode, and to convert said analog signal into a digital image signal, and to communicate said digital image signal to said electronic component;

wherein said electronic component is configured to receive and process said digital image signal and to output a processed image signal; and

wherein said means for outputting and scanning is further configured to receive said processed image from said electronic component, and to scan said processed image using said red wavelength.

23. The image capture device according to claim 22, wherein said photodiode comprises a top photodiode and a bottom photodiode each configured to receive a full frame of said image and to output a respective said analog signal.