Sensor-synchronized spectrally-structured-light imaging
First Claim
Patent Images
1. A method of spectral imaging comprising:
- obtaining color images through a sensor, comprising R, G and B color components, the color images comprising pixel values corresponding to locations in a field of view of the sensor, and being captured during corresponding illumination periods in which different LED light sources illuminate the field of view of the sensor, and the color images represent a combination of light from an LED light source and ambient light reflected from a scene in the field of view;
applying a coupling factor to pixel values of the color images corresponding to a spectral channel to provide spectral channel values, wherein the spectral channel is associated with a combination of light source and a color component;
summing pixel values for corresponding locations to provide sums for the corresponding locations; and
for N spectral channels and the locations, computing a ratio of the spectral channel value and sum of a corresponding location to provide a spectricity vector for the corresponding location.
1 Assignment
0 Petitions
Accused Products
Abstract
A smartphone is adapted for use as an imaging spectrometer, by synchronized pulsing of different LED light sources as different image frames are captured by the phone'"'"'s CMOS image sensor. A particular implementation employs the CIE color matching functions, and/or their orthogonally transformed functions, to enable direct chromaticity capture. A great variety of other features and arrangements are also detailed.
-
Citations
27 Claims
-
1. A method of spectral imaging comprising:
-
obtaining color images through a sensor, comprising R, G and B color components, the color images comprising pixel values corresponding to locations in a field of view of the sensor, and being captured during corresponding illumination periods in which different LED light sources illuminate the field of view of the sensor, and the color images represent a combination of light from an LED light source and ambient light reflected from a scene in the field of view; applying a coupling factor to pixel values of the color images corresponding to a spectral channel to provide spectral channel values, wherein the spectral channel is associated with a combination of light source and a color component; summing pixel values for corresponding locations to provide sums for the corresponding locations; and for N spectral channels and the locations, computing a ratio of the spectral channel value and sum of a corresponding location to provide a spectricity vector for the corresponding location. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method comprising:
-
obtaining pixels sampled from a scene, the pixels each comprising an N-D spectral vector; and classifying the N-D spectral vector to ascertain class of an object in the scene;
the method further including computing a spatial relationship function of pixels sampled from different locations of the object to obtain a vector of multi-spectral channels per pixel and spatial relationships among the pixels, inputting the vector to a classifier, and classifying the object based on the vector. - View Dependent Claims (17, 18, 20, 21, 22, 23, 24, 25, 26)
-
-
19. An apparatus comprising:
-
an imaging apparatus for obtaining pixels sampled from a scene, the pixels each comprising an N-D spectral vector;
the imaging apparatus configured to sample pixels under different illumination to obtain N different spectral samples per pixel; anda processor in communication with the imaging apparatus, the processor configured with instructions to execute a classifier that classifies the N-D spectral vector to ascertain class of an object in the scene; the processor configured with instructions to compute a spatial relationship function of pixels sampled from different locations of an object to obtain a vector of N spectral channels per pixel and spatial relationships among the pixels, the processor configured with instructions to input the vector to the classifier, and classify the object based on the vector. - View Dependent Claims (27)
-
Specification