OPTICAL IDENTIFICATION AND CHARACTERIZATION SYSTEM AND TAGS

• US 20180197052A1
• Filed: 07/04/2016
• Published: 07/12/2018
• Est. Priority Date: 07/05/2015
• Status: Active Grant

• Current Assignee: TheWhollySee Ltd.
• Original Assignee: TheWhollySee Ltd.
• Inventors: YANSON, Dan, YOFFE, Avraham
• Granted Patent: US 10,482,361 B2
• Time in Patent Office: Days
• CPC Class Codes: G01J 2003/2826 Multispectral imaging, e.g. filter imaging
• CPC Class Codes: G06K 19/06028 using bar codes
• CPC Class Codes: G06K 19/06037 multi-dimensional coding
• CPC Class Codes: G06K 19/0614 the marking being selective to wavelength, e.g. color barcode or barcodes only visible under UV or IR methods or arrangements for sensing record carriers using a selected wavelength, see G06K7/12

Abstract

A system is disclosed capable of automatic and remote identification, tracking, sensing, and characterization of physical entities (objects and subjects) using structural-color tags. Optical encoding is performed in the spectral domain by means of photonic engineering. Several embodiments are provided for the imaging, tagging and processing aspects of the system.

Claims

1. A system comprising:

(a) a plurality of structural-color tags, generating a distinct spectral response in a specified spectral range, said distinct spectral response including at least one characteristic spectral feature;

(b) a spectral imaging system for capturing a dataset of at least 5 spectrally-filtered digital images of a field of view; and

(c) a processing system comprising at least one processor, said processing system being configured to process a dataset of spectrally-filtered digital images from said spectral imaging system so as to;

(i) identify spatial pixels of said dataset having said characteristic spectral feature in said specified spectral range as spatial pixels corresponding to one of said tags; and

(ii) process spectral data from said dataset for said tag to derive information relating to said tag.

2. The system of claim 1, wherein said processing system is configured to perform said identifying and said processing for each of a plurality of said tags present within a field of view in a dataset of spectrally-filtered digital images.

3. The system of claim 1, wherein said spectral imaging system is a hyperspectral imaging system, and said dataset of spectrally-filtered digital images forms a hyperspectral image cube.

4. The system of claim 1, wherein said plurality of structural-color tags comprises at least 10 structural-color tags, each of said tags having a spectral response distinct from all others of said tags, and wherein said processing system is configured to identify from said spectral data each of said tags that is visible within the field of view.

5. The system of claim 1, wherein said spectral imaging system includes a first filter configuration providing one or more spectral transmission maxima and one or more spectral transmission minima, and a second filter configuration providing one or more spectral transmission maxima and one or more spectral transmission minima, so that the one or more of transmission maxima of said first filter configuration match the one or more transmission minima of said second filter configuration within a specified spectral range.

6. The system of claim 1, which further includes an active illuminator that emits, or is filtered to emit, at wavelengths that at least partly correspond to said at least one characteristic spectral feature.

7. The system of claim 1, wherein said processing system is further configured to actuate at least one action as a function of said information relating to said tag, the at least one action being selected from the group consisting of range-finding, focus adjustment, exposure adjustment, camera rotation, object tracking, image recording, illumination, flash activation, data transmission.

8. The system of claim 1, which further includes a visible-spectrum camera positioned close to, or integrated with said spectral imaging system, so that at least part of the field of view is shared between said visible-spectrum camera and said spectral imaging system.

9. A method for detection of, and obtaining information from, a plurality of structural-color tags comprising the steps of:

(a) employing a spectral imaging system to capture a dataset of at least 5 spectrally-filtered digital images of a field of view;

(b) processing said dataset of spectrally-filtered digital images to identify spatial pixels having characteristic spectral features in a specified spectral range as spatial pixels corresponding to a structural-color tag; and

(c) for each detected tag, process spectral data for the corresponding pixels to derive information relating to the tag.

10. The method of claim 9, wherein said dataset of spectrally-filtered digital images is captured by:

(a) capturing a first dataset of spectrally-filtered digital images under active illumination conditions;

(b) capturing a second dataset of spectrally-filtered digital images without active illumination; and

(c) subtracting at least part of said second dataset of spectrally-filtered digital images from at least part of said first dataset of spectrally-filtered digital images.

11. The method of claim 9, wherein at least part of said field of view covers a range greater than three meters from said spectral imaging system.

12. The method of claim 9, wherein said spatial pixels having characteristic spectral features are identified by subtraction of, and/or differentiation between, any two or more images, or portions thereof, within said dataset of spectrally-filtered digital images.

13. The method of claim 9, wherein the information derived from a tag includes either an identity or property, or both, of said tag, and/or of the entity bearing said tag.

14. The method of claim 9, which further includes the steps of:

(a) employing an active illuminator co-located with said spectral imaging system for providing active illumination at wavelengths that at least partly correspond to at least one said characteristic spectral feature;

(b) adding a retro-reflecting element to said tags for redirecting active illumination from said tags towards said spectral imaging system.

15. The method of claim 9, which further includes the steps of:

(a) employing an active illuminator at a different location from said spectral imaging system for providing active illumination at wavelengths that at least partly correspond to at least one said characteristic spectral feature;

(b) deriving angular information relating to said tag, said information including at least one of orientation, angle, displacement, relief, topography, shape, profile, structure, depth of said tag or underlying surface;

16. The method of claim 9, wherein a tag forms a parameter sensor and the information derived from a tag includes a measurement of said parameter.

17. A structural-color tag having a lateral dimension greater than five millimeters and comprising at least one photonic structure selected from the group consisting of interferometric, multilayer, thin-film, quarter-wavelength, Bragg, grating, Fabry-Perot, plasmonic, photonic crystal, structural filter, color-shifting, optically-variable structures, said photonic structure having a distinct spectral response in a specified spectral range, said distinct spectral response associated with

(a) one or more optical phenomena from the group comprising interference, diffraction, refraction, iridescence, scattering, plasmonics;

(b) at least one characteristic spectral feature, said feature including at least one transition between a high-intensity level and a low-intensity level, said intensity levels differing by 20% or more and said transition occurring over a spectral bandwidth of 1000 inverse centimeters or less.

18. A tag according to claim 17, wherein said at least one photonic structure is integrated as part of a medium selected from the group consisting of taggant, pigment, coating, paint, ink, film, sticker, tape, fabric.

19. A tag according to claim 17 comprising a quantity of material comprising a plurality of flakes distributed in a range of orientation, each of said flakes comprising a layered optical structure configured to generate a distinct spectral response in a specified spectral range.

20. A set of tags comprising a plurality of the tags of claim 17, wherein each of said tags has a spectral response distinct from all others of said tags.

21. A set of tags according to claim 20, wherein each of said tags differs from others of said tags in a value of at least one structural parameter selected from the group consisting of thickness, fill factor, period.

22. A tag according to claim 17 further comprising at least one optical element associated with said photonic structure and configured to enhance a proportion of light incident on said photonic structure which is retro-reflected along a line of incidence of the light.

23. A tag according to claim 22, wherein said at least one optical element is selected from the group consisting of glass beads, corner-cube array, corner reflector, prismatic array, lenticular array, lenticular sheet, cylindrical lens array, fly-eye lens array, dot lens array.

24. A tag according to claim 22, wherein said at least one photonic structure is a layered structure and said at least one optical element is a lens, said layered structure disposed in the focal plane of said lens.

25. A tag according to claim 22, whose distinct spectral response remains substantially invariant with the illumination and observation angle within an angular range of ±

10 degrees or greater about a direction normal to said tag.

26. A tag according to claim 22, wherein said tag forms an angle or orientation sensor and said at least one optical element is a retro-reflector, said at least one photonic structure being disposed on a surface of said retro-reflector.

27. A tag according to claim 22, further including a parameter-sensing material that changes its optical properties in response to changes in said parameter, said parameter selected from the group of temperature, humidity, strain, stress, deformation, time, gas presence or concentration, chemical agent presence or concentration.

28. A tag according to claim 22, wherein said tag forms a temperature sensor and further comprises thermochromic liquid crystals for rendering a spectral response indicative of temperature.