Laser speckle photography for surface tampering detection

• US 10,288,420 B2
• Filed: 07/31/2015
• Issued: 05/14/2019
• Est. Priority Date: 11/14/2012
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Shih, YiChang, Davis, Myers Abraham, Hasinoff, Samuel Wiliam, Durand, Frederic, Freeman, William T.
• Primary Examiner(s): Teitelbaum, Michael E
• Application Number:
  US14/815,092
• Publication Number:
  US 20160010982A1
• Time in Patent Office: 1,383 Days
• Field of Search: 348142, 348129, 348131, 348136, 348153, 348159, 348169, 348184, 348 46, 348 47, 348 48, 348 49, 348 50, 348 51, 348 54, 348 64, 3482221, 3483331, 348360, 348501, 348744, 348135, 348137, 348138, 348139, 348140, 348141, 348 67, 348 68, 348 69, 348 70, 382153, 382154, 382218, 349 5, 356 401, 356603, 356606, 356611, 356612
• CPC Class Codes: G01B 11/254 Projection of a pattern, viewing through a pattern, e.g. moiré
• CPC Class Codes: G01B 11/303 using photoelectric detection means
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In one embodiment, a method comprises projecting, from a projector, a diffused on an object. The method further includes capturing, with a first camera in a particular location, a reference image of the object while the diffused is projected on the object. The method further includes capturing, with a second camera positioned in the particular location, a test image of the object while the diffused is projected on the object. The method further includes comparing speckles in the reference image to the test image. The projector, first camera and second camera are removably provided to and positioned in a site of the object.

Claims

1. A method comprising:

comparing speckles in a reference image of an object captured with a camera at a first time in a particular location relative to the object and at a particular angle relative to the object, while coherent illumination is projected on the object, to speckles in a test image of the object captured with a camera at a second time positioned in the particular location relative to the object and at the particular angle relative to the object while the coherent illumination is projected on the object, the particular location being within a location threshold and the particular angle being within an angle threshold;

wherein the projector, first camera and second camera are removably provided to and positioned in a site of the object.

2. The method of claim 1, further comprising:

generating a reference map of the object from a plurality of reference images captured of the object;

before capturing the test image, positioning the second camera at the particular location by;

(1) taking a temporary picture with the second camera,

(2) repositioning the second camera based on features in the temporary picture and features in the generated reference map, and

(3) repositioning the second camera based on speckle comparison of the temporary image to the reference image; and

aligning the test image with the reference image by computing a similarity map.

3. The method of claim 2, wherein aligning the test image with the reference image further matches patches of the reference image to patches of the test image.

4. The method of claim 2, wherein positioning the second camera to the particular location further includes (4) repeating steps (1)-(3) until the second camera is returned to the particular location.

5. The method of claim 2, wherein the second camera is repositioned by at least one of a robotic device and motor.

6. The method of claim 2, wherein the second camera is repositioned along a coordinate plane, through a three-dimensional coordinate system, or rotated along one or more axes.

7. The method of claim 1, further comprising signaling, based on the comparison, whether the object was changed between capturing the reference image and capturing the test image.

8. The method of claim 1, further comprising outputting an indication of changed areas in the object between the reference image and the test image.

9. The method of claim 1, wherein positioning the same camera is returning the same camera to the particular location subsequently in time.

10. The method of claim 1, wherein comparing speckles in the reference image to the test image includes correlating speckles in the reference image to the test image.

11. The method of claim 10, wherein correlating laser speckles in the reference image to the test image includes:

randomly sampling image patches in the reference image and the test image;

matching patches from the test image to the reference image; and

fitting a warp to the resulting matching patches.

12. The method of claim 11, wherein matching patches further includes:

performing a normalized cross-correlation to find the corresponding best-matching patch in the test image;

based on the corresponding best matching patch, employing random sample consensus (RANSAC) to recover a 3×

3 homography relating the two speckle images; and

computing the similarity map relating the target image and the warped reference image.

13. A system comprising:

a processor; and

a memory with computer code instructions stored thereon, the processor and the memory, with the computer code instructions being configured to implement;

a correlation module configured comparing speckles in a reference image of an object captured with a first camera at a first time in a particular location relative to the object and at a particular angle relative to the object, while coherent illumination is projected on the object, to speckles in a test image of the object captured with a second camera positioned in the particular location relative to the object and at the particular angle relative to the object while the coherent illumination is projected on the object, the particular location being within a location threshold range and the particular angle being within an angle threshold range;

wherein the projector, first camera and second camera are removably provided to and positioned in a site of the object.

14. The system of claim 13, wherein at least one of the first camera, the second camera, and a third camera is configured to capture a plurality of reference images of the object, and further comprising:

a map generation module configured to generate a reference map of the object from the plurality of reference images;

a camera scaffold module configured to, before capturing the test image, position the second camera at the particular location by;

(1) take a temporary picture with the second camera,

(2) reposition the second camera based on features in the temporary picture and features in the generated reference map,

(3) reposition the second camera based on speckle comparison of the temporary image to the reference image,

an image alignment module configured to align the test image with the reference image by computing a similarity map.

15. The system of claim 14, wherein the image alignment module is further configured to matches patches of the reference image to patches of the test image.

16. The system of claim 14, wherein the second camera scaffold module is further configured to (4) repeat steps (1)-(3) until the second camera is returned to the particular location.

17. The system of claim 14, wherein the camera scaffolding module includes at least one of a robotic device and motor configured to reposition the second camera.

18. The system of claim 13, wherein the second camera is repositioned along a coordinate plane, through a three-dimensional coordinate system, or rotated along one or more axes.

19. The system of claim 13, further comprising a signaling module configured to signal, based on the comparison, whether the object was changed between capturing the reference image and capturing the test image.

20. The system of claim 13, further comprising a speckle output module configured to output an indication of changed areas in the object between the reference image and the test image.

21. The system of claim 13, wherein positioning the same camera is returning the same camera to the particular location subsequently in time.

22. The system of claim 13, wherein the correlation module is further configured to correlate speckles in the reference image to the test image.

23. The system of claim 22, wherein the correlation module is further configured correlate the speckles in the reference image to the test image by:

randomly sampling image patches in the reference image and the test image;

matching patches from the test image to the reference image; and

fitting a warp to the resulting matching patches.

24. The system of claim 23, wherein the correlation module is further configured to match patches by:

performing a normalized cross-correlation to find the corresponding best-matching patch in the test image;

based on the corresponding best matching patch, employing random sample consensus (RANSAC) to recover a 3×

3 homography relating the two speckle images; and

computing the similarity map relating the target image and the warped reference image.