System and method of determining if a surface is printed or a mobile device screen

• US 9,659,198 B2
• Filed: 09/10/2015
• Issued: 05/23/2017
• Est. Priority Date: 09/10/2015
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Van Horn, Erik, Good, Timothy, Giordano, Patrick Anthony, Colavito, Stephen J., Kearney, Sean Philip
• Primary Examiner(s): Haupt, Kristy A
• Application Number:
  US14/850,110
• Publication Number:
  US 20170076122A1
• Time in Patent Office: 621 Days
• Field of Search: None
• CPC Class Codes: G01J 3/457 Correlation spectrometry, e.g. of the intensity G01J3/453 takes precedence
• CPC Class Codes: G01J 3/506 measuring the colour produced by screens, monitors, displays or CRTs
• CPC Class Codes: G06K 7/1095 the scanner comprising adaptations for scanning a record carrier that is displayed on a display-screen or the like

Abstract

A system and method of determining if a surface contains print or is a screen of a mobile device is provided. The method is comprised of the steps of: acquiring a spectral wavelength signature of the surface; comparing the spectral wavelength signature of the surface to RGB triple-peak emission spectra; scanning the surface with an image-based scanner in non-illumination mode based upon the spectral wavelength signature of the surface corresponding to the RGB triple-peak emission spectra, and scanning the surface with an image-based scanner in illumination mode based upon the spectral wavelength signature of the surface not corresponding to the RGB triple-peak emission spectra.

Claims

1. A system for determining if a surface contains print or is a screen of a mobile device, comprising:

means to acquire a spectral wavelength signature of the surface;

means to compare the spectral wavelength signature of the surface to RGB triple-peak emission spectra;

the means to acquire a spectral wavelength signature and the means to compare the spectral wavelength signature to RGB triple-peak emission spectra being communicatively linked;

an image-based scanner, the image-based scanner provided with an illumination mode, and a non-illumination mode, the image-based scanner being communicatively linked to the means to acquire a spectral wavelength signature and to the means to compare the spectral wavelength signature;

the system being configured to acquire the spectral wavelength signature of the surface with the means to acquire the spectral wavelength signature and to compare the spectral wavelength signature to the RGB triple-peak emission spectra with the means to compare the spectral wavelength signature;

the system further configured to scan the surface with the image-based scanner in the non-illumination mode based upon the spectral wavelength signature corresponding to the RGB triple-peak emission spectra, and

the system further configured to scan the surface with the image-based scanner in the illumination mode based upon the spectral wavelength signature not corresponding to the RGB triple-peak emission spectra.

2. The system of claim 1, wherein the surface contains a barcode;

and wherein the image-based scanner is provided with barcode scanning capability.

3. The system of claim 1, wherein the means to acquire a spectral wavelength signature of the surface is comprised of a diffractive element and a sensor element;

and wherein the system is configured to acquire the spectral wavelength signature by capturing light from the surface, sending the captured light through the diffractive element, and using the sensor element acquire the spectral wavelength signature.

4. The system of claim 3, wherein the sensor element is selected from a linear imager and a two-dimensional sensor.

5. The system of claim 1, wherein the means to acquire a spectral wavelength signature of the surface is comprised of colored-filters and a sensor element;

and wherein the system is configured to acquire the spectral wavelength signature by capturing light from the surface and sending the captured light through colored filters, and using the sensor element to acquire the spectral wavelength signature.

6. The system of claim 1, wherein the means to acquire a spectral wavelength signature of the surface is comprised of a two-dimensional imaging lens having intentional chromatic aberrations and a sensor element;

and wherein the system is configured to acquire the spectral wavelength signature by capturing light from the surface, sending the captured light through the two-dimensional imaging lens, and using the sensor element to acquire the spectral wavelength signature.

7. The system of claim 1, wherein the means to compare the spectral wavelength signature to RGB triple-peak emission spectra is selected from:

Spectral Angle Mapper software, Principal Component Analysis software, and Pearson correlation coefficient software.

8. The system of claim 1, further comprising:

a laser scanner; and

wherein the system is configured to scan the surface with the laser scanner based upon the spectral wavelength signature not matching the RGB triple-peak emission spectra.

9. The system of claim 1, wherein the system is further configured to compare the spectral wavelength signature to known spectra selected from the spectra of sunlight, incandescent light, white LED light, warm-white fluorescent light, and fluorescent light with the means to compare the spectral wavelength signature;

and wherein the system is further configured to scan the surface with the image-based scanner in the illumination mode based upon the spectral wavelength signature corresponding to the known spectra.

10. The system of claim 1, wherein the means to acquire a spectral wavelength signature of the surface and the image-based scanner use a same field of view.

11. A system for determining if a surface contains print or is a screen of a mobile device, comprising:

an image based scanner;

image recognition software, the image recognition software being provided with information about aspect ratios of mobile device screens, aspect ratios of mobile devices, and features associated with mobile devices;

wherein the system is configured to capture a digital image of the surface and proximate surrounding background to the surface with the image-based scanner, and submit the digital image to the image recognition software; and

wherein the system is further configured to scan the surface with the image-based scanner in the non-illumination mode based upon positive comparisons between the digital image and the information about mobile devices stored in the image recognition software.

12. The system of claim 11, wherein the features associated with mobile devices may be selected from:

a presence of a portion of a human hand holding a device with the aspect ratio of a mobile device and a lit screen.

13. The system of claim 11, wherein the system is further configured to prompt a user of the system based upon positive comparisons between the digital image and the information about mobile devices stored in the image recognition software.

14. A method of determining if a surface contains print or is a screen of a mobile device, and for scanning the surface, comprising the steps of:

acquiring a spectral wavelength signature of the surface;

comparing the spectral wavelength signature of the surface to RGB triple-peak emission spectra;

scanning the surface with an image-based scanner in non-illumination mode based upon the spectral wavelength signature of the surface corresponding to the RGB triple-peak emission spectra, and

scanning the surface with an image-based scanner in illumination mode based upon the spectral wavelength signature of the surface not corresponding to the RGB triple-peak emission spectra.

15. The method of claim 14, wherein the acquiring step is accomplished by the steps of:

capturing light from the surface;

sending the captured light through a diffractive element; and

sensing the structure of the spectral wavelength signature with a sensing element.

16. The method of claim 14, wherein the acquiring step is accomplished by the steps of:

capturing light from the surface;

sending the captured light through colored filters, and sensing the structure of the spectral wavelength signature with a sensing element.

17. The method of claim 14, wherein the acquiring step is accomplished by the steps of:

capturing light from the surface;

sending the captured light through a two-dimensional imaging lens having intentional chromatic aberrations; and

sensing the structure of the spectral wavelength signature with a sensing element.

18. The method of claim 14, wherein the comparing the spectral wavelength signature of the surface to RGB triple-peak emission spectra step is accomplished by using software selected from Spectral Angle Mapper software, Principal Component Analysis software, and Pearson correlation coefficient software.

19. The method of claim 14, wherein the surface contains a barcode;

and wherein the image-based scanner provided with barcode scanning capabilities.

20. The method of claim 14, wherein the step of comparing the spectral wavelength signature of the surface to RGB triple-peak emission spectra also includes comparing the spectral wavelength signature of the surface to known spectra, the known spectra being selected from the spectra of sunlight, incandescent light, white LED light, warm-white fluorescent light, and fluorescent light;

and the step of scanning the surface with an image-based scanner in illumination mode is based upon the spectral wavelength signature of the surface corresponding to the known spectra.