Barcode recognition using data-driven classifier

• US 9,396,377 B2
• Filed: 12/08/2014
• Issued: 07/19/2016
• Est. Priority Date: 09/30/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: van der Merwe, Rudolph, Noble, Samuel Gordon, Brunner, Ralph
• Primary Examiner(s): Marshall, Christle I
• Application Number:
  US14/563,949
• Publication Number:
  US 20150090797A1
• Time in Patent Office: 589 Days
• Field of Search: 23546208-46212
• US Class Current: 1/1
• CPC Class Codes: G06K 7/10811 Focalisation
• CPC Class Codes: G06K 7/1443 locating of the code in an image
• CPC Class Codes: G06K 7/1447 extracting optical codes from image or text carrying said optical code

Abstract

A barcode decoding system and method are disclosed that use a data-driven classifier for transforming a potentially degraded barcode signal into a digit sequence. The disclosed implementations are robust to signal degradation through incorporation of a noise model into the classifier construction phase. The run-time computational cost is low, allowing for efficient implementations on portable devices. Implementations are disclosed for intelligent preview scaling, barcode-aware autofocus augmentation and multi-scale signal feature extraction.

Claims

1. A method comprising:

capturing a digital image of an object using a sensor of a device; and

scaling the captured digital image, using one or more processors of the device, to lie within a predefined image view area of a user interface presented on a display screen of the device, while a distance is maintained between the object and the sensor, wherein the scaling is based on mapping information of a real-world coordinate frame onto a sensor coordinate frame.

2. The method of claim 1, wherein the object comprises a barcode.

3. The method of claim 1, wherein the scaling uses a geometric model to map the real-world coordinate frame onto the sensor coordinate frame.

4. The method of claim 1, further comprising:

constraining a size of the predefined image view area of the user interface using the mapping information.

5. The method of claim 4, wherein constraining the size of the predefined image view area of the user interface is based in part on at least one of an optical magnification of the object by the device or a constraint of the sensor.

6. The method of claim 3, wherein the geometric model comprises a trigonometric model of a pinhole camera.

7. The method of claim 6, wherein the object has a length h and the object'"'"'s image on the sensor of the device has a dimension of length h′

, and the pinhole camera model relates a distance d of the object from a camera lens of the device to a distance d′

of the sensor of the device from the camera lens of the device, and the relationship is given by h/d=h′

/d′

.

8. The method of claim 1, wherein the mapping accounts for at least one of lens distortion, sensor characteristics, or photographic effects.

9. The method of claim 1, wherein the scaling uses a model to map the real-world coordinate frame onto the sensor coordinate frame, with the method further comprising:

estimating model parameters using a calibration process and an image of a calibration target taken from a number of positions of the sensor relative to the calibration target.

10. The method of claim 1, wherein the scaling comprises using a scale factor that is determined relative to a target guide and that is contained entirely within the predefined image view area, and wherein the scale factor scales the image to substantially fill the predefined image view area while preserving an aspect ratio of the image.

11. A system comprising:

one or more processors;

memory configured for storing instructions, which, when executed by the one or more processors, causes the one or more processors to perform operations comprising;

capturing a digital image of an object using a sensor of a device; and

scaling the captured digital image to lie within a predefined image view area of a user interface presented on a display screen of the device, while a distance is maintained between the object and the sensor, wherein the scaling is based on mapping information of a real-world coordinate frame onto a sensor coordinate frame.

12. The system of claim 11, wherein the object comprises a barcode.

13. The system of claim 11, wherein the scaling uses a geometric model to map the real-world coordinate frame onto the sensor coordinate frame.

14. The system of claim 11, further comprising:

constraining a size of the predefined image view area of the user interface using the mapping information.

15. The system of claim 14, where constraining the size of the predefined image view area of the user interface is based in part on at least one of an optical magnification of the object by the device or a constraint of the sensor.

16. The system of claim 13, wherein the geometric model comprises a trigonometric model of a pinhole camera.

17. The system of claim 16, wherein the object has a length h and the object'"'"'s image on the sensor of the device has a dimension of length h′

, and the pinhole camera model relates a distance d of the object from a camera lens of the device to a distance d′

of the sensor of the device from the camera lens of the device, and the relationship is given by h/d=h′

/d′

.

18. The system of claim 11, wherein the mapping accounts for at least one of lens distortion, sensor characteristics, or photographic effects.

19. The system of claim 11, wherein the scaling uses a model to map the real-world coordinate frame onto the sensor coordinate frame, with the system further comprising:

estimating model parameters using a calibration process and an image of a calibration target taken from a number of positions of the sensor relative to the calibration target.

20. The system of claim 11, wherein the scaling comprises using a scale factor that is determined relative to a target guide and that is contained entirely within the predefined image view area, and wherein the scale factor scales the image to substantially fill the predefined image view area while preserving an aspect ratio of the image.

21. A system comprising:

one or more processors;

memory configured for storing instructions, which, when executed by the one or more processors, causes the one or more processors to perform operations comprising;

capturing a digital image of an object using a sensor of a device, while the sensor is at a distance from the object; and

scaling the digital image to lie within a target guide of a user interface presented on a display area of the device, rather than scaling the target guide to fit a size of the digital image.

22. The system of claim 21, wherein the scaling comprises using a scale factor determined relative to the target guide, where the target guide is entirely within the display area, and where the scale factor scales the digital image to substantially fill the display area while preserving an aspect ratio of the digital image.