Interactive user interface for capturing a document in an image signal

• US 9,047,531 B2
• Filed: 01/28/2011
• Issued: 06/02/2015
• Est. Priority Date: 05/21/2010
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Showering, Paul Edward, Oosting, Eize
• Primary Examiner(s): DIEP, TRUNG T
• Application Number:
  US13/016,655
• Publication Number:
  US 20110285874A1
• Time in Patent Office: 1,586 Days
• Field of Search: 348/207.99, 348/208.14, 348/231.9, 382/312, 382/313
• US Class Current: 1/1
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/00718 Skew
• CPC Class Codes: H04N 1/00737 using the scanning elements as detectors
• CPC Class Codes: H04N 1/00748 Detecting edges, e.g. of a stationary sheet
• CPC Class Codes: H04N 1/00774 Adjusting or controlling
• CPC Class Codes: H04N 1/00824 for displaying or indicating, e.g. a condition or state details of displaying or indicating means H04N1/00405
• CPC Class Codes: H04N 1/04 Scanning arrangements , i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versaH04N1/387 takes precedence
• CPC Class Codes: H04N 1/3935 with modification of image resolution, i.e. determining the values of picture elements at new relative positions
• CPC Class Codes: H04N 2201/0081 Image reader H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0096 Portable devices
• CPC Class Codes: H04N 2201/0098 User intervention not otherwise provided for, e.g. placing documents, responding to an alarm
• CPC Class Codes: H04N 2201/3254 Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory
• CPC Class Codes: H04N 2201/3273 Display

Abstract

Devices, methods, and software are disclosed for an interactive user interface for capturing a frame of image data having a representation of a feature. In an illustrative embodiment, a device includes an imaging subsystem, one or more memory components, and one or more processors. The imaging subsystem is capable of providing image data representative of light incident on said imaging subsystem. The one or more memory components include at least a first memory component operatively capable of storing an input frame of the image data. The one or more processors may be enabled for performing various steps. One step may include receiving the image data from the first memory component. Another step may include attempting to identify linear features defining a candidate quadrilateral form in the image data. Another step may include providing user-perceptible hints for guiding a user to alter positioning of the device to enhance a capability for identifying the linear features defining a candidate quadrilateral form in the image data.

Claims

1. A device comprising:

an imaging subsystem, capable of providing image data representative of light incident on said imaging subsystem;

one or more memory components, comprising at least a buffering memory component operatively enabled for temporarily storing the image data; and

one or more processors, enabled for;

receiving the image data from at least a first memory component among the one or more memory components;

attempting to identify linear features defining a candidate quadrilateral form in the image data; and

providing user-perceptible hints via one or more output components for guiding a user to alter positioning of the device to enhance a capability for identifying the linear features defining a candidate quadrilateral form in the image data;

in which the one or more output components comprise a preview monitor enabled for displaying a preview image based on the image data, and in which the one or more processors are further enabled for providing the user-perceptible hints as hint icons displayed on the preview image;

the one or more processors are further enabled such that attempting to identify linear features defining a candidate quadrilateral form in the image data comprises;

generating a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame, in which a pixel in the reduced resolution frame combines information from two or more pixels in the input frame;

displaying the reduced resolution frame on the monitor as the preview image; and

attempting to identify the linear features defining a candidate quadrilateral form in the reduced resolution frame.

2. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise traces on the monitor corresponding to identified linear features.

3. The device of claim 2, in which the one or more processors are further enabled such that the traces on the monitor corresponding to identified linear features are altered from a first color to a second color to signify successful identification of a candidate quadrilateral form defined by the identified linear features.

4. The device of claim 3, in which the one or more memory components further comprise a second memory component, and in which the one or more processors are further enabled for prompting the user to indicate whether a high-resolution image corresponding to the identified candidate quadrilateral form should be stored in the second memory component, where the high-resolution image has a higher resolution than the preview image;

and if the user so indicates, then storing the high-resolution image corresponding to the identified candidate quadrilateral form in the second memory component.

5. The device of claim 3, in which the one or more memory components further comprise a second memory component, in which the one or more processors are further enabled for responding to the successful identification of the candidate quadrilateral form by storing a high-resolution image corresponding to the identified candidate quadrilateral form in a second memory component, where the high-resolution image has a higher resolution than the preview image.

6. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise straight indicators displayed on the monitor indicating a direction for translational re-positioning of the device.

7. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise distance indicators displayed on the monitor indicating a direction for re-positioning of the device closer to or farther from a target.

8. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise indicators displayed on the monitor indicating a direction to rotate the device.

9. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise an excessive motion indicator displayed on the monitor indicating that at least one of the imaging system and/or a candidate quadrilateral form are exhibiting excessive motion interfering with the capability for identifying linear features defining the candidate quadrilateral form.

10. The device of claim 1, in which the one or more processors are further enabled such that the hint icons comprise a partial shadow indicator displayed on the monitor indicating that an apparent partial shadow is obscuring a candidate quadrilateral form.

11. The device of claim 1, in which the one or more processors are further enabled such that attempting to identify linear features defining a candidate quadrilateral form in the image data comprises:

attempting to identify transition pairs comprising pairs of adjacent pixels in the reduced resolution frame having differences between the pixels that exceed a pixel transition threshold;

attempting to identify one or more linear features in the reduced resolution frame between two or more identified transition pairs; and

providing an indication of one or more identified linear features in the reduced resolution frame.

12. The device of claim 11, in which the one or more processors are further enabled such that attempting to identify linear features defining a candidate quadrilateral form in the image data comprises:

connecting consecutive identified pixel transitions into identified line segments, identifying sets of line segments that are approximately in-line with each other, and merging identified sets of in-line line segments into identified linear features;

measuring angles between identified linear features;

evaluating whether the measured angles are within a constrained skew value around 90 degrees, and if they are, then identifying intersections of the linear features as identified corner points;

evaluating whether four linear features with four corner points can be identified, and if they are not identified, then providing, on the preview monitor, the hint icons for guiding a user to alter positioning of the device to enhance a capability for identifying four linear features with four corner points.

13. A method, performed using one or more processors, comprising:

receiving a frame of image data from an imaging component;

generating, using at least one of the processors, a reduced resolution frame based on the input frame, the reduced resolution frame comprising fewer pixels than the input frame, in which each pixel of a plurality of pixels in the reduced resolution frame combines information from two or more pixels in the input frame;

attempting, using at least one of the processors, to identify linear features defining a candidate quadrilateral form in the image data; and

determining, using at least one of the processors, graphical operator hint icons for guiding a user to alter positioning of the imaging component to enhance a capability for identifying the linear features defining a candidate quadrilateral form in subsequent image data; and

providing the graphical operator hint icons via an output component;

in which the one or more output components comprise a preview monitor enabled for displaying a preview image based on the image data, and in which the one or more processors are further enabled for providing the user-perceptible hints as hint icons displayed on the preview image;

the one or more processors are further enabled such that attempting to identify linear features defining a candidate quadrilateral form in the image data comprises;

generating a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame, in which a pixel in the reduced resolution frame combines information from two or more pixels in the input frame;

displaying the reduced resolution frame on the monitor as the preview image; and

attempting to identify the linear features defining a candidate quadrilateral form in the reduced resolution frame.

14. The method of claim 13, in which the method further comprises providing an image of the reduced resolution frame and the graphical operator guidance icons on a preview monitor, and the graphical operator guidance icons are selected from among straight indicators indicating a direction for translational re-positioning of the imaging component, distance indicators indicating a direction for re-positioning of the device forward or backward, curved indicators indicating a direction to rotate the device, an excessive motion indicator indicating that the image data are exhibiting excessive motion, and a partial shadow indicator indicating that an apparent partial shadow is obscuring a candidate quadrilateral form.

15. A non-transitory computer-readable storage medium comprising executable instructions capable of enabling one or more computing elements, including one or more processors, for:

receiving a first frame of image data;

attempting to identify linear features defining a candidate quadrilateral form in the first frame of image data; and

providing user-perceptible hints for guiding a user to alter positioning of the device to enhance a capability for identifying the linear features defining a candidate quadrilateral form in a subsequent frame of image data;

providing the user hint icons via an output component;

in which the one or more output components comprise a preview monitor enabled for displaying a preview image based on the image data, and in which the one or more processors are further enabled for providing the user-perceptible hints as hint icons displayed on the preview image;

the one or more processors are further enabled such that attempting to identify linear features defining a candidate quadrilateral form in the image data comprises;

generating a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame, in which a pixel in the reduced resolution frame combines information from two or more pixels in the input frame;

displaying the reduced resolution frame on the monitor as the preview image; and

attempting to identify the linear features defining a candidate quadrilateral form in the reduced resolution frame.

16. The non-transitory computer-readable storage medium of claim 15, in which the executable instructions are further capable of enabling the one or more computing elements for:

storing a plurality of graphical icons to be used for the user perceptible hints;

evaluating one or more reasons for the image data being non-optimal;

selecting one or more of the graphical icons for addressing the one or more evaluated reasons for the image data being non-optimal; and

displaying the one or more selected graphical icons on a preview monitor that also displays the candidate quadrilateral form.

17. The non-transitory computer-readable storage medium of claim 16, in which the executable instructions are further capable of enabling the one or more computing elements for selecting from among straight indicator graphical icons indicating a direction for translational re-positioning of the imaging component, distance indicator graphical icons indicating a direction for repositioning of the device forward or backward, curved indicator graphical icons indicating a direction to rotate the device, an excessive motion indicator graphical icon indicating that the image data are exhibiting excessive motion, and a partial shadow indicator graphical icon indicating that an apparent partial shadow is obscuring a candidate quadrilateral form.