Interactive user interface for capturing a document in an image signal

• US 9,319,548 B2
• Filed: 05/27/2015
• Issued: 04/19/2016
• Est. Priority Date: 05/21/2010
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Showering, Paul Edward, Oosting, Eize
• Primary Examiner(s): DIEP, TRUNG T
• Application Number:
  US14/722,608
• Publication Number:
  US 20150256695A1
• Time in Patent Office: 328 Days
• Field of Search: 348/207.99, 348/208.14, 348/231.9, 382/312, 382/313
• US Class Current: 1/1
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/0044 for image preview or review, e.g. to help the user position a sheet
• CPC Class Codes: H04N 1/00718 Skew
• CPC Class Codes: H04N 1/00737 using the scanning elements as detectors
• CPC Class Codes: H04N 1/00748 Detecting edges, e.g. of a stationary sheet
• CPC Class Codes: H04N 1/00774 Adjusting or controlling
• CPC Class Codes: H04N 1/00824 for displaying or indicating, e.g. a condition or state details of displaying or indicating means H04N1/00405
• CPC Class Codes: H04N 1/04 Scanning arrangements , i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versaH04N1/387 takes precedence
• CPC Class Codes: H04N 1/3935 with modification of image resolution, i.e. determining the values of picture elements at new relative positions
• CPC Class Codes: H04N 2201/0081 Image reader H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0096 Portable devices
• CPC Class Codes: H04N 2201/0098 User intervention not otherwise provided for, e.g. placing documents, responding to an alarm
• CPC Class Codes: H04N 2201/3254 Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory
• CPC Class Codes: H04N 2201/3273 Display

Abstract

Devices, methods, and software are disclosed for an interactive user interface for capturing a frame of image data having a representation of a feature. In an illustrative embodiment, a device includes an imaging subsystem, one or more memory components, and one or more processors. The imaging subsystem is capable of providing image data representative of light incident on said imaging subsystem. The one or more memory components include at least a first memory component operatively capable of storing an input frame of the image data. The one or more processors may be enabled for performing various steps. One step may include receiving the image data from the first memory component. Another step may include attempting to identify linear features defining a candidate quadrilateral form in the image data. Another step may include providing user-perceptible hints for guiding a user to alter positioning of the device to enhance a capability for identifying the linear features defining a candidate quadrilateral form in the image data.

Claims

1. A device, comprising:

an imaging subsystem for generating image data;

a monitor for displaying an image; and

a processor enabled for;

receiving the image data;

generating a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame;

attempting to identify linear features defining a candidate quadrilateral form in the image data;

displaying the reduced resolution frame on the monitor; and

providing a user-perceptible hint as hint icons in the displayed reduced resolution frame for guiding a user to alter positioning of the device to improve the device'"'"'s capability for identifying linear features defining a candidate quadrilateral form in the image data.

2. The device of claim 1, wherein a pixel in the reduced resolution frame combines information from two or more pixels in the input frame.

3. The device of claim 1, wherein the user-perceptible hints comprises a hint icon.

4. The device of claim 3, wherein the hint icon comprises a trace corresponding to an identified linear feature.

5. The device of claim 4, wherein the trace corresponding to an identified linear feature is altered from a first color to a second color to signify successful identification of a candidate quadrilateral form defined by the identified linear features.

6. The device of claim 1, wherein, in response to the successful identification of linear features defining a candidate quadrilateral form and user input confirming the identification, the devices stores a high resolution image corresponding to the candidate quadrilateral form in memory.

7. The device of claim 1, wherein the user-perceptible hint comprises a straight indicator indicating a direction for translational re-positioning of the device.

8. The device of claim 1, wherein the user-perceptible hint comprises a distance indicator indicating a direction for re-positioning of the device closer to or farther from a target.

9. The device of claim 1, wherein the user-perceptible hint comprises an indicator indicating a direction to rotate the device.

10. The device of claim 1, wherein the user-perceptible hint comprises an excessive motion indicator indicating that the imaging subsystem and/or a candidate quadrilateral form are exhibiting excessive motion interfering with the capability for identifying linear features defining the candidate quadrilateral form.

11. The device of claim 1, wherein the user-perceptible hint comprises a partial shadow indicator indicating that an apparent partial shadow is obscuring a candidate quadrilateral form.

12. The device of claim 1, wherein the processor is enabled for:

attempting to identify transition pairs comprising pairs of adjacent pixels in the reduced resolution frame having differences between the pixels that exceed a pixel transition threshold;

attempting to identify a linear feature in the reduced resolution frame between two or more identified transition pairs; and

providing an indication of an identified linear feature in the reduced resolution frame.

13. The device of claim 12, wherein the processor is enabled for:

connecting consecutive identified pixel transitions into identified line segments;

identifying sets of line segments that are approximately in-line with each other;

merging identified sets of in-line line segments into identified linear features;

measuring angles between identified linear features;

evaluating whether the measured angles are within a constrained skew value around 90 degrees, and if they are, then identifying intersections of the linear features as identified corner points; and

evaluating whether four linear features with four corner points can be identified, and if they are not identified, then providing, on the monitor, the hint icons for guiding a user to alter positioning of the device to enhance a capability for identifying four linear features with four corner points.

14. A device, comprising:

an imaging subsystem for generating image data;

a monitor for displaying an image; and

a processor enabled for;

receiving the image data;

generating a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame;

attempting to identify linear features defining a candidate quadrilateral form in the image data;

displaying the reduced resolution frame on the monitor;

providing a user-perceptible hint as hint icons in the displayed reduced resolution frame for guiding a user to alter positioning of the device to improve the device'"'"'s capability for identifying linear features defining a candidate quadrilateral form in the image data; and

in response to the successful identification of linear features defining a candidate quadrilateral form, storing a high resolution image corresponding to the candidate quadrilateral form in memory.

15. The device of claim 14, wherein the user-perceptible hint comprises a straight indicator indicating a direction for translational re-positioning of the device.

16. The device of claim 14, wherein the user-perceptible hint comprises an indicator indicating a direction to rotate the device.

17. A method, comprising:

receiving image data from an imaging subsystem within a device;

generating, with a processor in the device, a reduced resolution frame based on an input frame of the image data, the reduced resolution frame comprising fewer pixels than the input frame;

attempting, with the processor, to identify linear features defining a candidate quadrilateral form in the image data;

displaying the reduced resolution frame on a monitor; and

providing a user-perceptible hint as hint icons in the displayed reduced resolution frame for guiding a user to alter positioning of the device to improve the device'"'"'s capability for identifying linear features defining a candidate quadrilateral form in the image data.

18. The method of claim 17, wherein the user-perceptible hint comprises a straight indicator indicating a direction for translational re-positioning of the device.

19. The method of claim 17, comprising:

attempting, with the processor, to identify transition pairs comprising pairs of adjacent pixels in the reduced resolution frame having differences between the pixels that exceed a pixel transition threshold;

attempting, with the processor, to identify a linear feature in the reduced resolution frame between two or more identified transition pairs; and

providing, with the monitor, an indication of an identified linear feature in the reduced resolution frame.

20. The method of claim 19, comprising:

connecting, with the processor, consecutive identified pixel transitions into identified line segments;

identifying, with the processor, sets of line segments that are approximately in-line with each other;

merging, with the processor, identified sets of in-line line segments into identified linear features;

measuring, with the processor, angles between identified linear features;

evaluating, with the processor, whether the measured angles are within a constrained skew value around 90 degrees, and if they are, then identifying intersections of the linear features as identified corner points; and

evaluating, with the processor, whether four linear features with four corner points can be identified, and if they are not identified, then providing, on the monitor, the hint icons for guiding a user to alter positioning of the device to enhance a capability for identifying four linear features with four corner points.