Systems and methods for capturing electronic signatures

• US 10,643,064 B2
• Filed: 01/11/2019
• Issued: 05/05/2020
• Est. Priority Date: 09/13/2018
• Status: Active Grant

• Current Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Original Assignee: Capital One Services LLC (Capital One Financial Corporation)
• Inventors: Edwards, Joshua, Mossoba, Michael
• Primary Examiner(s): Azarian, Seyed H
• Application Number:
  US16/245,347
• Publication Number:
  US 20200089941A1
• Time in Patent Office: 480 Days
• Field of Search: 382100, 382103, 382106-107, 382115-119, 382155, 382162, 382168, 382173, 382181, 382188, 382191, 382200-203, 382217, 382232, 382254, 382276, 382286-294, 382305, 382312, 382219, 715268, 713176
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Methods and systems for generating electronic signatures are disclosed. In some embodiments, the method includes: storing pixel features of a signing device; capturing, via an imaging device, a plurality of image frames including the pixel features of the signing device; identifying in the plurality of image frames, by a processor, first pixels matching the stored pixel features of the signing device; generating, by the processor, a first image including the identified pixels; and connecting, by the processor, the identified pixels to form at least one line drawing representing a signature.

Claims

1. A computer-implemented method for generating electronic signatures, comprising:

recognizing, by a processor, a signing device in a first image taken by an imaging device, the recognizing comprising distinguishing the signing device from a surrounding environment based on pixel features of the signing device,

wherein the signing device is a finger or a hand and wherein recognizing the signing device further comprises;

capturing, via the imaging device, the first image showing an object;

determining whether the object occupies more than a predetermined percentage of the first image; and

identifying the object as the signing device when it is determined that the object occupies more than the predetermined percentage of the first image;

capturing, via the imaging device, a plurality of image frames including the pixel features of the signing device;

identifying in the plurality of image frames, by the processor, pixels matching the pixel features of the signing device;

generating, by the processor, a second image including the identified pixels;

connecting, by the processor, the identified pixels within the second image to form at least one line drawing representing a signature;

detecting a change of gesture of the finger or hand;

generating a space, a punctuation mark, or a break in the at least one line drawing representing the signature based on the change of the gesture; and

displaying the at least one line drawing representing the signature in a graphical user interface.

2. The computer-implemented method of claim 1, wherein recognizing the signing device further comprises detecting an object with a predetermined shape within the first image.

3. The computer-implemented method of claim 1, wherein capturing the plurality of image frames comprises capturing the image frames successively in time.

4. The computer-implemented method of claim 1, wherein the pixel features of the signing device comprise color information including at least one of a red-green-blue (RGB) value, a cyan-magenta-yellow-black (CMYK) value, a hue-saturation-lightness (HSL) value, a hue-saturation-value (HSV) value, a hexadecimal value, or a Pantone matching system (PMS) value.

5. The computer-implemented method of claim 1, wherein the pixel features of the signing device comprise greyscale values.

6. The computer-implemented method of claim 1, wherein the pixel features of the signing device comprise shape information extracted from a binary image, converted from a greyscale image of the signing device.

7. The computer-implemented method of claim 1, wherein connecting the identified pixels to form line drawings representing a signature comprises:

interpolating the identified pixels in the first image to generate additional pixels; and

connecting the identified pixels with the additional pixels to form the at least one line drawing representing the signature.

8. The computer-implemented method of claim 1, wherein connecting the identified pixels to form the at least one line drawing further comprises capturing the plurality of image frames at an increased frame rate to smooth the at least one line drawing.

9. The computer-implemented method of claim 1, further comprising:

detecting a moving direction of the signing device based on the plurality of image frames; and

generating a space, a punctuation mark, or a break in the at least one line drawing representing the signature based on a detected change of the moving direction.

10. The computer-implemented method of claim 1, further comprising:

detecting a moving distance of the signing device along a first direction based on the plurality of image frames; and

generating a space, a punctuation mark, or a break in the at least one line drawing representing the signature when the moving distance along the first direction exceeds a predetermined threshold.

11. The computer-implemented method of claim 1, further comprising modifying the at least one line drawing representing the signature based on user input on the graphical user interface.

12. The computer-implemented method of claim 11, wherein modifying the at least one line drawing representing the signature further comprises adding a space, a punctuation, or a break in the at least one line drawing representing the signature based on the user input.

13. The computer-implemented method of claim 1, further comprising:

generating, at different points in time, first line drawings representing a first signature, and second line drawings representing a second signature; and

generating a space, a punctuation mark, or a break to separate the first line drawings and the second line drawings.

14. The computer-implemented method of claim 1, further comprising:

acquiring confirmation information from a user;

determining, based on the confirmation information, whether the user approves the at least one line drawing representing the signature; and

saving data representing the at least one line drawing in response to determining that the user approves the at least one line drawing.

15. The computer-implemented method of claim 14, further comprising displaying, in the graphical user interface, before acquiring the confirmation information from the user, the at least one line drawing representing the signature and a message requesting the user to approve the line drawings.

16. The computer-implemented method of claim 1, wherein:

the connecting generates at least two line drawings, and

the connecting further comprises determining a time sequence of the at least two line drawings.

17. A system for generating electronic signatures, comprising:

an imaging device;

a display;

a memory storing instructions; and

a processor in communication with the imaging device, the processor being configured to execute the instructions to;

recognize a signing device in an image taken by the imaging device, wherein the signing device is a finger or a hand;

capture, via the imaging device, the image, the image showing an object;

determine whether the object occupies more than a predetermined percentage of the image;

identify the object as the signing device when it is determined that the object occupies more than a predetermined percentage of the image;

control the imaging device to capture a plurality of image frames showing the signing device;

identify, in the plurality of image frames, pixels matching recognized pixel features of the signing device;

generate a first image including the identified pixels, wherein the first image is a combined image;

connect the identified pixels to form at least one line drawing representing a signature;

detect a change of gesture of the finger or hand;

generate a space, a punctuation mark, or a break in the at least one line drawing representing a signature based on the change of the gesture; and

displaying, on the display, the at least one line drawing representing the signature.

18. A non-transitory computer-readable medium storing instructions executable by a processor to cause the processor to perform operations for generating electronic signatures, the operations comprising:

recognizing a signing device in a first image taken by an imaging device by at least distinguishing the signing device from a surrounding environment based on pixel features of the signing device, wherein the signing device is a finger or a hand and wherein recognizing the signing device further comprises;

capturing, via the imaging device, the first image showing an object;

determining whether the object occupies more than a predetermined percentage of the first image; and

identifying the object as the signing device when it is determined that the object occupies more than the predetermined percentage of the first image;

storing the pixel features of a signing device, wherein the pixel features include shape and color information associated with the signing device;

capturing, via an imaging device, a plurality of image frames including the pixel features of the signing device;

identifying in the plurality of image frames, by a processor, first pixels matching the stored pixel features of the signing device;

generating, by the processor, a first image including the identified pixels; and

connecting, by the processor, the identified pixels to form at least one line drawing representing a signature;

detecting a change of gesture of the finger or hand;

generating a space, a punctuation mark, or a break in the at least one line drawing representing the signature based on the change of the gesture; and

displaying the at least one line drawing representing the signature in a graphical user interface.