Handwritten data input device and method, and authenticating device and method

• US 6,947,029 B2
• Filed: 08/03/2001
• Issued: 09/20/2005
• Est. Priority Date: 12/27/2000
• Status: Expired due to Fees

• Current Assignee: Cyber SIGN Japan, Inc., NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation), Panasonic Mobile Communications Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Mobile Communications Company Limited (Panasonic Holdings Corporation)
• Inventors: Sugimura, Toshiaki, Katagiri, Masaji, Inaba, Hiroshi, Nakano, Hirotaka, Akasaka, Tsutomu, Yasuda, Toshihiro, Chai, Toshiaki
• Primary Examiner(s): Eisen, Alexander
• Application Number:
  US10/182,602
• Publication Number:
  US 20030001818A1
• Time in Patent Office: 1,509 Days
• Field of Search: 345/156, 345/158, 345/179, 463/36, 178/19.01, 178/19.05, 178/19.07
• US Class Current: 345/158
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/83 input devices, e.g. keyboards, mice or controllers thereof
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/228 of three-dimensional handwriting, e.g. writing in the air
• CPC Class Codes: G06V 40/30 Writer recognition; Reading and verifying signatures
• CPC Class Codes: G07C 9/35 by means of a handwritten signature

Abstract

There are provided a device and method for enabling entry of handwritten data, such as a signature, without use of an electronic tablet. In step S2-1, a user affixes a signature by means of moving a pen device 30 in midair. In step S2-2, camera means 20 photographs the pen device 30 and outputs the resultant image data. In step S2-3, coordinate computation means 22 determines coordinates of a pen tip of the pen means 30 on a screen on the basis of the image data (motion picture data), thereby determining signature data. In step S2-4, comparison verification means 40 compares and verifies the thus-determined signature data with reference data. If a similarity exists between the signature data and the reference data, there is output an authentication result showing “authentication of verification.” Thus, personal identification can be effected on the basis of the signature data written by the user in midair.

Claims

1. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

camera means for acquiring motion picture data pertaining to a pen device moved by the user; and

coordinate computation means which determines time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of motion picture data pertaining to the pen device acquired by the camera means, wherein the coordinate computation means computes coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

2. The handwritten data input apparatus according to claim 1, wherein the coordinate computation means determines the pen device to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

3. The handwritten data input apparatus according to claim 1, wherein the coordinate computation means informs the user of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and informs the user of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

4. The handwritten data input apparatus according to claim 3, wherein the coordinate computation means informs the user of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

5. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

camera means for acquiring motion picture data pertaining to a pen device moved by the user; and

coordinate computation means which determines time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of motion picture data pertaining to the pen device acquired by the camera means, wherein the coordinate computation means recognizes a start time and end time of computation of handwritten data by means of external sounds.

6. The handwritten data input apparatus according to claim 5, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

7. A handwritten data input method by which handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

an acquisition step of acquiring motion picture data pertaining to a pen device moved by the user; and

a coordinate computation step of determining time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of the acquired motion picture data pertaining to the pen device, wherein there are computed, in the coordinate computation step, coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

8. The handwritten data input method according to claim 7, wherein, in the coordinate computation step, the pen device is determined to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

9. The handwritten data input method according to claim 7, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and is informed of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

10. The handwritten data input method according to claim 9, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

11. A handwritten data input method by which handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

an acquisition step of acquiring motion picture data pertaining to a pen device moved by the user; and

a coordinate computation step of determining time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of the acquired motion picture data pertaining to the pen device, wherein, in the coordinate computation step, a start time and end time of computation of handwritten data are recognized by means of external sounds.

12. The handwritten data input method according to claim 11, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

13. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

first camera means for acquiring first motion picture data pertaining to the pen device moved by the user;

second camera means for acquiring second motion picture data pertaining to the pen device from an angle different from that of the first camera means; and

coordinate computation means for determining three-dimensional coordinates of the pen device in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series data pertaining to the coordinates, wherein the coordinate computation means computes coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

14. The handwritten data input apparatus according to claim 13, wherein the coordinate computation means determines the pen device to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

15. The handwritten data input apparatus according to claim 13, wherein the coordinate computation means informs the user of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and informs the user of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

16. The handwritten data input apparatus according to claim 15, wherein the coordinate computation means informs the user of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

17. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

first camera means for acquiring first motion picture data pertaining to the pen device moved by the user;

second camera means for acquiring second motion picture data pertaining to the pen device from an angle different from that of the first camera means; and

coordinate computation means for determining three-dimensional coordinates of the pen device in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series data pertaining to the coordinates, wherein the coordinate computation means recognizes a start time and end time of computation of handwritten data by means of external sounds.

18. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

first camera means for acquiring first motion picture data pertaining to the pen device moved by the user;

second camera means for acquiring second motion picture data pertaining to the pen device from an angle different from that of the first camera means; and

coordinate computation means for determining three-dimensional coordinates of the pen device in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series data pertaining to the coordinates, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

19. A handwritten data input method by which

handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

a first acquisition step of acquiring first motion picture data pertaining to a pen device moved by the user from a first angle;

a second acquisition step of acquiring second motion picture data pertaining to a pen device moved by the user from a second angle different from the first angle; and

a coordinate computation step of determining three-dimensional coordinates of the pen device on the basis of the acquired sets of first and second motion picture data pertaining to the pen device and determining time-series data pertaining to the coordinates, wherein, in the coordinate computation step, coordinates of the pen device on the screen are computed from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

20. The handwritten data input method according to claim 19, wherein, in the coordinate computation step, the pen device is determined to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

21. The handwritten data input method according to claim 19, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and is informed of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

22. The handwritten data input method according to claim 21, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

23. A handwritten data input method by which

handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

a first acquisition step of acquiring first motion picture data pertaining to a pen device moved by the user from a first angle;

a second acquisition step of acquiring second motion picture data pertaining to a pen device moved by the user from a second angle different from the first angle; and

a coordinate computation step of determining three-dimensional coordinates of the pen device on the basis of the acquired sets of first and second motion picture data pertaining to the pen device and determining time-series data pertaining to the coordinates, wherein, in the coordinate computation step, a start time and an end time of computation of handwritten data are recognized by means of external sounds.

24. A handwritten data input method by which

handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

a first acquisition step of acquiring first motion picture data pertaining to a pen device moved by the user from a first angle;

a second acquisition step of acquiring second motion picture data pertaining to a pen device moved by the user from a second angle different from the first angle; and

a coordinate computation step of determining three-dimensional coordinates of the pen device on the basis of the acquired sets of first and second motion picture data pertaining to the pen device and determining time-series data pertaining to the coordinates, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.