Handwritten data input device and method, and authenticating device and method

• US 20030001818A1
• Filed: 07/31/2002
• Published: 01/02/2003
• Est. Priority Date: 12/27/2000
• Status: Active Grant

• Current Assignee: Cyber SIGN Japan, Inc., NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation), Panasonic Mobile Communications Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Mobile Communications Company Limited (Panasonic Holdings Corporation)
• Inventors: Katagiri, Masaji, Nakano, Hirotaka, Akasaka, Tsutomu, Yasuda, Toshihiro, Chai, Toshiaki, Sugimura, Toshiaki, Inaba, Hiroshi
• Granted Patent: US 6,947,029 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/83 input devices, e.g. keyboards, mice or controllers thereof
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/228 of three-dimensional handwriting, e.g. writing in the air
• CPC Class Codes: G06V 40/30 Writer recognition; Reading and verifying signatures
• CPC Class Codes: G07C 9/35 by means of a handwritten signature

Abstract

There are provided a device and method for enabling entry of handwritten data, such as a signature, without use of an electronic tablet. In step S2-1, a user affixes a signature by means of moving a pen device 30 in midair. In step S2-2, camera means 20 photographs the pen device 30 and outputs the resultant image data. In step S2-3, coordinate computation means 22 determines coordinates of a pen tip of the pen means 30 on a screen on the basis of the image data (motion picture data), thereby determining signature data. In step S2-4, comparison verification means 40 compares and verifies the thus-determined signature data with reference data. If a similarity exists between the signature data and the reference data, there is output an authentication result showing “authentication of verification.” Thus, personal identification can be effected on the basis of the signature data written by the user in midair.

Claims

1. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

camera means for acquiring motion picture data pertaining to a pen device moved by the user; and

coordinate computation means which determines time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of motion picture data pertaining to the pen device acquired by the camera means.

2. The handwritten data input apparatus according to claim 1, wherein the pen device has illumination means, and the coordinate computation means computes coordinates of the illumination means on the screen.

3. The handwritten data input apparatus according to claim 2, wherein the illumination means of the pen device is switchable between an illuminated state and extinguished state, and the coordinate computation means computes coordinates of the illumination means on the screen from when the illumination has entered an illuminated state until the illumination means enters an extinguished state.

4. The handwritten data input apparatus according to claim 1, wherein the coordinate computation means computes coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

5. The handwritten data input apparatus according to claim 4, wherein the coordinate computation means determines the pen device to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

6. The handwritten data input apparatus according to claim 4, wherein the coordinate computation means informs the user of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and informs the user of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

7. The handwritten data input apparatus according to claim 6, wherein the coordinate computation means informs the user of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

8. The handwritten data input apparatus according to claim 1, wherein the coordinate computation means recognizes a start time and end time of computation of handwritten data by means of external sounds.

9. The handwritten data input apparatus according to claim 8, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

10. The handwritten data input apparatus according to claim 1, further comprising display means for displaying the time-series data pertaining to coordinates.

11. A personal identification apparatus equipped with the handwritten data input apparatus defined in any one of claims 1 through 10, the personal identification apparatus comprising:

storage means in which are stored beforehand reference data serving as signature data pertaining to an authorized person; and

comparison verification means which verifies the user'"'"'s signature data input as handwritten data by the handwritten data input apparatus against the reference data and outputs authentication of identification when the handwritten data and the signature data are determined to be a signature affixed by the same person.

13. The handwritten data input method according to claim 12, wherein the pen device has illumination means, and coordinates of the illumination means on the screen are computed in the coordinate computation step.

14. The handwritten data input method according to claim 13, wherein the illumination means of the pen device is switchable between an illuminated state and an extinguished state, and, in the coordinate computation step, coordinates of the illumination means on the screen are computed from when the illumination has entered an illuminated state until the illumination means enters an extinguished state.

15. The handwritten data input method according to claim 12, wherein there are computed, in the coordinate computation step, coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

16. The handwritten data input method according to claim 15, wherein, in the coordinate computation step, the pen device is determined to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

17. The handwritten data input method according to claim 15, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and is informed of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

18. The handwritten data input method according to claim 17, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

19. The handwritten data input method according to claim 12, wherein, in the coordinate computation step, a start time and end time of computation of handwritten data are recognized by means of external sounds.

20. The handwritten data input method according to claim 19, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

27. The handwritten data input apparatus according to claim 2, wherein the illumination means emits modulated light, and the coordinate computation means computes coordinates of a portion of the motion picture data corresponding to the modulated light.

28. The handwritten data input method according to claim 13, wherein the illumination means emits modulated light, and the coordinate computation means computes coordinates of a portion of the motion picture data corresponding to the modulated light.

38. The handwritten data input apparatus according to claim 1, further comprising display means for displaying the time-series data pertaining to coordinates.

12. A handwritten data input method by which handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

an acquisition step of acquiring motion picture data pertaining to a pen device moved by the user; and

a coordinate computation step of determining time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of the acquired motion picture data pertaining to the pen device.

21. A personal identification method including the handwritten data input method defined in any one of claims 12 through 20, the personal identification method comprising:

a comparison verification step in which the user'"'"'s signature data input as handwritten data by the handwritten data input apparatus are verified against and compared with the reference data which are stored beforehand and serve as signature data pertaining to an authorized user, and there is output authentication of identification when the handwritten data and the signature data are determined to be a signature affixed by the same person.

22. A handwritten data input apparatus which acquires handwritten data written on a midair plane parallel to the surface of a predetermined flat plate by means of a user moving a pen device along the surface of the flat plate, the apparatus comprising:

camera means for acquiring motion picture data pertaining to a pen device moved by the user; and

coordinate computation means which determines time-series data pertaining to coordinates of a pen tip on a screen of the motion picture data, on the basis of motion picture data pertaining to the pen device acquired by the camera means.

24. The handwritten data input apparatus according to claim 23, wherein the finger is provided with a marker, and the coordinate computation means determines time-series data pertaining to coordinates of the marker of the finger.

32. The handwritten data input apparatus according to claim 29, wherein the coordinate computation means computes coordinates of the pen device on the screen from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

33. The handwritten data input apparatus according to claim 32, wherein the coordinate computation means determines the pen device to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

34. The handwritten data input apparatus according to claim 32, wherein the coordinate computation means informs the user of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and informs the user of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

35. The handwritten data input apparatus according to claim 34, wherein the coordinate computation means informs the user of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

36. The handwritten data input apparatus according to claim 29, wherein the coordinate computation means recognizes a start time and end time of computation of handwritten data by means of external sounds.

37. The handwritten data input apparatus according to claim 29, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

23. A handwritten data input apparatus for acquiring handwritten data written in midair by means of a user moving a finger in midair, comprising:

camera means for acquiring motion picture data pertaining to the finger moved by the user; and

coordinate computation means for determining time-series data pertaining to coordinates of the finger on a screen of the motion picture data, on the basis of the motion picture data pertaining to the finger acquired by the camera means.

25. A handwritten data input method for acquiring handwritten data written in midair by means of a user moving a finger in midair, comprising:

an acquisition step of acquiring motion picture data pertaining to the finger moved by the user; and

a coordinate computation step of determining time-series data pertaining to coordinates of the finger on a screen of the motion picture data, on the basis of the acquired motion picture data pertaining to the finger.

26. The handwritten data input method according to claim 25, wherein the finger is provided with a marker, and, in the coordinate computation step, time-series data pertaining to coordinates of the marker of the finger are determined.

29. A handwritten data input apparatus which acquires handwritten data written in midair by means of a user moving a pen device in midair, the apparatus comprising:

first camera means for acquiring first motion picture data pertaining to the pen device moved by the user;

second camera means for acquiring second motion picture data pertaining to the pen device from an angle different from that of the first camera means; and

coordinate computation means for determining three-dimensional coordinates of the pen device in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series data pertaining to the coordinates.

30. The handwritten data input apparatus according to claim 29, wherein the pen device has illumination means, and the coordinate computation means computes coordinates of the illumination means on the screen.

31. The handwritten data input apparatus according to claim 30, wherein the illumination means of the pen device is switchable between an illuminated state and extinguished state, and the coordinate computation means computes coordinates of the illumination means on the screen from when the illumination has entered an illuminated state until the illumination means enters an extinguished state.

39. A personal identification apparatus equipped with the handwritten data input apparatus defined in any one of claims 29 through 38, the personal identification apparatus comprising:

storage means in which are stored beforehand reference data serving as signature data pertaining to an authorized person; and

comparison verification means which verifies the user'"'"'s signature data input as handwritten data by the handwritten data input apparatus against the reference data by means of comparison and outputs authentication of identification when the handwritten data and the signature data are determined to be a signature affixed by the same person.

54. The handwritten data input apparatus according to claim 30, wherein the illumination means emits modulated light, and the coordinate computation means computes coordinates of a portion of the motion picture data corresponding to the modulated light.

40. A handwritten data input method by which handwritten data written in midair are acquired by means of a user moving a pen device in midair, the method comprising:

a first acquisition step of acquiring first motion picture data pertaining to a pen device moved by the user from a first angle;

a second acquisition step of acquiring second motion picture data pertaining to a pen device moved by the user from a second angle different from the first angle; and

a coordinate computation step of determining three-dimensional coordinates of the pen device on the basis of the acquired sets of first and second motion picture data pertaining to the pen device and determining time-series data pertaining to the coordinates.

41. The handwritten data input method according to claim 40, wherein the pen device has illumination means, and coordinates of the illumination means on the screen are computed in the coordinate computation step.

42. The handwritten data input method according to claim 41, wherein the illumination means of the pen device is switchable between an illuminated state and extinguished state, and, in the coordinate computation step, coordinates of the illumination means on the screen are computed from when the illumination has entered an illuminated state until the illumination means enters an extinguished state.

43. The handwritten data input method according to claim 40, wherein, in the coordinate computation step, coordinates of the pen device on the screen are computed from a start time in which the pen device has started moving on the screen from a stationary state longer than a predetermined first period until a stop time in which the pen device stops moving as a result of having entered a stationary state longer than a predetermined second period.

44. The handwritten data input method according to claim 43, wherein, in the coordinate computation step, the pen device is determined to be at rest when a change in coordinates of the pen device is smaller than a predetermined level.

45. The handwritten data input method according to claim 43, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data when the pen device is determined to be at rest for a period longer than the first period and is informed of termination of input of handwritten data when the pen device is determined to be at rest for a period longer than the second period.

46. The handwritten data input method according to claim 45, wherein, in the coordinate computation step, the user is informed of commencement of input of handwritten data by means of sound or informs termination of input of handwritten data by means of sound.

47. The handwritten data input method according to claim 40, wherein, in the coordinate computation step, a start time and an end time of computation of handwritten data are recognized by means of external sounds.

48. The handwritten data input method according to claim 40, wherein the sounds are the voice of the user or sounds of a pen switch provided on the pen device.

49. A personal identification method including the handwritten data input method defined in any one of claims 40 through 48, the personal identification method comprising:

a comparison verification step in which the user'"'"'s signature data input as handwritten data by the handwritten data input apparatus are verified against and compared with the reference data which are stored beforehand and serve as signature data pertaining to an authorized user, and authentication of identification is output when the handwritten data and the signature data are determined to be a signature affixed by the same person.

55. The handwritten data input method according to claim 41, wherein the illumination means emits modulated light, and, in the coordinate computation step, coordinates of a portion of the motion picture data corresponding to the modulated light are computed.

50. A handwritten data input apparatus for acquiring handwritten data written in midair by means of a user moving a finger in midair, comprising:

first camera means for acquiring first motion picture data pertaining to the finger moved by the user;

second camera means for acquiring second motion picture data pertaining to the finger from an angle different from that of the first camera means; and

coordinate computation means for determining three-dimensional coordinates of the finger in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series data pertaining to the coordinates.

51. The handwritten data input apparatus according to claim 50, wherein the finger is provided with a marker, and the coordinate computation means determines time-series data pertaining to coordinates of the marker of the finger.

52. A handwritten data input method for acquiring handwritten data written in midair by means of a user moving a finger in midair, comprising:

a first acquisition step of acquiring first motion picture data pertaining to the finger moved by the user;

a second acquisition step of acquiring second motion picture data pertaining to the finger from an angle different from that employed in the first acquisition step; and

a coordinate computation step of determining three-dimensional coordinates of the finger in three-dimensional space on the basis of the sets of first and second motion picture data and determining time-series coordinate pertaining to the coordinates.

53. The handwritten data input method according to claim 52, wherein the finger is provided with a marker, and, in the coordinate computation step, time-series data pertaining to coordinates of the marker of the finger are determined.