Freehand input method, freehand input device, and computer program product

• US 20080019591A1
• Filed: 11/13/2006
• Published: 01/24/2008
• Est. Priority Date: 07/19/2006
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Nakajima, Kenji, Iwayama, Naomi, Akiyama, Katsuhiko
• Granted Patent: US 7,796,818 B2
• Time in Patent Office: Days
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

Execution commands corresponding to the type of gesture are stored and by acquiring coordinate values of accepted handwriting input including gesture on a display screen, handwriting is displayed. When handwriting input is accepted, display data of handwriting is updated. When handwriting input is not completed, it is decided whether or not handwriting input is gesture input. When it is decided that the handwriting input is gesture input, the type of gesture is decided on the basis of the coordinate values of gesture on the display screen, an execution command corresponding to the type of gesture is read and the fact that the handwriting input is gesture input is displayed. When gesture input is completed, the execution command corresponding to gesture input is executed. Therefore, the user can make handwriting input according to the user'"'"'s intent without performing mode switching.

Claims

1. A method for making freehand input using a freehand input device which comprises:

a table for storing execution commands corresponding to the type of gesture therein;

a display unit having a display screen;

a handwriting input unit for accepting handwriting input including gesture input; and

a coordinate value acquisition unit for acquiring coordinate values of the handwriting input accepted by said handwriting input unit; and

displays handwriting corresponding to handwriting input including gesture accepted by said handwriting input, said method comprising the steps of;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not acceptance of handwriting input is completed;

deciding whether or not said handwriting input is gesture input when it is decided that acceptance of handwriting input is not completed;

deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquisition unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying on said display unit the fact that the input is gesture input;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to said gesture input when it is decided that gesture input is completed.

2. The method as set forth in claim 1, further comprising the steps of

deciding whether or not coordinate values acquired by said coordinate value acquisition unit are constant;

deciding whether or not the state where it is decided that the coordinate values are constant continues for a predetermined time when input is decided as gesture input;

changing decision result to the result that the input is not gesture input when it is decided the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing the fact that the input is not gesture input.

3. The method as set forth in claim 1, further comprising the steps of

displaying a predetermined icon in the vicinity of position where gesture was inputted on said display screen of said display unit when the input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that the input is not gesture input when it is decided that the icon displayed on said display screen of said display unit is selected; and

updating display on said display screen of said display unit to display showing the fact that the input is not gesture input.

4. The method as set forth in claim 1, wherein handwriting corresponding to handwriting input decided as gesture is turned on and off on said display screen of said display unit.

5. The method as set forth in claim 4, wherein a cycle of turning on and off of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed depending on the decided type of gesture.

6. The method as set forth in claim 1, wherein handwriting corresponding to handwriting input decided as gesture is displayed on said display screen of said display unit in a color other than the color of the handwriting input decided as non-gesture input.

7. The method as set forth in claim 6, wherein display color of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed depending on the decided type of gesture.

8. The method as set forth in claim 1, wherein text data representing that input is decided as gesture input is displayed in the vicinity of display position of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit.

9. The method as set forth in claim 8, wherein the text data is changed depending on the decided type of gesture.

10. The method as set forth in claim 1, wherein an icon representing that input is decided as gesture input is displayed in the vicinity of display position of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit.

11. The method as set forth in claim 10, wherein said icon is changed depending on the decided type of gesture.

12. The method as set forth in claim 1, wherein a cursor for instructing handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed so as to have different shape of a cursor in the case of the input decided as non-gesture input.

13. The method as set forth in claim 12, wherein pattern of said cursor is changed depending on the decided type of gesture.

14. A freehand input device which comprises:

storing means for storing execution commands corresponding to the type of gesture;

displaying means having a display screen;

freehand inputting means for accepting handwriting input including gesture input; and

coordinate value acquiring means for acquiring coordinate values of handwriting input accepted by said freehand inputting means; and

displays handwriting corresponding to handwriting input including gesture accepted by said freehand inputting means, said device comprising;

first deciding means for deciding whether or not said freehand inputting means is accepting handwriting input;

handwriting display updating means for updating display data of handwriting when said first deciding means decides that said freehand inputting means is accepting handwriting input;

second deciding means for deciding whether or not acceptance of handwriting input is completed;

third deciding means for deciding whether or not the handwriting input is gesture input when said second deciding means decides that acceptance of handwriting input is not completed;

deciding means for deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquiring means when said third deciding means decides the handwriting input is gesture input;

means for reading an execution command corresponding to the type of gesture decided by said deciding means;

gesture decision displaying means for displaying the fact that the handwriting input is gesture input on said display screen of said displaying means thereon; and

fourth deciding means for deciding whether or not gesture input is completed;

wherein the execution command corresponding to the gesture input is executed when said third deciding means decides that gesture input is completed.

15. The freehand input device as set forth in claim 14, further comprising:

coordinate value deciding means for deciding whether or not coordinate values acquired by said coordinate value acquiring means are constant; and

fifth deciding means for deciding whether or-not the state where said coordinate value deciding means decides that the coordinate values are constant continues for a predetermined time when said third deciding means decides that the handwriting input is gesture input;

wherein

said third deciding means changes decision result to the result that the handwriting input is not gesture input when said fifth deciding means decides that the predetermined time is elapsed, and

said gesture decision displaying means updates display on said display screen of said displaying means to display showing that the handwriting input is decided as non-gesture input.

16. The freehand input device as set forth in claim 14, further comprising:

icon displaying means for displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said displaying means when said third deciding means decides that handwriting input is decided as gesture input and said fourth deciding means decides that gesture input is completed; and

sixth deciding means decides whether or not the icon displayed by said icon displaying means is selected;

wherein

said third deciding means changes decision result to the result that handwriting input is not gesture input when said sixth deciding means decides that the icon is selected, and

said gesture decision displaying means updates display on said display screen of said displaying means to display showing that the handwriting input is not gesture input.

17. A freehand input device which comprises:

a table for storing execution commands corresponding to the type of gesture;

a display unit having a display screen;

freehand input unit for accepting handwriting input including gesture input; and

a controller for displaying handwriting corresponding to handwriting input including gesture accepted by said freehand input unit by acquiring coordinate values of handwriting input accepted by said freehand input unit, wherein

said controller further capable of performing the following operations of;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not acceptance of handwriting input is completed;

deciding whether or not said handwriting input is gesture input when it is decided that acceptance of handwriting input is not completed;

deciding the type of gesture on the basis of coordinate values on said display screen when it is decided that said handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed.

18. The freehand input device as set forth in claim 17, wherein said controller further capable of the following operations:

deciding whether or not coordinate values of gesture on said display screen of said display unit are constant;

deciding whether or not the state where coordinate values are constant continues for a predetermined time when it is decided that the handwriting input is gesture input;

changing decision result to the result that handwriting input is not gesture input when it is decided that the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing that the handwriting input is not gesture input.

19. The freehand input device as set forth in claim 17, wherein said controller further capable of the following operations:

displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said display unit when handwriting input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that handwriting input is not gesture input when it is decided that the icon displayed on said display screen of said display unit is selected; and

updating display on said display screen on said display unit to display showing that the handwriting input is not gesture input.

20. A computer program product for controlling a computer which is connected to:

a table for storing execution commands corresponding to the type of gesture;

a display unit having a display screen; and

a freehand input unit for accepting handwriting input including gesture input, and displays handwriting corresponding to handwriting input including gesture accepted by said handwriting input unit by acquiring coordinate values of handwriting input accepted by said handwriting input unit, wherein the computer program product comprises;

a computer readable storage medium having computer readable program code means embodied in the medium, the computer readable program code means comprising computer instruction means for;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not acceptance of handwriting input is completed;

deciding whether or not the handwriting input is gesture input when it is decided that acceptance of handwriting input is not completed;

deciding the type of gesture on the basis of coordinate values on said display screen of said display unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed.

21. The computer program product as set forth in claim 20, the computer readable program code means further comprising computer instruction means for:

deciding whether or not coordinate values of gesture on said display screen of said display unit are constant;

deciding whether or not the state where coordinate values are constant continues for a predetermined time when it is decided that the handwriting input is gesture input;

changing decision result to the result that handwriting input is not gesture input when it is decided that the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing that the handwriting input is not gesture input.

22. The computer program product as set forth in claim 20, the computer readable program code means further comprising computer instruction means for:

displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said display unit when handwriting input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that handwriting input is not gesture input when it is decided that the icon displayed of said display screen of said display unit is selected; and

updating display on said display screen on said display unit to display showing that the handwriting input is not gesture input.