Freehand input method, freehand input device, and computer program product

• US 7,796,818 B2
• Filed: 11/13/2006
• Issued: 09/14/2010
• Est. Priority Date: 07/19/2006
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Akiyama, Katsuhiko, Nakajima, Kenji, Iwayama, Naomi
• Primary Examiner(s): Ahmed; Samir A.
• Assistant Examiner(s): Li; Ruiping
• Application Number:
  US11/595,885
• Publication Number:
  US 20080019591A1
• Time in Patent Office: 1,401 Days
• Field of Search: 382/382, 382/189, 382/186, 382/187
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/36 Matching; Classification

Abstract

Execution commands corresponding to the type of gesture are stored and by acquiring coordinate values of accepted handwriting input including gesture on a display screen, handwriting is displayed. When handwriting input is accepted, display data of handwriting is updated. When handwriting input is not completed, it is decided whether or not handwriting input is gesture input. When it is decided that the handwriting input is gesture input, the type of gesture is decided on the basis of the coordinate values of gesture on the display screen, an execution command corresponding to the type of gesture is read and the fact that the handwriting input is gesture input is displayed. When gesture input is completed, the execution command corresponding to gesture input is executed. Therefore, the user can make handwriting input according to the user'"'"'s intent without performing mode switching.

Claims

1. A method for making a program cause a computer to function as a handwriting input device which comprises:

a table for storing execution commands corresponding to types of gestures therein;

a display unit having a display screen;

a handwriting input unit for accepting handwriting input including gesture input; and

a coordinate value acquisition unit for acquiring coordinate values of the handwriting input accepted by said handwriting input unit, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said handwriting input, said method comprising the steps of;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not said handwriting input is gesture input when it is decided that the accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input unit is completed;

deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquisition unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying on said display unit the fact that the input is gesture input;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to said gesture input when it is decided that gesture input is completed;

deciding whether or not coordinate values acquired by said coordinate value acquisition unit are constant;

deciding whether or not the state where it is decided that the coordinate values keep constant for a predetermined time when input is decided as gesture input;

changing decision result to the result that the input is not gesture input when it is decided the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing the fact that the input is not gesture input.

3. The method as set forth in claim 1, wherein handwriting displayed corresponding to handwriting input on said display screen of said display unit is blinked.

4. The method as set forth in claim 3, wherein a blinking cycle of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed depending on the decided type of gesture.

5. The method as set forth in claim 1, wherein handwriting corresponding to handwriting input decided as gesture is displayed on said display screen of said display unit in a color other than the color of the handwriting input decided as non-gesture input.

6. The method as set forth in claim 5, wherein display color of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed depending on the decided type of gesture.

7. The method as set forth in claim 1, wherein text data representing that input is decided as gesture input is displayed in the vicinity of display position of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit.

8. The method as set forth in claim 7, wherein the text data is changed depending on the decided type of gesture.

9. The method as set forth in claim 1, wherein an icon representing that input is decided as gesture input is displayed in the vicinity of display position of handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit.

10. The method as set forth in claim 9, wherein said icon is changed depending on the decided type of gesture.

2. A method for making a program cause a computer to function as a handwriting input device which comprises:

a table for storing execution commands corresponding to types of gestures therein;

a display unit having a display screen;

a handwriting input unit for accepting handwriting input including gesture input; and

a coordinate value acquisition unit for acquiring coordinate values of the handwriting input accepted by said handwriting input unit, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said handwriting input, said method comprising the steps of;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not said handwriting input is gesture input when it is decided that the accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input unit is completed;

deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquisition unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying on said display unit the fact that the input is gesture input;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to said gesture input when it is decided that gesture input is completed;

displaying a predetermined icon in the vicinity of position where gesture was inputted on said display screen of said display unit when the input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that the input is not gesture input when it is decided that the icon displayed on said display screen of said display unit is selected; and

updating display on said display screen of said display unit to display showing the fact that the input is not gesture input.

11. A method for making a program cause a computer to function as a handwriting- input device which comprises:

a table for storing execution commands corresponding to types of gestures therein;

a display unit having a display screen;

a handwriting input unit for accepting handwriting input including gesture input; and

a coordinate value acquisition unit for acquiring coordinate values of the handwriting input accepted by said handwriting input unit, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said handwriting input, said method comprising the steps of;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not said handwriting input is gesture input when it is decided that the accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input unit is completed;

deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquisition unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying on said display unit the fact that the input is gesture input;

deciding whether or not gesture input is completed; and

executing the execution command corresponding to said gesture input when it is decided that gesture input is completed;

wherein a cursor for instructing handwriting corresponding to handwriting input decided as gesture on said display screen of said display unit is changed so as to have different shape of a cursor in the case of the input decided as non-gesture input.

12. The method as set forth in claim 11, wherein pattern of said cursor is changed depending on the decided type of gesture.

13. A freehand input device which comprises:

storing means for storing execution commands corresponding to types of gestures;

displaying means having a display screen;

freehand inputting means for accepting handwriting input including gesture input; and

coordinate value acquiring means for acquiring coordinate values of handwriting input accepted by said freehand inputting means, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said freehand inputting means, said device comprising;

first deciding means for deciding whether or not said freehand inputting means is accepting handwriting input;

handwriting display updating means for updating display data of handwriting when said first deciding means decides that said freehand inputting means is accepting handwriting input;

second deciding means for deciding whether or not the handwriting input is gesture input when it is decided that accepting of handwriting input is said handwriting input is not completed;

third deciding means for deciding whether or not the accepting of handwriting input in said handwriting input is completed;

deciding means for deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquiring means when said third deciding means decides the handwriting input is gesture input;

means for reading an execution command corresponding to the type of gesture decided by said deciding means;

gesture decision displaying means for displaying the fact that the handwriting input is gesture input on said display screen of said displaying means thereon;

fourth deciding means for deciding whether or not gesture input is completed;

coordinate value deciding means for deciding whether or not coordinate values acquired by said coordinated value acquiring means are constant; and

fifth deciding means for deciding whether or not the state where said coordinate value deciding means decides that the coordinate values keep constant for a predetermined time when said second deciding means decides that the handwriting input is gesture input;

wherein

the execution command corresponding to the gesture input is executed when said second deciding means decides that gesture input is completed,

said second deciding means changes decision result to the result that the handwriting input is not gesture input when said fifth deciding means decides that the predetermined time is elapsed, and

said gesture decision displaying means updates display on said display screen of said displaying means to display showing that the handwriting input is decided as non-gesture input.

14. A freehand input device which comprises:

storing means for storing execution commands corresponding to types of gestures;

displaying means having a display screen;

freehand inputting means for accepting handwriting input including gesture input; and

coordinate value acquiring means for acquiring coordinate values of handwriting input accepted by said freehand inputting means, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said freehand inputting means, said device comprising;

first deciding means for deciding whether or not said freehand inputting means is accepting handwriting input;

handwriting display updating means for updating display data of handwriting when said first deciding means decides that said freehand inputting means is accepting handwriting input;

second deciding means for deciding whether or not the handwriting input is gesture input when it is decided that accepting of handwriting input is said handwriting input is not completed;

third deciding means for deciding whether or not the accepting of handwriting input in said handwriting input is completed;

deciding means for deciding the type of gesture on the basis of the coordinate values acquired by said coordinate value acquiring means when said third deciding means decides the handwriting input is gesture input;

means for reading an execution command corresponding to the type of gesture decided by said deciding means;

gesture decision displaying means for displaying the fact that the handwriting input is gesture input on said display screen of said displaying means thereon;

fourth deciding means for deciding whether or not gesture input is completed;

wherein

the execution command corresponding to the gesture input is executed when said- second deciding means decides that gesture input is completed;

icon displaying means for displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said displaying means when said third deciding means decides that handwriting input is decided as gesture input and said fourth deciding means decides that gesture input is completed; and

sixth deciding means decides whether or not the icon displayed by said icon displaying means is selected;

wherein said third deciding means changes decision result to the result that handwriting input is not gesture input when said sixth deciding means decides that the icon is selected, and

said gesture decision displaying means updates display on said display screen of said displaying means to display showing that the handwriting input is not gesture input.

15. A freehand input device which comprises:

a table for storing execution commands corresponding to types of gestures;

a display unit having a display screen;

a freehand input unit for accepting handwriting input including gesture input; and

a controller for displaying handwriting corresponding to handwriting input including the gesture accepted by said freehand input unit by acquiring coordinate values of handwriting input accepted by said freehand input unit, wherein

said controller further capable of performing the following operations of,

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not said handwriting input is gesture input when it is decided that accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input is completed;

deciding the type of gesture on the basis of coordinate values on said display screen when it is decided that said handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed;

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed;

deciding whether or not coordinated values of gesture on said display screen of said display unit are constant;

deciding whether or not the state where coordinate value keep constant for a predetermined time when it is decided that the handwriting input is gesture input;

changing decision result to the result that handwriting input is not gesture input when it is decided that the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing that the handwriting input is not gesture input.

16. A freehand input device which comprises:

a table for storing execution commands corresponding to types of gestures;

a display unit having a display screen;

a freehand input unit for accepting handwriting input including gesture input; and

a controller for displaying handwriting corresponding to handwriting input including the gesture accepted by said freehand input unit by acquiring coordinate values of handwriting input accepted by said freehand input unit, wherein

said controller further capable of performing the following operations of,

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not said handwriting input is gesture input when it is decided that accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input is completed;

deciding the type of gesture on the basis of coordinate values on said display screen when it is decided that said handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed;

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed;

wherein said controller is further capable of the following operations;

displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said display unit when handwriting input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that handwriting input is not gesture input when it is decided that the icon displayed on said display screen of said display unit is selected; and

updating display on said display screen on said display unit to display showing that the handwriting input is not gesture input.

17. A computer program product for controlling a computer which is connected to:

a table for storing execution commands corresponding to types of gestures;

a display unit having a display screen; and

a freehand input unit for accepting handwriting input including gesture input, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said handwriting input unit by acquiring coordinate values of handwriting input accepted by said handwriting input unit, said computer program product comprises;

a non-transirory computer readable storage medium having computer readable program code means embodied in the medium, the computer readable program code means comprising computer instruction means for;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not the handwriting input is gesture input when it is decided that the accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input unit is completed;

deciding the type of gesture on the basis of coordinate values on said display screen of said display unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed;

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed;

deciding whether or not coordinate values of gesture on said display screen of said display unit are constant;

deciding whether or not the state where coordinated values keep constant for a predetermined time when it is decided that the handwriting input is gesture unput;

changing decision result to the result that handwriting input is not gesture input when it is decided that the predetermined time is elapsed; and

updating display on said display screen of said display unit to display showing that the handwriting input is not gesture input.

18. A computer program product for controlling a computer which is connected to:

a table for storing execution commands corresponding to types of gestures;

a display unit having a display screen; and

a freehand input unit for accepting handwriting input including gesture input, wherein the display unit displays handwriting corresponding to handwriting input including the gesture accepted by said handwriting input unit by acquiring coordinate values of handwriting input accepted by said handwriting input unit, said computer program product comprises;

a non-transirory computer readable storage medium having computer readable program code means embodied in the medium, the computer readable program code means comprising computer instruction means for;

deciding whether or not said handwriting input unit is accepting handwriting input;

updating display data of handwriting when it is decided that said handwriting input unit is accepting handwriting input;

deciding whether or not the handwriting input is gesture input when it is decided that the accepting of handwriting input in said handwriting input unit is not completed;

deciding whether or not the accepting of handwriting input in said handwriting input unit is completed;

deciding the type of gesture on the basis of coordinate values on said display screen of said display unit when it is decided that the handwriting input is gesture input;

reading an execution command corresponding to the decided type of gesture from said table;

displaying the fact that the handwriting input is gesture input on said display screen of said display unit;

deciding whether or not gesture input is completed;

executing the execution command corresponding to the gesture input when it is decided that gesture input is completed;

displaying a predetermined icon in the vicinity of position where gesture is inputted on said display screen of said display unit when handwriting input is decided as gesture input and it is decided that gesture input is completed;

deciding whether or not the icon displayed on said display screen of said display unit is selected;

changing decision result to the result that handwriting input is not gesture input when it is decided that the icon displayed of said display screen of said display unit is selected; and

updating display on said display screen on said display unit to display showing that the handwriting input is not gesture input.