Automatic information input program

• US 7,441,181 B2
• Filed: 02/05/2003
• Issued: 10/21/2008
• Est. Priority Date: 03/29/2002
• Status: Expired due to Fees

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Yamada, Shigefumi, Suzuki, Shoji, Mochizuki, Makoto, Shinzaki, Takashi, Matsuda, Takahiro, Ikegami, Jun
• Primary Examiner(s): Hong; Stephen
• Assistant Examiner(s): Patel; Manglesh M
• Application Number:
  US10/358,253
• Publication Number:
  US 20030184589A1
• Time in Patent Office: 2,085 Days
• Field of Search: 715/507, 715/505, 715/506, 715/508, 715221-225, 715/226, 715/234, 715/811, 395/147
• US Class Current: 715/226
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 2221/2115 Third party
• CPC Class Codes: G06F 40/174 Form filling; Merging

Abstract

When predetermined information is input into an input field and an OK button is pressed on a user authentication screen displayed on a monitor screen by a browser at entry time, the input predetermined information, the input predetermined information, the positional information about the input field and the OK button, and the identification information on the user authentication screen are obtained by the input unit and entered in an external storage device through a storage unit. When the authentication screen detection unit detects the user authentication screen by the authentication screen detection unit at input time, the input/press unit automatically inputs the predetermined information read from the external storage device into the position of the input field obtained according to the positional information read from the external storage device through the storage unit, and the position of the OK button is automatically pressed.

Claims

1. A computer-readable medium storing an automatic information input program for directing a computer to perform a process of automatically inputting predetermined information into a moveable input field on an input window for input of predetermined information on an input window displayed on a monitor screen in an application, comprising:

at an entry time,

an information entering process of entering the predetermined information, and

an input position entering process of entering initial positional information about the moveable input field on the input window corresponding to a position of the moveable input field displayed on the monitor screen; and

at an input time,

a personal authentication process of performing personal authentication based upon biometric information,

an automatic inputting process of automatically inputting the predetermined information when the personal authentication is valid,

said automatic inputting process comprising;

an input position detecting process of detecting the position of the moveable input field on the input window displayed on the monitor screen based on the initial positional information entered in the input position entering process,

an information input process of automatically inputting the predetermined information entered in the information entering process into the moveable input field detected in the input position detecting process,

an input success/failure detecting process of detecting whether an automatic input of the predetermined information into the moveable input field has been successfully performed;

a search area setting process of setting a predetermined search area on the monitor screen when a failure has been detected in the input success/failure detecting process; and

a trial process of automatically inputting the predetermined information by moving a position of the search area set in the search area selling process.

2. The computer readable medium according to claim 1, wherein

said computer can further perform:

at the entry time,

a button position entering process of entering initial positional information of a button corresponding to the moveable input field, the initial positional information of the button corresponding to a position of the button on the monitor screen; and

at the input time,

a button position specifying process of specifying the position of the button on the monitor screen, based on the initial positional information entered in the button position entering process, and

a pressing process of automatically pressing the button in the position specified in the button position specifying process.

3. The computer readable medium according to claim 1, wherein

said computer can further perform:

at the entry time,

an identification information obtaining process of obtaining identification information for specification of the application displaying the moveable input field from the application, and

an identification information entering process of entering the identification information obtained in the identification information obtaining process; and

at the input time,

a display detecting process of monitoring a screen displayed on the monitor screen and detecting that the screen is displayed by the application holding the identification information entered in the identification information entering process.

4. The computer readable medium according to claim 1, wherein said computer can perform:

an entering process of entering as the position of the moveable input field on the monitor screen, the position specified by a pointing device as an input position in the input position entering process; and

an entering process of entering as the position of the button the position pressed by the pointing device in the button position entering process.

5. The computer readable medium according to claim 1, wherein the computer can perform:

at the entry time,

a size entering process of entering the size information about a screen displayed on the monitor screen; and

at input time,

a screen size changing process of automatically changing the size of the screen being displayed into the size at size entry time according to the size information about the screen entered in the size entering process when the size of the screen being displayed on the monitor screen is different from the size at size entry time of the screen.

6. The computer readable medium according to claim 5, wherein the computer can further perform a screen size restoring process of restoring the size of the screen whose size has been changed in the screen size changing process into the originally displayed screen size after automatically inputting the predetermined information and/or automatically pressing the button.

7. The computer readable medium according to claim 1, wherein said computer can further perform:

at the entry time,

a font information entering process of entering the size information and the type information about a character font used on the window of the monitor screen; and

at the input time,

a font changing process of changing the size and/or type of the font used on a screen being displayed into the size and/or type of the entered font when the size and/or type of the font used on the screen being displayed on the monitor screen is different from the size and/or type of the font at entry time.

8. The computer readable medium according to claim 7, wherein said computer can further perform a font restoring process of restoring the size and/or type of a font on the screen changed in the font changing process into the size and/or type of the font on the originally displayed screen after an automatic input of the predetermined information and/or an automatic press of the button.

9. The computer readable medium according to claim 1, wherein said computer can perform:

at the entry time,

an application information obtaining process of obtaining initial positional information corresponding to the position of the moveable input field and/or a button on the monitor screen for the type and/or version of the application displaying the moveable input field and/or the button, and

an application information entering process of entering the initial positional information corresponding to the position of the moveable input field and/or the button on the monitor screen for the type and/or version of the application according to obtained in the application information obtaining process; and

at the input time,

a position computing process of computing the position, on the monitor screen, of the moveable input field and/or the button in the application of a different type and/or version according to difference information entered in advance for the difference on the monitor screen display between the types and/or versions of the applications, when the type and/or version of the application displaying the moveable input field and/or button on the monitor screen is different from the type and/or version of the application displaying the button.

10. The computer readable medium according to claim 1, wherein said computer can perform:

at the entry time,

another display presence/absence entering process of entering the presence/absence of another display as to whether there is a display of a button indicating the function specific to an application and/or a display of a small window belonging to an application for the position of the moveable input field and/or button displayed on the monitor screen, and

another display difference information entering process of entering the difference information corresponding to the presence/absence of another display for the position of the moveable input field and/or button on the monitor screen; and

at the input time,

a position computing process of computing the display position, on the monitor screen, of the moveable input field and/or the button being displayed in the application according to the difference information entered in the other display difference information entering process when the presence/absence of the other display in the application displaying the moveable input field and/or button on the monitor screen is different from the presence/absence of the other display entered at entry time.

11. The computer readable medium according to claim 1, wherein said computer can further perform at an input time:

a trial frequency control process of performing control such that the movement of the position in the search area and the automatic input of the predetermined information and/or the automatic press of the button are tries until a predetermined result can be obtained if the automatic input of the predetermined information and/or the automatic press of the button has failed in the trial process.

12. The computer readable medium according to claim 11, wherein said computer can further perform:

at the input time,

a rule entering process of entering a predetermined rule specifying a different search area; and

a repeating process of repeating the trial process under the control of the trial frequency control process while moving the position from a reference position specified according to the rule entered in the rule entering process if the automatic input of the predetermined information into the moveable input field and/or the automatic press of the button has failed in the trial process under the trial frequency control process in the search area set in the search area setting process.

22. The computer readable medium according to claim 1, wherein:

said computer can perform;

a file information entering process of entering in advance file information about markup language for generation of a window as the identification information for designation of the input window on the monitor screen for display of the moveable input field;

at the input time,

a file information obtaining process of obtaining the file information about the window displayed on the monitor screen,

a comparing process of comparing the file information obtained in the file information obtaining process with the file information entered in the file information entering process, and

an execution control process of controlling the predetermined information to be automatically input and/or a button to be automatically pressed on the window when the file information match in the comparing process.

25. The computer readable medium according to claim 1, wherein said computer can perform:

an additional information adding process of adding predetermined additional information in a predetermined description position in a file described in the markup language on the screen displaying the moveable input field and/or the button on the monitor screen; and

at the input time,

a discriminating process of discriminating whether predetermined additional information is additionally described in a predetermined description position in a markup language on the window displayed on the monitor screen, and

an execution control process of controlling the predetermined information to be automatically input and/or the button to be automatically pressed on the window when predetermined additional information is discriminated in the discriminating process.

28. The computer readable medium according to claim 1, wherein said computer can perform:

a process of automatically inputting into the moveable input field an ID or a password, or both of them as the predetermined information.

31. The computer readable medium according to claim 1, wherein said window on the monitor screen can be a window of a Web page relating to an electronic transaction, and the predetermined information can be necessary information for purchase of merchandise in the electronic transaction.

33. The computer readable medium according to claim 1, wherein said moveable input field can be an information input field of a Web page, an information input field of mail software, a dialog box activated as another screen by a browser, or a similar information input field.

36. The computer readable medium according to claim 1, wherein said application with said moveable input field cannot be changed.

13. A computer-readable medium storing an automatic information input program for directing a computer to perform a process of automatically inputting information about a moveable information input field displayed on a monitor screen of an application, comprising:

a personal authentication process of performing personal authentication based upon biometric information,

an automatic inputting process of automatically inputting the information when the personal authentication is valid,

said automatic inputting process comprising;

an initial position determining process of determining the initial position of the moveable information input field on the monitor screen, into which the information is to be automatically input in a predetermined search area on a screen displayed on the monitor screen;

a next position determining process of sequentially moving a next automatic input position to a different position, on the monitor screen, at a predetermined rule based on an initial position determined in the initial position determining process;

an input process of automatically inputting the information in a position determined in the initial position determining process and/or the next position determining process;

an input success/failure detecting process of detecting whether information has been successfully input into the moveable information input field by an automatic information input in the input process;

a search area setting process of setting a predetermined search area on the monitor screen when a failure has been detected in the input success/failure detecting process; and

a trial process of automatically inputting the information by moving a position of the search area set in the search area setting process,

said trial process comprising a control process of controlling each of the processes such that when a failure is detected in the input success/failure detecting process on the automatic information input performed by the input process on the position determined in the initial position determining process, the next position determining process determines the next position, the input process automatically inputs the information in the position, the input success/failure detecting process detects the success/failure of the input for the automatic information input, the next position determining process determines again the next position when a failure is detected in the detecting process, the input process automatically inputs the information in the position, and the input success/failure detecting process detects the success/failure of an input on the automatic information input until a predetermined input result can be obtained.

15. The computer readable medium according to claim 13, wherein when the information is automatically input, said input information entering process for entering in advance the information and said information input process for inputting the information entered in advance when the information is automatically input are performed by the computer.

16. The computer readable medium according to claim 13, wherein said computer can further perform:

an identification information entering process of obtaining in advance identification information specifying the application for displaying the moveable information input field into which the predetermined information entered in advance from the application, and entering in advance the obtained identification information; and

a display detecting process of monitoring the screen displayed on the monitor screen, and detecting a display on the screen by the application having the identification information entered in the identification information entering process.

18. The computer readable medium according to claim 13, wherein said computer can further perform:

an initial position determination rule entering process of entering a first rule for determination of the initial input position in the initial input position determining process and/or a second rule for determination of the initial press position in the initial press position determining process;

with the initial input position determining process performed such that the initial input position can be determined according to the first rule entered in the initial position determination rule entering process, and/or with the initial press position determining process performed such that the initial press position can be determined according to the second rule entered in the initial position determination rule entering process.

20. The computer readable medium according to claim 13, wherein said computer can further perform:

a next position determination rule entering process of entering a third rule for determination of the next input position in a next input position determining process and/or the fourth rule for determination of the next press position in a next press position determining process, with the next input position determining process performed such that the next input position can be determined according to the third rule entered in the next position determination rule entering process, and the next press position determining process performed such that the next press position can be determined according to the fourth rule entered in the next position determination rule entering process.

23. The computer readable medium according to claim 13, wherein:

said computer can perform;

a file information entering process of entering in advance file information about markup language for generation of a window as the identification information for designation of the window on the monitor screen for display of the moveable information input field; and

at an input time,

a file information obtaining process of obtaining the file information about the input window displayed on the monitor screen,

a comparing process of comparing the file information obtained in the file information obtaining process with the file information entered in the file information entering process, and

an execution control process of controlling the predetermined information to be automatically input and/or the button to be automatically pressed on the window when the file information match in the comparing process.

26. The computer readable medium according to claim 13, wherein said computer can perform:

an additional information adding process of adding predetermined additional information in a predetermined description position in a file described in the markup language on the screen displaying the moveable information input field and/or the button on the monitor screen; and

at an input time,

a discriminating process of discriminating whether predetermined additional information is additionally described in a predetermined description position in a markup language on the window displayed on the monitor screen, and

an execution control process of controlling the predetermined information to be automatically input and/or the button to be automatically pressed on the window when predetermined additional information is discriminated in the discriminating process.

29. The computer readable medium according to claim 13, wherein said computer can perform:

a process of automatically inputting into the moveable information input field an ID or a password, or both of them as the predetermined information.

30. The computer readable medium according to claim 13, wherein the computer can perform:

an initial position determining process of setting a top end of a predetermined display area on the monitor screen as an initial position into which the predetermined information is automatically input;

a next position determining process of moving a next input position sequentially downwards using the initial position determined in the initial position determining process as a reference;

an input process of sequentially and automatically inputting an ID and a password into the two positions determined in the initial position determining process and/or the next position determining process;

an input success/failure detecting process of detecting whether the ID and/or a password has been successfully input into the moveable information input field by automatic information input in the input process; and

a control process of controlling each of the processes such that when a failure is detected in the input success/failure detecting process on the automatic input performed by the input process on the position determined in the initial position determining process, the next position determining process determines the next position, the input process automatically inputs the information in the position, the input success/failure detecting process detects the success/failure of the input for the automatic input, the next position determining process determines again the next position when a failure is detected in the detecting process, the input process automatically inputs the information in the position, and the input success/failure detecting process detects the success/failure of an input on the automatic input until a predetermined input result can be obtained.

32. The computer readable medium according to claim 13, wherein said window on the monitor screen can be a window of a Web page relating to an electronic transaction, and the predetermined information can be necessary information for purchase of merchandise in the electronic transaction.

34. The computer readable medium according to claim 13, wherein said moveable information input field can be an information input field of a Web page, an information input field of mail software, a dialog box activated as another screen by a browser, or a similar information input field.

37. The computer readable medium according to claim 13, wherein said application with said moveable information input field cannot be changed.

14. A computer-readable medium storing an automatic information input program for directing a computer to perform a process of automatically pressing a push button of an application displayed on a monitor screen, comprising:

a personal authentication process of performing personal authentication based upon biometric information; and

an automatic inputting process of automatically pressing the push button when the personal authentication is valid,

said automatic inputting process comprising;

an initial position determining process of determining an initial position of the push button on the monitor screen, in which the push button is to be automatically pressed in a predetermined search area on a screen displayed on the monitor screen;

a next position determining process of sequentially moving a next automatic press position to a different position, on the monitor screen, at a predetermined rule based on the initial position determined in the initial position determining process;

a pressing process of automatically pressing the push button in the position determined in the initial position determining process and/or the next position determining process;

a press success/failure detecting process of detecting whether the push button has been successfully pressed by the automatic press in the pressing process;

a search area setting process of setting a predetermined search area on the monitor screen when a failure has been detected in the press success/failure detecting process; and

a trial process of automatically pressing the push button by moving a position of the search area set in the search area setting process,

said trial process comprising a control process of controlling each of the processes such that when a failure is detected in the successful/faulty press detecting process on the automatic press performed by the pressing process on the position determined in the initial position determining process, the next position determining process determines the next position, the pressing process automatically presses the push button in the position, the input success/failure detecting process detects the success/failure of the press for the automatic press, the next position determining process determines again the next position when a failure is detected in the detecting process, the pressing process automatically presses the push button in the position, and the input success/failure detecting process detects the success/failure of a press on the automatic press until a predetermined press result can be obtained.

17. The computer readable medium according to claim 14, wherein said computer can further perform:

an identification information entering process of obtaining in advance identification information specifying an application for displaying a moveable input field into which predetermined information is entered in advance from the application, and entering in advance the obtained identification information; and

a display detecting process of monitoring the screen displayed on the monitor screen, and detecting a display on the screen by the application having the identification information entered in the identification information entering process.

19. The computer readable medium according to claim 14, wherein said computer can further perform:

an initial position determination rule entering process of entering a first rule for determination of the initial input position in the initial input position determining process and/or a second rule for determination of the initial press position in the initial press position determining process;

with the initial input position determining process performed such that the initial input position can be determined according to the first rule entered in the initial position determination rule entering process, and/or with the initial press position determining process performed such that the initial press position can be determined according to the second rule entered in the initial position determination rule entering process.

21. The computer readable medium according to claim 14, wherein said computer can further perform:

a next position determination rule entering process of entering a third rule for determination of the next input position in a next input position determining process and/or the fourth rule for determination of the next press position in a next press position determining process, with the next input position determining process performed such that the next input position can be determined according to the third rule entered in the next position determination rule entering process, and the next press position determining process performed such that the next press position can be determined according to the fourth rule entered in the next position determination rule entering process.

24. The computer readable medium according to claim 14, wherein:

said computer can perform;

a file information entering process of entering in advance file information about markup language for generation of a window as the identification information for designation of the window on the monitor screen for display of the moveable input field; and

at an input time,

a file information obtaining process of obtaining the file information about the window displayed on the monitor screen,

a comparing process of comparing the file information obtained in the file information obtaining process with the file information entered in the file information entering process, and

an execution control process of controlling the predetermined information to be automatically input and/or the button to be automatically pressed on the window when the file information match in the comparing process.

27. The computer readable medium according to claim 14, wherein said computer can perform:

an additional information adding process of adding predetermined additional information in a predetermined description position in a file described in the markup language on the screen displaying a moveable input field and/or the button on the monitor screen; and

at an input time,

a discriminating process of discriminating whether predetermined additional information is additionally described in a predetermined description position in a markup language on the window displayed on the monitor screen, and

an execution control process of controlling the predetermined information to be automatically input and/or the button to be automatically pressed on the window when predetermined additional information is discriminated in the discriminating process.

35. The computer readable medium according to claim 14, wherein a moveable input field can be an information input field of a Web page, an information input field of mail software, a dialog box activated as another screen by a browser, or a similar information input field.

38. An automatic information input method automatically inputting predetermined information into a moveable input field and automatically pressing a button on a window displaying the moveable input field and the button corresponding to the moveable input field of an application on a monitor screen, comprising:

at an entry time,

entering the predetermined information,

entering initial positional information about the input moveable field on the window corresponding to a position of the moveable input field displayed on the monitor screen,

entering initial positional information about the button on the window corresponding to a position of the button displayed on the monitor screen,

obtaining, from the application, the identification information specifying the application for displaying the moveable input field and the button, and

entering the identification information obtained in the identification information obtaining; and

at an input time,

performing personal authentication based upon biometric information,

automatically pressing the button when the personal authentication is valid,

said automatic pressing performed according to a process comprising;

monitoring a screen displayed on the monitor screen and detecting that screen display is performed by the application having the identification information entered in the identification information entering,

detecting the position of the moveable input field on the monitor screen based on the initial positional information entered in the input position entering,

automatically inputting the predetermined information entered in the information entering in the moveable input field detected in the input position detecting,

specifying the position of the button on the monitor screen based on the initial positional information entered in the button position entering,

automatically pressing the button in the position specified in the button position specifying

an press success/failure detecting process of detecting whether an automatic press of the button has been successfully performed;

a search area setting process of setting a predetermined search area on the monitor screen when a failure has been detected in the press success/failure detecting process; and

a trial process of automatically pressing the button by moving a position of the search area set in the search area setting process.

39. An automatic information input method automatically inputting predetermined information into a moveable input field and automatically pressing a button on a window displaying the moveable input field and the button corresponding to the moveable input field of an application on a monitor screen, comprising:

entering in advance the predetermined information;

obtaining in advance from the application the identification information specifying the application for displaying the moveable input field and the button, and entering in advance the obtained identification information;

monitoring the screen displayed on the monitor screen, and detecting that screen display is performed by the application having the identification information entered in the identification information entering;

performing personal authentication based upon biometric information,

automatically inputting the predetermined information and/or automatically pressing a button when the personal authentication is valid,

said automatic inputting process comprising;

setting a predetermined position corresponding to a position of the moveable input field displayed on the monitor screen;

sequentially moving a next input position using the predetermined position set in the initial position determining as reference according to a predetermined rule;

sequentially and automatically inputting the predetermined information and automatically pressing the button in the two positions determined in the initial position determining and/or the next position determining;

detecting whether the automatic input and/or the automatic press in the inputting/pressing has been successful;

setting a predetermined search area on the monitor screen when a failure has been detected and automatically inputting the predetermined information and/or automatically pressing the button by moving a position of the search area set in the search area setting process by repeating, when the successful/faulty input/press detecting detects a failure in the automatic input and/or automatic press performed in the inputting/pressing on the position determined in the initial position determining, the next position determining the next position, the inputting/pressing performing the automatic input and/or automatic press on the position, and the successful/faulty input/press detecting the success/failure of input/press on the automatic input and/or the automatic press; and

, when a failure is detected in the detecting, the next position determining the next position again, the inputting/pressing performing the automatic input and/or press on the position, the successful/faulty input/press detecting the success/failure of the input/press on the automatic input and/or press.

40. An automatic information input apparatus including a processor automatically inputting predetermined information into a moveable input field and automatically pressing a button on a window displaying the moveable input field and the button corresponding to the moveable input field of an application on a monitor screen, comprising:

at an entry time,

an information entry unit entering the predetermined information,

an input position entry unit entering initial positional information, on the monitor screen, about the moveable input field on the window displayed on the monitor screen,

a button position entry unit entering initial positional information, on the monitor screen, about the button on the window displayed on the monitor screen,

an identification information obtaining unit obtaining from the application the identification information specifying the application for displaying the moveable input field and the button, and

an identification information entry unit entering the identification information obtained in the identification information obtaining unit; and

at an input time,

a personal authentication unit performing personal authentication based upon biometric information,

an automatic inputting unit automatically inputting the predetermined information and/or automatically pressing a button when the personal authentication is valid,

said automatic inputting unit comprising;

a display detection unit monitoring the screen displayed on the monitor screen and detecting that screen display is performed by the application having the identification information entered in the identification information entry unit,

an input position detection unit detecting the position of the moveable input field on the monitor screen based on the initial positional information entered in the input position entry unit,

an information input unit automatically inputting the predetermined information entered in the information entry unit in the moveable input field detected by the input position detection unit,

a button position specification unit specifying the position of the button on the monitor screen based on the initial positional information entered in the button position entry unit,

a pressing unit automatically pressing the button in the position specified in the button position specification unit,

an input success/failure detecting unit detecting whether an automatic press of the button has been successfully performed,

a search area setting unit setting a predetermined search area on the monitor screen when a failure has been detected in the input success/failure detecting process, and

a trial unit automatically pressing the button by moving a position of the search area set by the search area setting unit.

41. An automatic information input apparatus including a processor automatically inputting predetermined information into a moveable input field and automatically pressing a button on a window displaying the moveable input field and the button corresponding to the moveable input field of an application on a monitor screen, comprising:

an input position entry unit entering in advance the predetermined information;

an identification information entry unit obtaining in advance from the application the identification information specifying the application for displaying the moveable input field and the button, and entering in advance the obtained identification information;

a display detection unit monitoring the screen displayed on the monitor screen, and detecting that screen display is performed by the application having the identification information entered in the identification information entry unit;

a personal authentication unit performing personal authentication based upon biometric information,

an automatic inputting unit automatically inputting the predetermined information and/or automatically pressing a button when the personal authentication is valid,

said automatic inputting unit comprising;

an initial position determination unit setting a predetermined position, on the monitor screen, on the input window displayed on the monitor screen;

a next press position determination unit sequentially moving a next input position using the predetermined position set by the initial position determination unit as reference according to a predetermined rule;

an input/press unit sequentially and automatically inputting the predetermined information and automatically pressing the button in the two positions determined by the initial position determination unit and/or the next position determination unit;

an successful/faulty input/press detection unit detecting whether the automatic input and/or the automatic press by the input/press unit has been successful;

a search area setting unit selling a predetermined search area on the monitor screen when a failure has been detected in the success/faulty input/press detecting unit; and

a trial unit automatically inputting the predetermined information and/or automatically pressing the button by moving a position of the search area set by the search area setting unit by repeating, when the successful/faulty input/press detection unit detects a failure in the automatic input and/or automatic press performed by the input/press unit on the position determined by the initial position determination unit, the next position determination unit determining the next position, the input/press unit performing the automatic input and/or automatic press on the position, and the successful/faulty input/press detection unit detecting the success/failure of input/press on the automatic input and/or the automatic press; and

, when a failure is detected by the detection unit, the next position determination unit determining the next position again, the input/press unit performing the automatic input and/or press on the position, the successful/faulty input/press detection unit detecting the success/failure of the input/press on the automatic input and/or press.