Non-transitory computer-readable recording medium storing computer-readable instructions for causing information processing device to execute communication processing with image processing program and voice-recognition program, information processing device, and method of controlling information processing device

• US 10,318,237 B2
• Filed: 03/20/2018
• Issued: 06/11/2019
• Est. Priority Date: 03/31/2017
• Status: Active Grant

• Current Assignee: Brother Kogyo Kabushiki Kaisha
• Original Assignee: Brother Kogyo Kabushiki Kaisha
• Inventors: Matsuo, Yu
• Primary Examiner(s): Nguyen, Allen H
• Application Number:
  US15/925,911
• Publication Number:
  US 20180285069A1
• Time in Patent Office: 448 Days
• Field of Search: 358 113
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 1/00403 Voice input means, e.g. voice commands
• CPC Class Codes: H04N 1/00493 Particular location of the interface or console
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Abstract

A non-transitory computer-readable recording medium storing computer-readable instructions may be read by a controller of an information processing device in which an image processing program and a voice-recognition program have been installed. The computer-readable instructions may cause the information processing device to obtain the text data from the voice-recognition program in a case where the voice-recognition program creates the text data. The computer-readable instructions may cause the information processing device to determine whether the obtained text data includes a first string and a second string. The computer-readable instructions may cause the information processing device to cause a display of the information processing device to display a specific image in a case where it is determined that the text data includes the first string and the second string. The computer-readable instructions may cause the information processing device to instruct the image processing program to execute image processing.

Claims

1. A non-transitory computer-readable recording medium storing computer-readable instructions read by a controller of an information processing device in which an image processing program and a voice-recognition program have been installed, the computer-readable instructions being for intermediating communications between the image processing program and the voice-recognition program,

the image processing program and the voice-recognition program having a format interpretable by the controller of the information processing device,

the image processing program being for executing image processing,

the voice-recognition program being for converting a voice inputted via a microphone of the information processing device to text data,

wherein the computer-readable instructions for intermediating communications between the image processing program and the voice-recognition program, when executed by the controller of the information processing device, cause the information processing device to:

obtain the text data from the voice-recognition program in a case where the voice-recognition program creates the text data;

determine whether the obtained text data includes a first string indicating a name of the image processing program and a second string indicating a content of image processing which is one of print and scan to be executed by the image processing program;

cause a display of the information processing device to display a specific image indicating the print or scan indicated by the second string in a case where it is determined that the text data includes the first string and the second string; and

instruct the image processing program having the name indicated by the first string to execute the print or scan indicated by the second string in a case where an execution instruction is accepted.

2. The non-transitory computer-readable recording medium as in claim 1, wherein

the causing the display to display the specific image includes causing the voice recognition program or the image processing program to display the specific image by sending specific image data for displaying the specific image to the voice recognition program or the image processing program.

3. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

receive result information indicating an execution result of the print or scan indicated by the second string from the image processing program; and

cause the voice-recognition program to output the execution result indicated by the result information by sending the received result information to the voice-recognition program.

4. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

create the first string based on a similar character string similar to the first string in a case where it is determined that the first string is not included in the text data but the similar character string is included in the text data;

cause the voice-recognition program to output the created first string by sending the created first string to the voice-recognition program;

receive, from the voice-recognition program, first use information indicating whether the created first string is usable; and

instruct the image processing program having a name indicated by the created first string to execute the print or scan indicated by the second string in a case where the received first use information indicates that the created first string is usable.

5. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

create the second string based on a similar character string similar to the second string in a case where it is determined that the second string is not included in the text data but the similar character string is included in the text data;

cause the voice-recognition program to output the second string by sending the created second string to the voice-recognition program;

receive, from the voice-recognition program, second use information indicating whether the created second string is usable;

cause the display to display a specific image indicating the print or scan indicated by the created second string in a case where the received second use information indicates that the created second string is usable; and

instruct the image processing program having the name indicated by the first string to execute the print and scan indicated by the created second string in a case where an execution instruction for the image processing is accepted.

6. The non-transitory computer-readable recording medium as in claim 5, wherein

the causing the display to display the specific image indicating the print or scan includes causing the voice-recognition program or the image processing program to display the specific image by sending specific image data for displaying the specific image to the voice-recognition program or the image processing program.

7. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

create a plurality of first candidate strings that is candidates for the first character string, in a case where it is determined that the first string is not included in the text data;

cause the voice-recognition program to output the plurality of first candidate strings by sending the created plurality of first candidate strings to the voice-recognition program;

receive, from the voice-recognition program, selected first string information indicating a selected first string selected from the sent plurality of first candidate strings; and

instruct the image processing program having a name indicated by the selected first string indicated by the received selected first string information to execute the print or scan indicated by the second string.

8. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

create a plurality of second candidate strings that is candidates for the second string, in a case where it is determined that the second string is not included in the text data;

causing the voice-recognition program to output the plurality of second candidate strings by sending the created plurality of second candidate strings to the voice-recognition program;

receive, from the voice-recognition program, selected second string information indicating a selected second string selected from the created plurality of second candidate strings;

cause the display to display a specific image indicating the print or scan indicated by the selected second string indicated by the received selected second string information; and

instruct the image processing program having a name indicated by the first string to execute the print or scan indicated by the selected second string, in a case where execution instruction of the image processing is accepted.

9. The non-transitory computer-readable recording medium as in claim 8, wherein

the causing the display to display the specific image indicating the print or scan indicated by the selected second string includes causing the voice-recognition program or the image processing program to display the specific image by sending specific image data for displaying the specific image to the voice-recognition program or the image processing program.

10. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

cause the voice recognition program to accept input of the first string by sending first request information for requesting input of the first string to the voice recognition program in a case where it is determined that the first string is not included in the text data;

receive the first string from the voice-recognition program; and

instruct the image processing program having a name indicated by the received first string to execute the print or scan indicated by the second string.

11. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

send second request information for requesting input of the second string to the voice-recognition program in a case where it is determined that the second string is not included in the text data so as to cause the voice-recognition program to accept input of the second string; and

receive the second string from the voice-recognition program;

cause the display to display a specific image indicating the print or scan indicated by the received second string; and

instruct the image processing program having a name indicated by the first string to execute the print or scan indicating the received second string in a case where execution instruction of the image processing is accepted.

12. The non-transitory computer-readable recording medium as in claim 11, wherein

the causing the display to display the specific image indicating the print or scan indicated by the received second string includes causing the voice-recognition program or the image processing program to display the specific image by sending specific image data for displaying the specific image to the voice-recognition program or the image processing program.

13. The non-transitory computer-readable recording medium as in claim 1, wherein the computer-readable instructions, when executed by the controller of the information processing device, further cause the information processing device to:

obtain first information indicating whether setting information to be used in the print or scan indicated by the second string is included in the text data; and

extract the setting information from the text data in a case where the first information indicates the setting information is included in the text data,

the instructing of the image processing program having the name indicated by the first string to execute the print or scan indicated by the second string includes instructing the image processing program to execute the print or scan according to the extracted setting information.

14. An information processing device, in which an image processing program and a voice-recognition program have been installed,

the image processing program and the voice-recognition program having a format interpretable by a controller of the information processing device,

the image processing program being for executing image processing,

the voice-recognition program being for converting a voice inputted via a microphone of the information processing device to text data, the information processing device comprising:

a display;

the microphone;

the controller; and

a main memory storing computer-readable instructions therein for intermediating communications between the image processing program and the voice-recognition program, the computer-readable instructions, when executed by the controller, causing the information processing device to;

obtain the text data from the voice-recognition program in a case where the voice-recognition program creates the text data;

determine whether the obtained text data includes a first string indicating a name of the image processing program and a second string indicating a content of image processing which is one of print and scan to be executed by the image processing program;

cause the display to display a specific image indicating the print or scan indicated by the second string in a case where it is determined that the text data includes the first string and the second string; and

instruct the image processing program having the name indicated by the first string to execute the print or scan indicated by the second string in a case where an execution instruction is accepted.

15. A method of controlling an information processing device in which an image processing program and a voice-recognition program have been installed,

the image processing program and the voice-recognition program having a format interpretable by the controller of the information processing device,

the image processing program being for executing image processing,

the voice-recognition program being for converting a voice inputted via a microphone of the information processing device to text data, the method comprising,

when a controller of the information processing device executes computer-readable instructions for intermediating communications between the image processing program and the voice-recognition program, read by the controller, performing the steps of;

obtaining the text data from the voice-recognition program in a case where the voice-recognition program creates the text data;

determining whether the obtained text data includes a first string indicating a name of the image processing program and a second string indicating a content of image processing which is one of print and scan to be executed by the image processing program;

causing a display of the information processing device to display a specific image indicating the print or scan indicated by the second string in a case where it is determined that the text data includes the first string and the second string; and

instructing the image processing program having the name indicated by the first string to execute the print or scan indicated by the second string in a case where an execution instruction is accepted.