Electronic device and method of executing function of electronic device

• US 10,440,167 B2
• Filed: 04/19/2019
• Issued: 10/08/2019
• Est. Priority Date: 03/27/2017
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Il-Hwan, Kang, Sang-Wook, Kim, Young-Hoon, Park, Seung-Hoon, Seo, Hyun-Ju, Um, Tae-Kwang, Lee, Jae-Yong, Choi, Jin-Ho, Lee, Da-Som, Yeo, Jae-Yung
• Primary Examiner(s): Khan, Suhail
• Application Number:
  US16/389,216
• Publication Number:
  US 20190260866A1
• Time in Patent Office: 172 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

An artificial intelligence system and method are disclosed herein. The system includes a processor which implements the method, including: receiving by an input unit a first user input including a request to execute a task using at least one of the electronic device or an external device, transmitting by a wireless communication unit first data associated with the first user input to an external server, receiving a first response from the external server including information associated with at least one of the first user input and a sequence of electronic device states for performing at least a portion of the task, receiving a second user input assigning at least one of a voice command and a touch operation received by a touch screen display as the request to perform the task, and transmitting second data associated with the second user input to the external server.

Claims

1. A portable communication device comprising:

a microphone;

a touchscreen display; and

at least one processor configured to;

execute a first function of a plurality of functions of a first application at the portable communication device based at least in part on a first touch input received via the touchscreen display;

after the executing of the first function is terminated, display, via the touchscreen display, a recommendation text and a graphical indication based at least in part on a determination that the first function is executable based at least in part on one or more voice command being received via the microphone, the recommendation text including one or more words related to the first function;

receive a second touch input with respect to the graphical indication;

after the second touch input is received, receive a first voice input via the microphone at least temporarily while the recommendation text is displayed, wherein the first voice input is registered as a voice command to execute the first function;

receive a second voice input after the first voice input is registered; and

based on a determination that the second voice input corresponds to the registered voice command, execute the first function of the first application at the portable communication device.

2. The portable communication device of claim 1, wherein the at least one processor is configured to:

perform the displaying of the recommendation text and the graphical indication using a second application, wherein the second application is different from the first application.

3. The portable communication device of claim 1, wherein the at least one processor is configured to:

generate the recommendation text such that a name of the first application is included as at least part of the recommendation text.

4. The portable communication device of claim 1, wherein the at least one processor is configured to:

transmit at least part of the first voice input to a server external to the portable communication device, such that the server registers the at least part of the first voice input as the registered voice command to execute the first function.

5. The portable communication device of claim 1, further comprising a memory to store the first application, wherein the at least one processor is configured to:

store, in the memory, at least part of the first voice input as the registered voice command to execute the first function.

6. The portable communication device of claim 1, wherein the at least one processor is configured to:

execute a plurality of functions including the first function and a second function different from the first function based at least in part on reception of the registered voice command.

7. The portable communication device of claim 1, wherein the at least one processor is configured to:

transmit the second voice input to a server external to the portable communication device, such that the server determines that the second voice input corresponds to the registered voice command.

8. A portable communication device comprising:

a memory storing a specified application;

a microphone;

a touchscreen display; and

at least one processor configured to;

execute, using the specified application, a specified function based at least in part on a first touch input received via the touchscreen display, the executing including displaying a first user interface corresponding to the specified application via the touchscreen display;

after the specified function is executed, display, via the touchscreen display, a text indication indicative of the specified function and a graphical indication as part of a second user interface different from the first user interface, wherein the displaying is based at least in part on a determination that the specified function is executable based at least in part on one or more voice command;

receive, via the touchscreen display, a second touch input with respect to the graphical indication; and

based at least in part on the second touch input, display, via the touchscreen display, a recommendation text as part of a third user interface different from the first user interface and the second user interface, the recommendation text including one or more words to be used to execute the specified function,

while the recommendation text is displayed as part of the third user interface via the touchscreen display, receive a voice input via the microphone, and

wherein at least part of the voice input is registered as a voice command to be used to execute the specified function.

9. The portable communication device of claim 8, wherein the at least one processor is configured to:

receive another voice input via the microphone while the first and second user interfaces are not displayed;

determine that the other voice input corresponds to the registered voice command; and

execute the specified function based at least in part on the determining.

10. The portable communication device of claim 8, wherein the voice input includes a different word from the one or more words included in the recommendation text such that the different word is registered as at least part of the registered voice command to be used to execute the specified function.

11. The portable communication device of claim 8, wherein the at least one processor is configured to:

transmit the at least part of the voice input to a server external to the portable communication device, such that the server registers the at least part of the voice input as the registered voice command.

12. The portable communication device of claim 8, wherein the at least one processor is configured to:

store, in the memory, the at least part of the voice input as the registered voice command.

13. The portable communication device of claim 8, wherein the at least one processor is configured to:

execute a plurality of functions including the specified function and another function different from the specified function based on reception of another of the one or more voice command.

14. The portable communication device of claim 8, wherein the at least one processor is configured to:

perform the displaying of the text indication and the graphical indication using a second application, wherein the second application is different from the specified application.