Electronic device and method for spoken interaction thereof

• US 10,546,587 B2
• Filed: 10/14/2015
• Issued: 01/28/2020
• Est. Priority Date: 10/14/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chakladar, Subhojit, Lee, Sanghoon
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): Villena, Mark
• Application Number:
  US14/883,489
• Publication Number:
  US 20160104484A1
• Time in Patent Office: 1,567 Days
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A method of operating an electronic device is provided, the method including: receiving, by the electronic device that includes a display and a voice receiving device, a sequence of speech elements through the voice receiving device; displaying, on the display by the electronic device, first information that is based on at least a part of a first speech element out of the speech elements; and displaying, on the display by the electronic device, second information, which is different than the first information and is based on at least a part of a second speech element that is received later than the first speech element among the speech elements.

Claims

1. A method for operating an electronic device, the method comprising:

receiving, by the electronic device that includes a display and a voice receiving device, a first speech portion of a sentence through the voice receiving device;

while receiving a second speech portion of the sentence following the first speech portion of the sentence through the voice receiving device;

transmitting, by the electronic device, the first speech portion to be recognized to an outside of the electronic device through a communication interface;

receiving, by the electronic device, first information from the outside of the electronic device through the communication interface, the first information associated with a plurality of applications corresponding to a context of the first speech portion; and

displaying, on the display of the electronic device, icons corresponding to the plurality of applications; and

after receiving the second speech portion of the sentence;

transmitting, by the electronic device to the outside of the electronic device, the second speech portion to be recognized, through the communication interface;

receiving, by the electronic device, via the communication interface from the outside of the electronic device, second information, the second information associated with at least one application of the plurality of applications corresponding to the context of the first speech portion and a context of the second speech portion;

displaying, on the display of the electronic device, at least one icon corresponding to the at least one application sorted out of the plurality of applications; and

executing an application corresponding to the at least one icon.

2. The method of claim 1, further comprising:

transmitting, by the electronic device, the second speech portion to the outside of the electronic device through the communication interface after transmitting the first speech portion to the outside of the electronic device through the communication interface; and

receiving, by the electronic device, the second information from the outside of the electronic device through the communication interface after receiving the first information from the outside of the electronic device through the communication interface.

3. The method of claim 1, wherein the first speech portion is a phrase including one or more words, and does not form a complete sentence.

4. The method of claim 1, wherein the second speech portion is a phrase that includes one or more words, and does not form a complete sentence, and forms at least a part of the sentence together with the first speech portion.

5. The method of claim 1, wherein:

the first information includes information that is generated, retrieved, or recommended based on an association with the first speech portion, and

the second information includes information that is generated, retrieved, or recommended based on an association with at least a part of a combination of the first information and the second speech portion.

6. The method of claim 5, wherein the first information includes a map and the second information includes position information on the map.

7. The method of claim 1, further comprising:

generating, retrieving, or recommending, by the electronic device, the first information by processing the first speech portion; and

generating, retrieving, or recommending, by the electronic device, the second information by processing the second speech portion.

8. An electronic device, comprising:

a display;

a voice receiving device;

a communication interface;

a memory; and

a processor, wherein;

the memory stores instructions, which when executed by the processor, cause the electronic device to;

receive a first speech portion of a sentence through the voice receiving device,

while receiving a second speech portion of the sentence following the first speech portion of the sentence through the voice receiving device;

transmit, by the electronic device, through the communication interface, the first speech portion to be recognized to an outside of the electronic device,

receive, by the electronic device, through the communication interface, first information from the outside of the electronic device, the first information associated with a plurality of applications corresponding to a context of the first speech portion, and

display, on the display, icons corresponding to the plurality of applications, and

after receiving the second speech portion of the sentence;

transmit, by the electronic device to the outside of the electronic device, through the communication interface, the second speech portion to be recognized,

receive, by the electronic device, through the communication interface, from the outside of the electronic device, second information, the second information associated with at least one application of the plurality of applications corresponding to the context of the first speech portion and a context of the second speech portion, and

display on the display, at least one icon corresponding to the at least one application out of the plurality of applications, and

execute an application corresponding to the at least one icon.

9. The electronic device of claim 8, wherein the memory further stores instructions, which when executed by the processor, cause the electronic device to:

transmit the second speech portion to the outside of the electronic device through the communication interface, after transmitting the first speech portion to the outside of the electronic device through the communication interface, and

receive the second information from the outside of the electronic device through the communication interface, after receiving the first information from the outside of the electronic device through the communication interface.

10. The electronic device of claim 8, wherein the first speech portion includes a phrase including one or more words, and does not form a complete sentence.

11. The electronic device of claim 8, wherein the second speech portion is a phrase including one or more words, and does not form a complete sentence, and forms at least a part of a single sentence together with the first speech portion.

12. The electronic device of claim 8, wherein:

the first information includes information that is generated, retrieved, or recommended based on an association with the first speech portion, and

the second information includes information that is at least one of generated, retrieved, or recommended based on an association with at least a part of a combination of the first information and the second speech portion.

13. The electronic device of claim 12, wherein the first information includes a map and the second information includes position information on the map.

14. The electronic device of claim 8, wherein, the memory further stores instructions, which, when executed by the processor, cause the electronic device to:

at least one of generating, retrieving, or recommending the first information by processing the first speech portion, and

at least one of generating, retrieving, or recommending the second information by processing the second speech portion.