Image processing apparatus, control method thereof, and image processing system using a user's voice

• US 9,392,326 B2
• Filed: 10/03/2013
• Issued: 07/12/2016
• Est. Priority Date: 01/17/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Jong-cheol, Lee, Joo-yeong, Park, Sang-shin
• Primary Examiner(s): Bryar, Jeremiah
• Application Number:
  US14/045,438
• Publication Number:
  US 20140200896A1
• Time in Patent Office: 1,013 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4396 by muting the audio signal
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4852 for modifying audio parameters, e.g. switching between mono and stereo
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895

Abstract

An image processing apparatus includes an image processor; an audio input to input a user'"'"'s speech; a storage to store at least one simple sentence voice command and an operation corresponding to the simple sentence voice command; a communication device to communicate with a server that analyzes a descriptive sentence voice command and determine an operation corresponding to the descriptive sentence voice command; an audio processor to process a first voice command corresponding to the speech and conduct the operation corresponding to the simple sentence voice command if the first voice command is the simple sentence voice command, and to transmit the first voice command to the communication device if the first voice command is not the simple sentence voice command; and a controller configured to display a first guide image which recommends the simple sentence voice command stored in the storage if the corresponding operation for the first voice command determined by the server is identical to one of the at least one simple sentence voice command stored in the storage.

Claims

1. An image processing apparatus comprising:

an image processor configured to process an image signal and display the processed image;

an audio input configured to input a user'"'"'s speech;

a storage configured to store a list of simple voice commands and an operation corresponding to each of the simple voice commands;

a communication device configured to communicate with a server that analyzes a descriptive voice command and determine an operation corresponding to the descriptive voice command;

an audio processor configured to process a voice command corresponding to the user'"'"'s speech to conduct the operation corresponding to a simple voice command in the list if the first voice command is the simple voice command in the list, and to transmit the voice command to the server through the communication device if the voice command is not the simple voice command in the list; and

a controller configured to, if an operation for the voice command determined by the server corresponds to the simple voice command in the list, display a guide image which recommends the corresponding simple voice command in the list,

wherein the simple voice command is shorter than the descriptive voice command.

2. The image processing apparatus of claim 1, wherein the controller determines the operation corresponding to the voice command according to a control command transmitted from the server based on the voice command.

3. The image processing apparatus of claim 1, wherein a time from a point when the user'"'"'s speech is input to the audio input to a point when the corresponding operation is performed is shorter when the voice command is the simple voice command than when the first voice command is the descriptive voice command.

4. The image processing apparatus of claim 1, wherein the controller displays a second guide image which recommends a preset second voice command when a plurality of voice commands respectively corresponding to a plurality of user speeches are sequentially input in a state that a preset corresponding operation is set to be performed depending on when the plurality of voice commands are sequentially input or when the second voice command is input.

5. The image processing apparatus of claim 1, wherein the communication device communicates with a speech-to-text (STT) server to convert the user'"'"'s speech into a voice command of a text, and the controller transmits an audio signal of the speech to the STT server and receives the voice command corresponding to the speech from the STT server when the speech is input to the audio input.

6. The image processing apparatus of claim 1, further comprising a display configured to display the image signal processed by the image processor as an image.

7. A control method of an image processing apparatus, the method comprising:

inputting a user'"'"'s speech;

performing an operation corresponding to a simple voice command in a list stored in the image processing apparatus if a voice command corresponding to the user'"'"'s speech is the simple sentence voice command in the list, the list comprising simple voice commands and an operation corresponding to each of the simple voice commands; and

transmitting the first voice command to a server if the voice command corresponding to the user'"'"'s speech is not the simple voice command in the list, the server configured to analyze a descriptive voice command and determine an operation corresponding to the descriptive voice command,

wherein the transmitting the voice command to the server comprises, if an operation for the voice command determined by the server corresponds to the simple voice command in the list, displaying a guide image which recommends the corresponding simple voice command in the list,

wherein the simple voice command is shorter than the descriptive voice command.

8. The control method of claim 7, wherein the displaying the guide image comprises determining the operation corresponding to the voice command according to a control command transmitted from the server based on the voice command.

9. The control method of claim 7, wherein a time from a point when the user'"'"'s speech is input to an audio input to a point when the corresponding operation is performed is shorter when the voice command is the simple voice command than when the voice command is the descriptive voice command.

10. The control method of claim 7, further comprising:

displaying a second guide image that recommends a preset second voice command when a plurality of voice commands respectively corresponding to a plurality of speeches are sequentially input in a state that a preset corresponding operation is set to be performed depending on when the plurality of voice commands are sequentially input or when the second voice command is input.

11. The control method of claim 7, wherein the inputting the user'"'"'s speech comprises transmitting an audio signal of the speech to a speech-to-text (STT) server to convert the speech into a voice command of a text and receiving the voice command corresponding to the speech from the STT server.

12. An image processing system comprising:

an image processing apparatus configured to process an image signal and display the processed image signal; and

a server configured to communicate with the image processing apparatus,

wherein the image processing apparatus comprises

an audio input configured to input a user'"'"'s speech;

a storage configured to store a list of simple voice commands and an operation corresponding to each of the simple voice commands;

a communication device configured to communicate with the server which analyzes a descriptive voice command and determine an operation corresponding to the descriptive voice command;

an audio processor configured to process a voice command corresponding to the user'"'"'s speech and conduct the operation corresponding to a simple voice command in the list if the voice command is the simple voice command in the list, and configured to transmit the voice command to the server through the communication device if the voice command is not the simple voice command in the list; and

a controller configured to, if an operation for the voice command determined by the server corresponds to the simple voice command in the list, display a guide image which recommends the corresponding simple voice command in the list,

wherein the simple voice command is shorter than the descriptive voice command.

13. The image processing system of claim 12, wherein the storage is configured to store a list of simple sentence voice commands and operations corresponding to each simple sentence voice command.

14. An image processing apparatus comprising:

a display;

an audio input device configured to input a user'"'"'s speech; and

a controller configured to perform a preset first operation if a voice command corresponding to the user'"'"'s speech is any one of a first voice command of a simple sentence and a second voice command of a descriptive sentence,

wherein, in response to determining that the voice command corresponding to the user'"'"'s speech is the second voice command, the controller performs the preset first operation and displays, on the display, a guide image which recommends that the user uses the first voice command instead of the second voice command to perform the preset first operation a subsequent time, and

wherein the first voice command is shorter than the second voice command.