Remote control system, controller, program product, storage medium and server

• US 20060004743A1
• Filed: 06/15/2005
• Published: 01/05/2006
• Est. Priority Date: 06/15/2004
• Status: Abandoned Application

• Current Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Sanyo Electric Company Limited (Panasonic Holdings Corporation)
• Inventors: Murao, Hiroya, Ohkura, Kazumi, Nishikawa, Youichiro
• Application Number:
  US11/152,410
• Publication Number:
  US 20060004743A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

When a voice is inputted to an operation terminal (200), the audio input is subjected to voice recognition in a voice recognizing unit (107) and keywords are extracted. A search condition creating unit (110) creates a search condition from the extracted keywords. A search unit (111) searches for control items that can be options to choose from. These control items are displayed on a television screen by an output information creating unit (113). A user uses the operation terminal (200) as a pointing device to select and point a desired control item among the displayed control items. Thereafter, a “select” key of operation keys is operated to obtain control codes for this control item. The control codes are sent to a television set (300).

Claims

1. A remote control system with an operation terminal and a controller which outputs control information for controlling an appliance in accordance with an operation command inputted to the operation terminal, comprising:

audio inputting means for inputting audio information;

instruction inputting means for selecting and designating an item displayed on a screen;

candidate creating means for creating a group of candidate items which can be options to choose from, from the audio information inputted to the audio inputting means;

image information creating means for creating image information from the candidate item group created by the candidate creating means;

display means for displaying, on the screen, the image information created by the image information creating means;

determining means for determining which control item in the candidate item group displayed on the screen by the display means is selected and designated by the instruction inputting means; and

control information outputting means for outputting control information according to the control item that is determined by the determining means.

2. A remote control system according to claim 1, wherein the candidate creating means includes:

database means for storing control items in association with keywords;

text composing means for composing text data by using the audio information inputted from the audio inputting means; and

candidate extracting means for comparing the text data composed by the text composing means against keywords of control items stored in the database means, and extracting as candidates to choose from, control items that contain keywords matching a character string in the text.

3. A remote control system according to claim 2, wherein the candidate extracting means checks, for each control item, the degree at which the character string in the text matches the keywords (matching degree), and extracts control items that are candidates to choose from in a descending order by the matching degree.

4. A remote control system according to claim 3, wherein the candidate extracting means counts, for each control item, how many of terms that are contained in the character string in the text match the keywords (matching count), and extracts control items that are candidates to choose from in a descending order by the matching count.

5. A remote control system according to any one of claims 2 through 4, wherein the text composing means includes voice recognizing means for creating text data by performing voice recognition on the audio information inputted to the audio inputting means, and presents, for the candidate extracting means, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the inputted audio information.

6. A remote control system according to claim 1, wherein the candidate creating means includes a candidate group obtaining means for obtaining, from an external server, a group of candidate items that can be options to choose from by using the audio information inputted to the audio inputting means.

7. A remote control system according to claim 1, wherein the instruction inputting means includes a pointing device with which, when the operation terminal is pointed toward the screen, the pointed position is overlaid on the screen.

8. A remote control system according to claim 1, wherein the candidate creating means includes:

a synonym database for storing synonyms in association with keywords;

a control item database for storing control items in association with keywords;

text composing means for composing text data from the audio information inputted from the audio inputting means;

synonym displaying means for comparing the text data composed by the text composing means against keywords of synonyms stored in the synonym database to extract, as candidates to choose from, synonyms that are associated with keywords matching a character string in the text, and displaying the extracted synonyms on the screen as options to choose from; and

candidate extracting means for comparing synonyms that are designated by selection from the synonyms displayed on the screen by the synonym displaying means against keywords of control items stored in the control item database, and extracting, as candidates to choose from, control items that contain keywords matching a character string in the text.

9. A remote control system according to claim 8, wherein the candidate extracting means compares the synonyms that are designated by the selection designation information and other synonyms that are associated with keywords corresponding to the former synonyms in the synonym database against keywords of control items stored in the control item database, to thereby extract control items that are candidates to choose from.

10. A remote control system according to claim 8 or 9,

wherein the text composing means includes voice recognition means for creating text data by performing voice recognition of the audio information inputted by the audio inputting means, and presents, to the synonym displaying means, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the inputted audio information, and

wherein the synonym displaying means extracts the synonyms that are candidates to choose from, for the N voice recognition results, and displays an image containing the synonyms and the voice recognition results both as options on the screen.

11. A remote control system according to claim 10, wherein the synonym displaying means causes the screen to display an image containing, as options, the N voice recognition results and synonyms for the recognition result that is at the top of the recognition priority order among the N voice recognition results.

12. A remote control system according to claim 11, wherein, when one of the N displayed recognition results is selected and designated, the synonym displaying means causes the screen to display synonyms for the selected and designated recognition result in place of the synonyms that have been displayed.

13. A controller which outputs control information to control an appliance in accordance with operation input information received from an operation terminal, comprising:

candidate creating means for creating a group of candidate items that can be options to choose from by using operation input information inputted with a voice and received from the operation terminal;

image information creating means for creating image information from the candidate item group created by the candidate creating means;

display means for displaying the image information created by the image information creating means on a screen;

determining means for determining which control item in the candidate item group displayed on the screen by the display means is selected and designated by the operation input information received from the operation terminal; and

control information outputting means for outputting control information according to the control item that is determined by the determining means.

14. A controller according to claim 13, wherein the candidate creating means includes:

database means for storing control items in association with keywords;

text composing means for composing text data by using the operation input information inputted with a voice and received from the operation terminal; and

candidate extracting means for comparing the text data composed by the text composing means against keywords of control items stored in the database means, and extracting, as candidates to choose from, control items that contain keywords matching a character string in the text.

15. A controller according to claim 14, wherein the candidate extracting means checks, for each control item, the degree at which the character string in the text matches the keywords (matching degree), and extracts control items that are candidates to choose from in a descending order by the matching degree.

16. A controller according to claim 15, wherein the candidate extracting means counts, for each control item, how many of terms that are contained in the character string in the text match the keywords (matching count), and extracts control items that are candidates to choose from in a descending order by the matching count.

17. A controller according to any one of claims 14 through 16, wherein the text composing means includes voice recognizing means for creating text data by performing voice recognition on the audio information inputted to the audio inputting means, and presents, for the candidate extracting means, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the inputted audio information.

18. A controller according to claim 13, wherein the candidate creating means includes:

a synonym database for storing synonyms in association with keywords;

a control item database for storing control items in association with keywords;

text composing means for composing text data from the operation input information inputted with a voice and received from the operation terminal;

synonym displaying means for comparing the text data composed by the text composing means against keywords of synonyms stored in the synonym database to extract, as candidates to choose from, synonyms that are associated with keywords matching a character string in the text, and displaying the extracted synonyms on a screen as options to choose from; and

candidate extracting means for comparing synonyms that are designated by selection designation information sent from the operation terminal from the synonyms displayed on the screen by the synonym displaying means, against keywords of control items stored in the control item database, and extracting, as candidates to choose from, control items that contain keywords matching a character string in the text.

19. A controller according to claim 18, wherein the candidate extracting means compares the synonyms that are designated by the selection designation information and other synonyms that are associated with keywords corresponding to the former synonyms in the synonym database against keywords of control items stored in the control item database, to thereby extract control items that are candidates to choose from.

20. A controller according to claim 18 or 19,

wherein the text composing means includes voice recognition means for creating text data from voice recognition of the operation input information inputted with a voice, and presents, to the synonym displaying means, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the audio input, and

wherein the synonym displaying means extracts the synonyms that are the candidates to choose from, for the N voice recognition results, and displays an image containing the synonyms and the voice recognition results both as options on the screen.

21. A controller according to claim 20, wherein the synonym displaying means causes the screen to display an image containing, as options, the N voice recognition results and synonyms for the recognition result that is at the top of the recognition priority order among the N voice recognition results.

22. A controller according to claim 21, wherein, when one of the N displayed recognition results is selected and designated, the synonym displaying means causes the screen to display synonyms for the selected and designated recognition result in place of the synonyms that have been displayed.

23. A program product which gives a computer a function of executing processings in accordance with operation input information received from an operation terminal, the processings comprising:

a candidate creating processing for creating a group of candidate items that can be options to choose from by using operation input information inputted with a voice and received from the operation terminal;

an image information creating processing for creating image information from the candidate item group created by the candidate creating processing;

a display processing for displaying the image information created by the image information creating processing on a screen;

a determining processing for determining which control item in the candidate item group displayed on the screen by the display processing is selected and designated by the operation input information received from the operation terminal; and

a control information outputting processing for outputting control information according to the control item that is determined by the determining processing to a target device.

24. A program product according to claim 23, comprising a database for storing control items in association with keywords,

wherein the candidate creating processing includes:

a text composing processing for composing text data by using the operation input information inputted with a voice and received from the operation terminal; and

a candidate extracting processing for comparing the text data composed by the text composing processing against keywords of control items stored in the database, as candidates to choose from, control items that contain keywords matching a character string in the text.

25. A program product according to claim 24, wherein the candidate extracting processing includes checking, for each control item, the degree at which the character string in the text matches the keywords (matching degree), and extracting control items that are candidates to choose from in a descending order by the matching degree.

26. A program product according to claim 25, wherein the candidate extracting processing includes counting, for each control item, how many of terms that are contained in the character string in the text match the keywords (matching count), and extracting control items that are candidates to choose from in a descending order by the matching count.

27. A program product according to any one of claims 24 through 26, wherein the text composing processing includes a voice recognizing processing for creating text data by performing voice recognition on the audio information inputted to the audio inputting processing, and includes presenting, for the candidate extracting processing, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the inputted audio information.

28. A program product according to claim 23, further comprising:

a synonym database for storing synonyms in association with keywords; and

a control item database for storing control items in association with keywords,

wherein the candidate creating processing includes;

a text composing processing for composing text data from the operation input information inputted with a voice and received from the operation terminal;

a synonym displaying processing for comparing the text data composed by the text composing processing against keywords of synonyms stored in the synonym database to extract, as candidates to choose from, synonyms that are associated with keywords matching a character string in the text, and displaying the extracted synonyms on a screen as options to choose from; and

a candidate extracting processing for comparing synonyms that are designated by selection designation information sent from the operation terminal from the synonyms displayed on the screen by the synonym displaying processing, against keywords of control items stored in the control item database, and extracting control items that contain keywords matching a character string in the text.

29. A program product according to claim 28, wherein the candidate extracting processing includes comparing the synonyms that are designated by the selection designation information and other synonyms that are associated with keywords corresponding to the former synonyms in the synonym database against keywords of control items stored in the control item database, to thereby extract control items that are candidates to choose from.

30. A program product according to claim 28 or 29,

wherein the text composing processing includes a voice recognition processing for creating text data from voice recognition of the operation input information inputted with a voice, and includes presenting, to the synonym displaying processing, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the audio input, and

wherein the synonym displaying processing includes extracting the synonyms that are candidates to choose from, for the N voice recognition results, and displaying an image containing the synonyms and the voice recognition results both as options on the screen.

31. A program product according to claim 30, wherein the synonym displaying processing includes causing the screen to display an image containing, as options, the N voice recognition results and synonyms for the recognition result that is at the top of the recognition priority order among the N voice recognition results.

32. A program product according to claim 31, wherein, when one of the N displayed recognition results is selected and designated, the synonym displaying processing includes causing the screen to display synonyms for the selected and designated recognition result in place of the synonyms that have been displayed.

33. A storage medium which stores a program that gives a computer a function of executing processings in accordance with operation input information received from an operation terminal, the processings comprising:

a candidate creating processing for creating a group of candidate items that can be options to choose from by using operation input information inputted with a voice and received from the operation terminal;

an image information creating processing for creating image information from the candidate item group created by the candidate creating processing;

a display processing for displaying the image information created by the image information creating processing on a screen;

a determining processing for determining which control item in the candidate item group displayed on the screen by the display processing is selected and designated by the operation input information received from the operation terminal; and

a control information outputting processing for outputting control information according to the control item that is determined by the determining processing to a target device.

34. A storage medium according to claim 33, comprising a database for storing control items in association with keywords,

wherein the candidate creating processing includes:

a text composing processing for composing text data by using the operation input information inputted with a voice and received from the operation terminal; and

a candidate extracting processing for comparing the text data composed by the text composing processing against keywords of control items stored in the database, and extracting, as candidates to choose from, control items that contain keywords matching a character string in the text.

35. A storage medium according to claim 34, wherein the candidate extracting processing includes checking, for each control item, the degree at which the character string in the text matches the keywords (matching degree), and extracting control items that are candidates to choose from in a descending order by the matching degree.

36. A storage medium according to claim 35, wherein the candidate extracting processing includes counting, for each control item, how many of terms that are contained in the character string in the text match the keywords (matching count), and extracting control items that are candidates to choose from in a descending order by the matching count.

37. A storage medium according to any one of claims 34 through 36, wherein the text composing processing includes a voice recognizing processing for creating text data by performing voice recognition on the audio information inputted to the audio inputting processing, and includes presenting, for the candidate extracting processing, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the inputted audio information.

38. A storage medium according to claim 33, further comprising:

a synonym database for storing synonyms in association with keywords; and

a control item database for storing control items in association with keywords,

wherein the candidate creating processing includes;

a text composing processing for composing text data from the operation input information inputted with a voice and received from the operation terminal;

a synonym displaying processing in which the text data composed by the text composing processing is compared against keywords of synonyms stored in the synonym database to extract, as candidates to choose from, synonyms that are associated with keywords matching a character string in the text, and the extracted synonyms are displayed on a screen as options to choose from; and

a candidate extracting processing in which, of the synonyms displayed on the screen by the synonym displaying processing, synonyms that are associated with selection designation information sent from the operation terminal is compared against keywords of control items stored in the control item database, and control items that contain keywords matching a character string in the text are extracted as candidates to choose from.

39. A storage medium according to claim 38, wherein the candidate extracting processing includes comparing the synonyms that are designated by the selection designation information and other synonyms that are associated with keywords corresponding to the former synonyms in the synonym database against keywords of control items stored in the control item database, to thereby extract control items that are candidates to choose from.

40. A storage medium according to claim 38 or 39,

wherein the text composing processing includes voice recognition processing for creating text data from voice recognition of the operation input information inputted with a voice, and includes presenting, for the synonym displaying processing, as text data to be compared against the keywords, a text data group consisting of N (N is a natural number) most similar voice recognition results having high resemblance to the audio input, and

wherein the synonym displaying processing includes extracting the synonyms that are candidates to choose from, for the N voice recognition results, and displaying an image containing the synonyms and the voice recognition results both as options on the screen.

41. A storage medium according to claim 40, wherein the synonym displaying processing includes causing the screen to display an image containing, as options, the N voice recognition results and synonyms for the recognition result that is at the top of the recognition priority order among the N voice recognition results.

42. A storage medium according to claim 41, wherein, when one of the N displayed recognition results is selected and designated, the synonym displaying processing includes causing the screen to display synonyms for the selected and designated recognition result in place of the synonyms that have been displayed.

43. A server comprising:

communication means for communicating with a controller via a network;

candidate creating means for creating a group of candidate items that can be options to choose from by using audio information received from the controller; and

transmitting means for sending the candidate item group created by the candidate creating means to the controller by using the communication means.

44. A server according to claim 43,

wherein the candidate creating means includes, for each appliance, a database used in search for candidate items and, of these databases, a database for an appliance that can be a control target is set as a search database, from which a group of candidate items that can be options to choose from is obtained based on audio information received from the controller.

45. A server according to claim 44,

wherein the databases contain voice recognition dictionaries for voice recognition of the audio information, and

wherein the candidate creating means selects some of the voice recognition dictionaries that are for appliances that can be control targets, and merges the selected voice recognition dictionaries to obtain one voice recognition dictionary, which is set to be used in voice recognition of audio information received from the controller, and results of the voice recognition are used to obtain a group of candidate items that can be options to choose from.

46. A server according to claim 44 or 45, wherein the candidate creating means includes an appliance database in which appliance information is registered and sorted in association with user, and uses appliance information registered in the appliance database to specify databases associated with appliances that can be control targets.

47. A server according to claim 43,

wherein the candidate creating means includes:

status information obtaining means for obtaining, from the controller, information on an operation status of an appliance that can be control target; and

determining means for determining, from the obtained status information, whether a group of candidate items that can be control targets is appropriate or not, and

wherein a result of the determination is used to limit a group of control items that can be options to choose from.