Voice chat system, information processing apparatus, speech recognition method, keyword data electrode detection method, and program for speech recognition

• US 8,620,658 B2
• Filed: 04/14/2008
• Issued: 12/31/2013
• Est. Priority Date: 04/16/2007
• Status: Active Grant

• Current Assignee: So-Net Entertainment Corporation (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Original Assignee: So-Net Entertainment Corporation (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Inventors: Nakade, Motoki, Ogawa, Hiroaki, Honda, Hitoshi, Kurata, Yoshinori, Ishizuka, Daisuke
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US12/102,158
• Publication Number:
  US 20090055185A1
• Time in Patent Office: 2,087 Days
• Field of Search: 704/9, 704/10, 704/235, 704/246, 704/251, 704/270, 704/271, 704/257, 704/275, 704/256, 704/270.1
• US Class Current: 704/257
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A voice chat system includes a plurality of information processing apparatuses that performs a voice chat while performing speech recognition and a search server connected to the plural information processing apparatuses via a communication network. The search server discloses a search keyword list containing the search keywords searched by the search server to at least one of the plural information processing apparatuses. The at least one information processing apparatus includes a recognition word dictionary generating unit that acquires the search keyword list from the search server to generate a recognition word dictionary containing words for use in the speech recognition, and a speech recognition unit that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the recognition word dictionary.

Claims

1. A voice chat system, comprising:

a plurality of information processing apparatuses that perform a voice chat while performing speech recognition; and

a search server connected to the plural information processing apparatuses via a communication network,

wherein the search server discloses a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to at least one of the information processing apparatuses, the at least one information processing apparatus comprising;

a recognition word dictionary generating unit that acquires the search keyword list from the search server to generate a recognition word dictionary containing words for use in the speech recognition;

a speech recognition unit that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the recognition word dictionary;

a voice conversation control unit that performs communication control of the voice data with at least one information processing apparatus; and

a keyword detection unit that detects keywords related to the content of the conversation during the voice chat from the result of the speech recognition,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

2. An information processing apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list and performing a voice chat with other information processing apparatus, the apparatus comprising:

a recognition word dictionary generating unit that acquires the search keyword list from the search server to generate a recognition word dictionary containing words for use in the speech recognition;

a speech recognition unit that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the recognition word dictionary;

a voice conversation control unit that performs communication control of the voice data with the other information processing apparatus; and

a keyword detection unit that detects keywords related to the content of the conversation during the voice chat from the result of the speech recognition,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

3. The information processing apparatus according to claim 2, wherein the recognition word dictionary includes:

a fixed word dictionary in which predetermined words are pre-registered; and

a variable word dictionary in which registered words are updated on an as needed basis, and

wherein the recognition word dictionary generating unit selects words to be registered in the variable word dictionary from the search keyword list that contains higher-rank search keywords of the search server to generate the variable word dictionary.

4. The information processing apparatus according to claim 3, wherein the recognition word dictionary generating unit determines a preference of a user of the information processing apparatus based on history information of the keywords detected by the keyword detection unit and selects the words from the search keyword list based on the preference.

5. The information processing apparatus according to claim 3, wherein the recognition word dictionary generating unit searches for the words selected from the search keyword list using the search server and acquires a sub-keyword related to the words from a search result obtained by the search, thereby registering the sub-keyword in the variable word dictionary in a correlated manner with the words.

6. The information processing apparatus according to claim 3, wherein the recognition word dictionary generating unit applies a weight to the respective words selected from the search keyword list based on search rank information that is determined by a frequency of the words being searched by the search server.

7. The information processing apparatus according to claim 6, wherein the recognition word dictionary generating unit calculates a frequency of the keywords based on history information of the keywords detected by the keyword detection unit and changes the weight of the words registered in the variable word dictionary and corresponding to the keywords.

8. An information processing apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list, selecting words from the search keyword list, acquiring, from a recognition word dictionary generating device that applies weight information for use in speech recognition to the selected words, the words having the weight information applied thereto, and performing a voice chat with other information processing apparatus, the apparatus comprising:

a speech recognition unit that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the words acquired from the recognition word dictionary generating device;

a voice conversation control unit that performs communication control of the voice data with the other information processing apparatus; and

a keyword detection unit that detects keywords related to the content of the conversation during the voice chat from the result of the speech recognition,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

9. A speech recognition method used in an information processing apparatus, the apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list and performing a voice chat with other information processing apparatus, the method comprising the steps of:

acquiring the search keyword list from the search server to generate a recognition word dictionary containing words for used in speech recognition;

obtaining voice data from the content of the conversation during the voice chat;

analyzing the voice data based on an acoustic feature of the voice data and generating word sequence candidates corresponding to the content of the conversation; and

analyzing the generated word sequence candidates based on a linguistic concatenation feature between the words that constitute the word sequence by referencing a recognition database for use in the speech recognition containing the recognition word dictionary, thereby selecting a most feasible word sequence,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

10. A speech recognition method used in an information processing apparatus, the apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list, selecting words from the search keyword list, acquiring, from a recognition word dictionary generating device that applies weight information for use in speech recognition to the selected words, the words having the weight information applied thereto, and performing a voice chat with other information processing apparatus, the method comprising the steps of:

acquiring the words having the weight information applied thereto from the recognition word dictionary generating device and storing the words in a recognition database for use in speech recognition;

obtaining voice data from the content of the conversation during the voice chat;

analyzing the voice data based on an acoustic feature of the voice data and generating word sequence candidates corresponding to the content of the conversation; and

analyzing the generated word sequence candidates based on a linguistic concatenation feature between the words that constitute the word sequence by referencing the recognition database, thereby selecting a most feasible word sequence,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

11. A non-transitory storage medium storing a program for a computer that controls an information processing apparatus, the apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list and performing a voice chat with other information processing apparatus, the program allowing the computer to execute:

a recognition word dictionary generating function that acquires the search keyword list from the search server to generate a recognition word dictionary containing words for use in the speech recognition;

a speech recognition function that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the recognition word dictionary;

a voice conversation control function that performs communication control of the voice data with the other information processing apparatus; and

a keyword detection function that detects keywords related to the content of the conversation during the voice chat from the result of the speech recognition,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

12. A non-transitory storage medium storing a program for a computer that controls an information processing apparatus, the apparatus acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list, selecting words from the search keyword list, acquiring, from a recognition word dictionary generating device that applies weight information for use in speech recognition to the selected words, the words having the weight information applied thereto, and performing a voice chat with other information processing apparatus, the program allowing the computer to execute:

a speech recognition function that performs speech recognition on voice data obtained from a dialog of the conversation during the voice chat by referencing a recognition database containing the words acquired from the recognition word dictionary generating device;

a voice conversation control function that performs communication control of the voice data with the other information processing apparatus; and

a keyword detection function that detects keywords related to the content of the conversation during the voice chat from the result of the speech recognition,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

13. An information processing apparatus, comprising:

a recognition word dictionary generating unit that acquires, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in language recognition;

a broadcast text information receiving unit that receives broadcast text information transmitted from a broadcasting station;

a keyword detection unit that detects predetermined keywords from the broadcast text information by referencing the recognition word dictionary; and

an external display device connection control unit that performs connection control with an external display device and outputs the keywords detected from the broadcast text information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

14. The information processing apparatus according to claim 13, wherein the broadcast text information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving and the broadcast text information corresponding to the broadcast channel from the external display device connected to the information processing apparatus.

15. The information processing apparatus according to claim 13, wherein the broadcast text information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving, from the external display device connected to the information processing apparatus, and acquires the broadcast text information corresponding to the broadcast channel from the broadcasting station.

16. The information processing apparatus according to claim 13,

wherein the information processing apparatus stores a reference history of the keywords in the external display device, and

wherein the external display device connection control unit notifies the search engine of a keyword selected by the external display device.

17. An information processing apparatus, comprising:

a recognition word dictionary generating unit that acquires, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in speech recognition;

a broadcast audio information receiving unit that receives broadcast audio information transmitted from a broadcasting station;

a speech recognition unit that performs speech recognition on the broadcast audio information by referencing a recognition database containing the recognition word dictionary;

a keyword detection unit that detects predetermined keywords from the result of the speech recognition on the broadcast audio information; and

an external display device connection control unit that performs connection control with an external display device and outputs the keywords detected from the broadcast audio information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

18. The information processing apparatus according to claim 17, wherein the broadcast audio information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving and the broadcast audio information corresponding to the broadcast channel from the external display device connected to the information processing apparatus.

19. The information processing apparatus according to claim 17, wherein the broadcast audio information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving, from the external display device connected to the information processing apparatus, and acquires the broadcast audio information corresponding to the broadcast channel from the broadcasting station.

20. The information processing apparatus according to claim 17, wherein the information processing apparatus stores a reference history of the keywords in the external display device, and

wherein the external display device connection control unit notifies the search engine of a keyword selected by the external display device.

21. A keyword detection method, comprising the steps of:

acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in language recognition;

receiving broadcast text information transmitted from a broadcasting station;

detecting predetermined keywords from the broadcast text information by referencing the recognition word dictionary; and

performing connection control with an external display device and outputting the keywords detected from the broadcast text information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

22. A keyword detection method, comprising the steps of:

acquiring, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in speech recognition;

receiving broadcast audio information transmitted from a broadcasting station;

performing speech recognition on the broadcast audio information by referencing a recognition database containing the recognition word dictionary;

detecting predetermined keywords from the result of the speech recognition on the broadcast audio information; and

performing connection control with an external display device and outputting the keywords detected from the broadcast audio information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

23. A non-transitory storage medium storing a program for allowing a computer to realize:

a recognition word dictionary generating function that acquires, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in language recognition;

a broadcast text information receiving function that receives broadcast text information transmitted from a broadcasting station;

a keyword detection function that detects predetermined keywords from the broadcast text information by referencing the recognition word dictionary; and

an external display device connection control function that performs connection control with an external display device and outputs the keywords detected from the broadcast text information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

24. A non-transitory storage medium storing a program for allowing a computer to realize:

a recognition word dictionary generating function that acquires, from a search server, a search keyword list containing the search keywords searched by the search server and rank information associated with the search keyword list to generate a recognition word dictionary containing words for use in speech recognition;

a broadcast audio information receiving function that receives broadcast audio information transmitted from a broadcasting station;

a speech recognition function that performs speech recognition on the broadcast audio information by referencing a recognition database containing the recognition word dictionary;

a keyword detection function that detects predetermined keywords from the result of the speech recognition on the broadcast audio information; and

an external display device connection control function that performs connection control with an external display device and outputs the keywords detected from the broadcast audio information to the external display device,

wherein the search server represents a website that provides a keyword search service and a directory search service so that a user uses the search server to search for information available through Internet.

25. A voice chat system, comprising:

a plurality of information processing apparatuses that performs a voice chat;

a keyword extraction database referenced by the information processing apparatuses when extracting keywords from a dialog of the conversation during the voice chat; and

a search engine used by the information processing apparatuses when searching for the keywords and articles related to the keywords using the extracted keywords, the search engine disclosing to at least one information processing apparatus a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list,

wherein at least one information processing apparatus includes;

a parameter extraction unit that extracts a parameter from voice data generated from the dialog, the parameter characterizing the voice data;

a keyword extraction unit that recognizes the generated voice data and extracts the keywords from the voice data based on the parameter and the keyword extraction database;

an information search unit that searches for the extracted keywords using the search engine and acquires a search result for the keywords and the articles related to the keywords;

a display unit that displays a keyword that is correlated with address information of the search result for the keyword and an article that is correlated with address information of the articles related to the keywords; and

a keyword synchronization unit that transmits the extracted keywords to an information processing apparatus, which is a counterpart of the chat, and performs keyword synchronization with the counterpart information processing apparatus,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

26. An information processing apparatus performing voice chat with other information processing apparatus, the apparatus comprising:

a parameter extraction unit that extracts a parameter from voice data generated from a dialog of the conversation during the voice chat, the parameter characterizing the voice data;

a keyword extraction unit that recognizes the generated voice data and extracts keywords from the voice data based on the parameter and a keyword extraction database;

an information search unit that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords, the information search unit acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

a search information accumulation unit that accumulates the keywords and the articles in a correlated manner with address information of the search result for the keywords and address information of the articles, respectively,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

27. The information processing apparatus according to claim 26, further comprising a keyword synchronization unit that transmits the extracted keywords to an information processing apparatus, which is a counterpart of the chat, and performs keyword synchronization with the counterpart information processing apparatus.

28. The information processing apparatus according to claim 26, further comprising a database memory unit that stores the keyword extraction database.

29. The information processing apparatus according to claim 26, wherein the search engine is provided within the information processing apparatus.

30. The information processing apparatus according to claim 26, further comprising a display unit that displays a keyword that is correlated with address information of the search result for the keyword and an article that is correlated with address information of the articles related to the keywords.

31. The information processing apparatus according to claim 26, further comprising a reference history memory unit that stores a reference history of the keywords.

32. The information processing apparatus according to claim 31, wherein the reference history memory unit stores the referenced keywords in a correlated manner with an identifier assigned to the respective chat and a counterpart of the chat.

33. The information processing apparatus according to claim 31, wherein the keyword extraction unit extracts a keyword placed at a higher rank of the reference history on a preferential basis.

34. The information processing apparatus according to claim 26, wherein the keyword extraction unit extracts a higher-rank search keyword of the search engine on a preferential basis.

35. An information processing apparatus performing voice chat with other information processing apparatus, the at least one information processing apparatus comprising:

a parameter extraction unit that extracts a parameter from voice data generated from a dialog of the conversation during the voice chat, the parameter characterizing the voice data;

a keyword extraction unit that recognizes the generated voice data and extracts keywords from the voice data based on the parameter and a keyword extraction database;

an information search unit that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords, the information search unit acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

a search information accumulation unit that accumulates the keywords and the articles in a correlated manner with address information of the search result for the keywords and address information of the articles, respectively,

wherein the information processing apparatus comprises a keyword synchronization unit that receives the keywords transmitted from the at least one information processing apparatus and performs keyword synchronization with the corresponding information processing apparatus,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

36. A non-transitory storage medium storing a program for allowing a computer to realize:

a parameter extraction function that extracts a parameter from voice data generated from a dialog of the conversation during the voice chat, the parameter characterizing the voice data;

a keyword extraction function that recognizes the generated voice data and extracts keywords from the voice data based on the parameter and a keyword extraction database;

an information search function that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords, the information searching function acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

a search information storage function that stores the keywords and the articles in a correlated manner with address information of the search result for the keywords and address information of the articles, respectively,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

37. A non-transitory storage medium storing a program for allowing a computer to realize:

a keyword synchronization function that receives keywords transmitted from at least one information processing apparatus and performs keyword synchronization with the corresponding information processing apparatus,

wherein the keywords are extracted from a speech of a user with reference to a keyword list and associated rank information provided by a search engine representing a that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

38. An information processing apparatus, comprising:

a broadcast text information receiving unit that receives broadcast text information transmitted from a broadcasting station;

a keyword extraction unit that extracts keywords from the broadcast text information based on a keyword extraction database;

an information search unit that searches for the extracted keywords using a search engine and acquires articles related to the keywords, the information search unit acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

an external display device connection control unit that performs connection control with an external display device and outputs the keywords, a search result for the keywords, and articles related to the keywords to the external display device,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

39. The information processing apparatus according to claim 38, wherein the broadcast text information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving and the broadcast text information corresponding to the broadcast channel from the external display device connected to the information processing apparatus.

40. The information processing apparatus according to claim 38, wherein the broadcast text information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving, from the external display device connected to the information processing apparatus, and acquires the broadcast text information corresponding to the broadcast channel from the broadcasting station.

41. The information processing apparatus according to claim 38, further comprising a reference history memory unit that stores a reference history of the keywords in the external display device,

wherein the external display device connection control unit notifies the search engine of a keyword selected by the external display device.

42. The information processing apparatus according to claim 38, further comprising a keyword synchronization unit that transmits the extracted keywords to at least one information processing apparatus and performs keyword synchronization with the at least one information processing apparatus.

43. An information processing apparatus, comprising:

a broadcast audio information receiving unit that receives broadcast audio information transmitted from a broadcasting station;

a parameter extraction unit that extracts a parameter from voice data contained in the broadcast audio information, the parameter characterizing the voice data;

a keyword extraction unit that recognizes the voice data and extracts keywords from the voice data based on the parameter and a keyword extraction database;

an information search unit that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords, the information search unit acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

an external display device connection control unit that performs connection control with an external display device and outputs the keywords, the search result for the keywords, and the articles related to the keywords to the external display device,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

44. The information processing apparatus according to claim 43, wherein the broadcast audio information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving and the broadcast audio information corresponding to the broadcast channel from the external display device connected to the information processing apparatus.

45. The information processing apparatus according to claim 43, wherein the broadcast audio information receiving unit acquires reception channel information concerning a broadcast channel through which the external display device is receiving, from the external display device connected to the information processing apparatus, and acquires the broadcast audio information corresponding to the broadcast channel from the broadcasting station.

46. The information processing apparatus according to claim 43, further comprising a reference history memory unit that stores a reference history of the keywords in the external display device,

wherein the external display device connection control unit notifies the search engine of a keyword selected by the external display device.

47. The information processing apparatus according to claim 43, further comprising a keyword synchronization unit that transmits the extracted keywords to at least one information processing apparatus and performs keyword synchronization with the at least one information processing apparatus.

48. A non-transitory storage medium storing a program for allowing a computer to realize:

a broadcast text information receiving function that receives broadcast text information broadcast from a broadcasting station;

a keyword extraction function that extracts keywords from the broadcast text information based on a keyword extraction database;

an information search function that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords, the information search function acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

an external display device connection control function that performs connection control with an external display device and outputs the keywords, the search result for the keywords, and the articles related to the keywords to the external display device,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.

49. A non-transitory storage medium storing a program for allowing a computer to realize:

a broadcast audio information receiving function that receives broadcast audio information transmitted from a broadcasting station;

a parameter extraction function that extracts a parameter from voice data contained in the broadcast audio information, the parameter characterizing the voice data;

a keyword extraction function that recognizes the voice data and extracts keywords from the voice data based on the parameter and a keyword extraction database;

an information search function that searches for the extracted keywords using a search engine and acquires a search result for the keywords and articles related to the keywords the information search function acquiring from the search engine a search keyword list containing search keywords searched by the search engine and rank information associated with the search keyword list; and

an external display device connection control function that performs connection control with an external display device and outputs the keywords, the search result for the keywords, and the articles related to the keywords to the external display device,

wherein the search engine represents a website that provides a keyword search service and a directory search service so that a user uses the search engine to search for information available through Internet.