Methods and systems for speech adaptation data

• US 9,305,565 B2
• Filed: 09/10/2012
• Issued: 04/05/2016
• Est. Priority Date: 05/31/2012
• Status: Expired due to Fees

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A.
• Primary Examiner(s): Neway, Samuel G
• Application Number:
  US13/609,143
• Publication Number:
  US 20130325452A1
• Time in Patent Office: 1,303 Days
• Field of Search: 704200-504
• US Class Current: 1/1
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/07 to the speaker
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence

Abstract

Computationally implemented methods and systems include receiving speech data correlated to one or more words spoken by a particular party, receiving adaptation data that is at least partly based on at least one speech interaction of a particular party that is discrete from the received speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party, obtaining target data regarding a target configured to process at least a portion of the received speech data, and determining whether to apply the adaptation data for processing at least a portion of the received speech data, at least partly based on the acquired target data. In addition to the foregoing, other aspects are described in the claims, drawings, and text.

Claims

1. A computationally-implemented method, comprising:

receiving speech data correlated to one or more words spoken by a particular party;

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party;

obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data;

applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device; and

transmitting adaptation result data that is based on at least one aspect of the speech data.

2. The computationally-implemented method of claim 1, wherein said receiving speech data correlated to one or more words spoken by a particular party includes:

receiving speech data comprising a representation of speech that is spoken by the particular party.

3. The computationally-implemented method of claim 2, wherein said receiving speech data comprising a representation of speech that is spoken by the particular party includes:

receiving speech data corresponding to received speech spoken by the particular party that has been at least partially processed.

4. The computationally-implemented method of claim 1, wherein said receiving speech data correlated to one or more words spoken by a particular party includes:

receiving, from a further device, speech data correlated to one or more words spoken by a particular party.

5. The computationally-implemented method of claim 4, wherein said receiving, from a further device, speech data correlated to one or more words spoken by a particular party includes:

receiving, from the further device, audio data derived from one or more words spoken by the particular party.

6. The computationally-implemented method of claim 5, wherein said receiving, from the further device, audio data derived from one or more words spoken by the particular party includes:

receiving, from the further device, audio data derived by the further device from one or more words spoken by the particular party and detected by the particular device.

7. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data from a further device, said adaptation data at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party.

8. The computationally-implemented method of claim 7, wherein said receiving adaptation data from a further device, said adaptation data at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party includes:

receiving adaptation data from a further device, said adaptation data originating at the further device and at least partly based on least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party.

9. The computationally-implemented method of claim 7, wherein said receiving adaptation data from a further device, said adaptation data at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party includes:

receiving adaptation data from a further device related to the particular device, said adaptation data originating at the further device and at least partly based on least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party.

10. The computationally-implemented method of claim 9, wherein said receiving adaptation data from a further device related to the particular device, said adaptation data originating at the further device and at least partly based on least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party includes:

receiving adaptation data from a further device associated with the particular party, said adaptation data originating at the further device and at least partly based on least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party.

11. The computationally-implemented method of claim 7, wherein said receiving adaptation data from a further device, said adaptation data at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party includes:

receiving adaptation data from a further device, said adaptation data received by the further device from the particular device, and said adaptation data at least partly based on least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on the particular device associated with the particular party.

12. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that used one or more same utterances as speech used in the speech data, said one or more same utterances spoken to a different device than a target device to which the detected speech data is directed.

13. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data was collected by the particular device associated with the particular party.

14. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data is temporarily stored on the particular device associated with the particular party until it is deposited at a remote server.

15. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data was transmitted from a first device to a second device using the particular device associated with the particular party as a conduit configured to facilitate the transmission.

16. The computationally-implemented method of claim 1, wherein said receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party includes:

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data; and

adding further data to the received adaptation data.

17. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

generating an indication from a speech processing component that the adaptation data is configured to be applied to the target device to assist in processing at least a portion of the speech data.

18. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

generating target device data indicating whether the target device is configured to process at least a portion of the received speech data.

19. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

determining whether the speech data is configured to be processed by a speech recognition component of the target device to which the adaptation data has been applied; and

generating target device data regarding the target device based on the determination.

20. The computationally-implemented method of claim 19, wherein said generating target device data regarding the target device based on the determination includes:

analyzing at least a portion of the speech data; and

generating target device data regarding the target device at least partly based on a result of analyzing the at least a portion of the speech data.

21. The computationally-implemented method of claim 20, wherein said analyzing at least a portion of the speech data includes:

analyzing at least a portion of the speech data using a speech recognition component to which the adaptation data has been applied.

22. The computationally-implemented method of claim 21, wherein said analyzing at least a portion of the speech data using a speech recognition component to which the adaptation data has been applied includes:

analyzing at least a portion of the speech data using a speech recognition component of the target device to which the adaptation data has been applied.

23. The computationally-implemented method of claim 21, wherein said analyzing at least a portion of the speech data using a speech recognition component to which the adaptation data has been applied includes:

analyzing at least a portion of the speech data using a speech recognition component of a further device to which the adaptation data has been applied.

24. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

determining whether the target device is configured to process the speech data; and

generating target device data indicating whether the target device is configured to process at least a portion of the speech data based on the determination regarding the target device.

25. The computationally-implemented method of claim 24, wherein said determining whether the target device is configured to process the speech data includes:

analyzing at least a portion of the speech data; and

determining that the target device is configured to process the speech data at least partly based on the analysis of the speech data.

26. The computationally-implemented method of claim 24, wherein said determining whether the target device is configured to process the speech data includes:

extracting data from the speech data indicating a type of target device that is configured to process the speech data; and

determining that a type of the target device is the same as the type of target device indicated by the extracted data.

27. The computationally-implemented method of claim 26, wherein said extracting data from the speech data indicating a type of target device that is configured to process the speech data includes:

extracting data from the speech data indicating a manufacturer of one or more target devices that are configured to process the speech data.

28. The computationally-implemented method of claim 24, wherein said determining whether the target device is configured to process the speech data includes:

converting the speech data into data that is recognizable by a target device.

29. The computationally-implemented method of claim 28, wherein said converting the speech data into data that is recognizable by a target device includes:

converting the speech data into one or more commands or command modifiers configured to be recognized by a control component of the target device.

30. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

receiving target device data regarding a target device configured to process at least a portion of the speech data.

31. The computationally-implemented method of claim 30, wherein said receiving target device data regarding a target device configured to process at least a portion of the speech data includes:

receiving target device data regarding a target device configured to process at least a portion of the speech data from a further device that is different than the particular device.

32. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

receiving data identifying the target device configured to process at least a portion of the speech data.

33. The computationally implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

receiving an address of a target device configured to process at least a portion of the speech data.

34. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

acquiring target device data regarding an intended application module configured to process at least a portion of the speech data.

35. The computationally-implemented method of claim 34, wherein said acquiring target device data regarding an intended application module configured to process at least a portion of the speech data includes:

acquiring target device data regarding an intended application module configured to process at least a portion of the speech data, wherein at least a portion of said processing is configured to be facilitated by the adaptation data.

36. The computationally-implemented method of claim 34, wherein said acquiring target device data regarding an intended application module configured to process at least a portion of the speech data includes:

acquiring target device data regarding a speech data processing capability of an intended application module configured to process at least a portion of the speech data.

37. The computationally-implemented method of claim 1, wherein said obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data includes:

acquiring target device data regarding a first application module configured to process at least a portion of the speech data, and a second application module configured to process at least a portion of the speech data.

38. The computationally-implemented method of claim 37, wherein said acquiring target device data regarding a first application module configured to process at least a portion of the speech data, and a second application module configured to process at least a portion of the speech data includes:

acquiring target device data regarding a word processing application module configured to process at least a portion of the speech data, and a speech recognition application module configured to process at least a portion of the speech data.

39. The computationally-implemented method of claim 37, wherein said acquiring target device data regarding a first application module configured to process at least a portion of the speech data, and a second application module configured to process at least a portion of the speech data includes:

acquiring target device data regarding a word processing application module configured to process at least a portion of the speech data, and an operating system module configured to process at least a portion of the speech data.

40. The computationally-implemented method of claim 37, wherein said acquiring target device data regarding a first application module configured to process at least a portion of the speech data, and a second application module configured to process at least a portion of the speech data includes:

acquiring target device data regarding a word processing application module configured to process at least a portion of the speech data, and a spreadsheet processing application module configured to process at least a portion of the speech data.

43. The computationally-implemented method of claim 1, wherein said applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device includes:

applying the adaptation data for processing at least a portion of the speech data according to whether the target device data indicates a presence of one or more applications configured to process the speech data.

44. The computationally-implemented method of claim 1, wherein said applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device includes:

applying the adaptation data for processing at least a portion of the speech data according to whether the target device data includes one or more characteristics of one or more applications of a target device.

45. The computationally-implemented method of claim 1, wherein said applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device includes:

applying the adaptation data for processing at least a portion of the speech data at least partly based on a preference flag set on one or more applications.

46. The computationally-implemented method of claim 1, wherein said applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device includes:

applying the adaptation data for processing at least a portion of the speech data at least partly based on a decision by an operating system of the target device configured to process at least a portion of the speech data, when the target device data indicates that there are one or more applications present configured to process the speech data.

47. The computationally-implemented method of claim 1, wherein said transmitting adaptation result data that is based on at least one aspect of the speech data includes:

transmitting adaptation result data indicating that a determination was made regarding an intended target of the speech data.

48. The computationally-implemented method of claim 1, wherein said transmitting adaptation result data that is based on at least one aspect of the speech data includes:

transmitting adaptation result data that is based on a measure of success of at least one portion of a speech-facilitated transaction corresponding to the speech data.

49. The computationally-implemented method of claim 48, wherein said transmitting adaptation result data that is based on a measure of success of at least one portion of a speech-facilitated transaction corresponding to the speech data includes:

transmitting adaptation result data that includes a representation of success of at least one portion of a speech-facilitated transaction corresponding to the speech data.

50. The computationally-implemented method of claim 49, wherein said transmitting adaptation result data that includes a representation of success of at least one portion of a speech-facilitated transaction corresponding to the speech data includes:

transmitting adaptation result data that includes a numeric representation of success of at least one portion of a speech-facilitated transaction corresponding to the speech data.

51. The computationally-implemented method of claim 50, wherein said transmitting adaptation result data that includes a numeric representation of success of at least one portion of a speech-facilitated transaction corresponding to the speech data includes:

transmitting a confidence rate of correct interpretation of at least one portion of the speech-facilitated transaction corresponding to the received speech data.

54. The computationally-implemented method of claim 1, wherein said particular device associated with the particular party includes:

at least one mobile device associated with the particular party by at least one of;

a contract with a telecommunications provider associating the mobile device with the particular party, ownership of the mobile device by the particular party, information stored on the at least one mobile device identifying the particular party, or detected usage of the mobile device by the particular party.

41. A computationally-implemented method comprising:

receiving speech data correlated to one or more words spoken by a particular party;

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party;

obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data;

applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data at least partly based on the target device data indicating that the speech data has arrived at a device other than the target device;

transmitting adaptation result data that is based on at least one aspect of the speech data.

42. A computationally-implemented method comprising:

receiving speech data correlated to one or more words spoken by a particular party;

receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party;

obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data;

applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data at least partly based on the target device data indicating that there are one or more other target devices present that are configured to apply the adaptation data for processing at least a portion of the speech data; and

transmitting adaptation result data that is based on at least one aspect of the speech data.

52. A computationally-implemented system, comprising

circuitry for receiving speech data correlated to one or more words spoken by a particular party;

circuitry for receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party;

circuitry for obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data;

circuitry for applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device; and

circuitry for transmitting adaptation result data that is based on at least one aspect of the speech data.

53. A device defined by a computational language comprising:

one or more interchained physical machines ordered for receiving speech data correlated to one or more words spoken by a particular party;

one or more interchained physical machines ordered for receiving adaptation data that is at least partly based on at least one speech interaction of the particular party that is discrete from the speech data, wherein at least a portion of the adaptation data has been stored on a particular device associated with the particular party;

one or more interchained physical machines ordered for obtaining target device data indicating whether a target device in communication with the particular device associated with the particular party is configured to process at least a portion of the speech data;

one or more interchained physical machines ordered for applying, at least partially via the target device, the adaptation data for processing at least a portion of the speech data, at least partly based on the target device data indicating that the speech data has arrived at an intended target device; and

one or more interchained physical machines ordered for transmitting adaptation result data that is based on at least one aspect of the speech data.