Configuring Dynamic Custom Vocabulary for Personalized Speech Recognition

• US 20150106096A1
• Filed: 10/15/2013
• Published: 04/16/2015
• Est. Priority Date: 10/15/2013
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Inventors: Toopran, Divya Sai, Rai, Vinuth, Parundekar, Rahul
• Granted Patent: US 9,484,025 B2
• Time in Patent Office: Days
• US Class Current: 704/244
• CPC Class Codes: G10L 15/193 Formal grammars, e.g. finite state automata, context free grammars or word networks
• CPC Class Codes: G10L 2015/228 of application context

Abstract

The disclosure includes a system and method for configuring custom vocabularies for personalized speech recognition. The system includes a processor and a memory storing instructions that when executed cause the system to: detect a provisioning trigger event; determine a state of a journey associated with a user based on the provisioning trigger event; determine one or more interest places based on the state of the journey; populate a place vocabulary associated with the user using the one or more interest places; filter the place vocabulary based on one or more place filtering parameters; and register the filtered place vocabulary for the user.

Claims

1. A computer-implemented method comprising:

detecting a provisioning trigger event;

determining a state of a journey associated with a user based on the provisioning trigger event;

determining one or more interest places based on the state of the journey;

populating a place vocabulary associated with the user using the one or more interest places;

filtering the place vocabulary based on one or more place filtering parameters; and

registering the filtered place vocabulary for the user.

2. The method of claim 1, wherein the one or more place filtering parameters include a first location associated with the user and filtering the place vocabulary comprises:

determining a coverage radius based on the first location;

determining a coverage range using the coverage radius and the first location; and

generating the filtered place vocabulary that includes one or more custom place terms corresponding to one or more second locations within the coverage range.

3. The method of claim 1, further comprising:

receiving a speech command from the user;

recognizing one or more custom place terms in the speech command based on the registered place vocabulary;

sending data describing the speech command that includes the one or more custom place terms; and

receiving a result that matches the speech command including the one or more custom place terms.

4. The method of claim 1, further comprising:

receiving navigation data associated with the user;

processing the navigation data to identify a travel route and one or more stop points;

determining one or more road names associated with the travel route;

determining one or more landmarks associated with the travel route; and

populating the place vocabulary further based on the one or more stop points, the one or more landmarks and the one or more road names.

5. The method of claim 1, further comprising:

receiving social network data associated with the user; and

determining the one or more interest places further based on location data included in the social network data.

6. The method of claim 5, further comprising:

receiving search data associated with the user; and

determining the one or more interest places further based on the search data.

7. The method of claim 1, further comprising:

receiving contacts data associated with the user; and

determining the one or more interest places further based on location data in the contacts data.

8. The method of claim 7, further comprising:

receiving search data associated with the user; and

determining the one or more interest places further based on the search data.

9. The method of claim 1, further comprising:

receiving search data associated with the user; and

determining the one or more interest places further based on the search data.

10. The method of claim 1, wherein:

the journey includes a future journey;

the state of the journey includes a journey start time for the future journey; and

the place vocabulary is populated and registered before the journey start time.

11. A computer-implemented method comprising:

detecting a provisioning trigger event;

determining a state of a journey associated with a user based on the provisioning trigger event;

receiving contact data describing one or more contacts associated with the user;

receiving social graph data describing a social graph associated with the user;

receiving location data associated with the user;

populating a contact vocabulary associated with the user based on the contact data, the social graph data, contact information associated with the location data and the state of the journey;

filtering the contact vocabulary based on one or more contact filtering parameters; and

registering the filtered contact vocabulary for the user.

12. A computer-implemented method comprising:

detecting a provisioning trigger event;

determining a state of a journey associated with a user based on the provisioning trigger event;

receiving content data describing one or more content items;

receiving data describing one or more content sources;

populating a content vocabulary associated with a user based on the content data, the one or more content sources and the state of the journey;

filtering the content vocabulary based on one or more content filtering parameters; and

registering the filtered content vocabulary for the user.

13. A computer program product comprising a computer usable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

determine one or more interest places based on the state of the journey;

populate a place vocabulary associated with the user using the one or more interest places;

filter the place vocabulary based on one or more place filtering parameters; and

register the filtered place vocabulary for the user.

14. The computer program product of claim 13, wherein the one or more place filtering parameters include a first location associated with the user and filtering the place vocabulary comprises:

determining a coverage radius based on the first location;

determining a coverage range using the coverage radius and the first location; and

generating the filtered place vocabulary that includes one or more custom place terms corresponding to one or more second locations within the coverage range.

15. The computer program product of claim 13, wherein the computer readable program when executed on the computer causes the computer to also:

receive a speech command from the user;

recognize one or more custom place terms in the speech command based on the registered place vocabulary;

send data describing the speech command that includes the one or more custom place terms; and

receive a result that matches the speech command including the one or more custom place terms.

16. The computer program product of claim 13, wherein the computer readable program when executed causes the computer to also:

receive navigation data associated with a user;

process the navigation data to identify a travel route and one or more stop points;

determine one or more road names associated with the travel route;

determine one or more landmarks associated with the travel route; and

populate the place vocabulary further based on the one or more stop points, the one or more landmarks and the one or more road names.

17. The computer program product of claim 13, wherein the computer readable program when executed causes the computer to also:

receive social network data associated with the user; and

determine the one or more interest places further based on location data included in the social network data.

18. The computer program product of claim 17, wherein the computer readable program when executed causes the computer to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

19. The computer program product of claim 13, wherein the computer readable program when executed causes the computer to also:

receive contacts data associated with the user; and

determine the one or more interest places further based on location data in the contacts data.

20. The computer program product of claim 19, wherein the computer readable program when executed causes the computer to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

21. The computer program product of claim 13, wherein the computer readable program when executed causes the computer to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

22. The computer program product of claim 13, wherein:

the journey includes a future journey;

the state of the journey includes a journey start time for the future journey; and

the place vocabulary is populated and registered before the journey start time.

23. A computer program product comprising a computer usable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

receive contact data describing one or more contacts associated with the user;

receive social graph data describing a social graph associated with the user;

receive location data associated with the user;

populate a contact vocabulary associated with the user based on the contact data, the social graph data, contact information associated with the location data and the state of the journey;

filter the contact vocabulary based on one or more contact filtering parameters; and

register the filtered contact vocabulary for the user.

24. A computer program product comprising a computer usable medium including a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

receive content data describing one or more content items;

receive data describing one or more content sources;

populate a content vocabulary associated with a user based on the content data, the one or more content sources and the state of the journey;

filter the content vocabulary based on one or more content filtering parameters; and

register the filtered content vocabulary for the user.

25. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

determine one or more interest places based on the state of the journey;

populate a place vocabulary associated with the user using the one or more interest places;

filter the place vocabulary based on one or more place filtering parameters; and

register the filtered place vocabulary for the user.

26. The system of claim 25, wherein the one or more place filtering parameters include a first location associated with the user and the instructions when executed cause the system to filter the place vocabulary by:

determining a coverage radius based on the first location;

determining a coverage range using the coverage radius and the first location; and

generating the filtered place vocabulary that includes one or more custom place terms corresponding to one or more second locations within the coverage range.

27. The system of claim 25, wherein the instructions when executed cause the system to also:

receive a speech command from the user;

recognize one or more custom place terms in the speech command based on the registered place vocabulary;

send data describing the speech command that includes the one or more custom place terms; and

receive a result that matches the speech command including the one or more custom place terms.

28. The system of claim 25, wherein the instructions when executed cause the system to also:

receive navigation data associated with a user;

process the navigation data to identify a travel route and one or more stop points;

determine one or more road names associated with the travel route;

determine one or more landmarks associated with the travel route; and

populate the place vocabulary further based on the one or more landmarks and the one or more road names.

29. The system of claim 25, wherein the instructions when executed cause the system to also:

receive social network data associated with the user; and

determine the one or more interest places further based on location data included in the social network data.

30. The system of claim 29, wherein the instructions when executed cause the system to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

31. The system of claim 25, wherein the instructions when executed cause the system to also:

receive contacts data associated with the user; and

determine the one or more interest places further based on location data in the contacts data.

32. The system of claim 31, wherein the instructions when executed cause the system to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

33. The system of claim 25, wherein the instructions when executed cause the system to also:

receive search data associated with the user; and

determine the one or more interest places further based on the search data.

34. The system of claim 25, wherein:

the journey includes a future journey;

the state of the journey includes a journey start time for the future journey; and

the place vocabulary is populated and registered before the journey start time.

35. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

receive contact data describing one or more contacts associated with the user;

receive social graph data describing a social graph associated with the user;

receive location data associated with the user;

populate a contact vocabulary associated with the user based on the contact data, the social graph data, contact information associated with the location data and the state of the journey;

filter the contact vocabulary based on one or more contact filtering parameters; and

register the filtered contact vocabulary for the user.

36. A system comprising:

a processor; and

a memory storing instructions that, when executed, cause the system to;

detect a provisioning trigger event;

determine a state of a journey associated with a user based on the provisioning trigger event;

receive content data describing one or more content items;

receive data describing one or more content sources;

populate a content vocabulary associated with a user based on the content data, the one or more content sources and the state of the journey;

filter the content vocabulary based on one or more content filtering parameters; and

register the filtered content vocabulary for the user.