System and method for multimodal short-cuts to digital sevices

• US 20040176958A1
• Filed: 02/04/2002
• Published: 09/09/2004
• Est. Priority Date: 02/04/2002
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Sorvari, Antti, Salmenkaita, Jukka-Pekka
• Granted Patent: US 9,374,451 B2
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04M 1/6041 Portable telephones adapted for handsfree use
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2203/251 where a voice mode or a visual mode can be used interchangeably
• CPC Class Codes: H04M 2203/253 where a visual mode is used instead of a voice mode
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: H04W 8/183 Processing at user equipment or user record carrier

Abstract

A method and system for facilitating user access to services through a wireless device of a user, involves recommending to a user a subset of services from a plurality of services available to the user in which each recommended service of the subset has at least one voice short-cut associated therewith, and selecting a service to be accessed through the user'"'"'s wireless device from the subset of services according to a voice command by the user corresponding to the voice short-cut of the service.

Claims

1. A method of enabling user access to services through a wireless device of a user, the method comprising:

recommending to a user a subset of services from a plurality of services available to the user, each recommended service of the subset having at least one voice short-cut associated therewith; and

selecting a service to be accessed through the user'"'"'s wireless device from the subset of services according to a voice command by the user corresponding to the voice short-cut of the service.

2. The method according to claim 1, wherein the plurality of services comprises services previously accessed by the user.

3. The method according to claim 1, wherein the recommended services are transparent to the user.

4. The method according to claim 1, further comprising visually outputting visual information corresponding to the subset of recommended services to the user.

5. The method according to claim 4, wherein the visual information includes identification of a voice short-cut for each service of the subset of services.

6. The method according to claim 5, wherein the visual information includes an icon to notify the user of the availability of voice access of the recommended services.

7. The method according to claim 1, further comprising audibly outputting audio information corresponding to the subset of recommended services to the user.

8. The method according to claim 7, wherein the audio information includes identification of a voice short-cut for each service of the subset of recommended services.

9. The method according to claim 1, wherein the recommending determines the subset of recommended services based on the user-related filter criteria.

10. The method according to claim 1, wherein the recommending determines the subset of recommended services based on a current context of the user.

11. The method according to claim 10, wherein the current context is inferred based on at least one of a temporal variable, a position variable and a selected profile of the device.

12. The method according to claim 1, further comprising determining the current context based on a current sensed environment of the wireless device.

13. The method according to claim 1, wherein the recommending determines the subset of recommended services based on a service usage history or preference of the user.

14. The method according to claim 1, wherein the recommending determines the subset of recommended services based on the current environment of the wireless device sensed by one or more sensors.

15. The method according to claim 14, wherein the sensor is selected from the group consisting of a positioning sensor, a compass, a touch sensor, an audio sensor, a light sensor, and a temperature sensor.

16. The method according to claim 1, further comprising obtaining voice short-cuts for a service in an XML format.

17. The method according to claim 1, further comprising assigning temporary voice short-cuts to the subset of recommended services.

18. The method according to claim 1, further comprising generating a voice short-cut for a service from the plurality of services based on metadata associated with the service.

19. The method according to claim 1, further comprising enabling the user to predefine a voice short-cut for a service from the plurality of services.

20. The method according to claim 1, further comprising enabling the user to add or modify voice short-cuts for any one of the plurality of services.

21. The method according to claim 1, wherein a voice short-cut for a service of the plurality of services is predefined by the service provider.

22. The method according to claim 1, further comprising receiving a voice short-cut for a service from a remote location, across a wireless network.

23. The method according to claim 22, wherein the voice short-cut for a service is received from a remote location, across an ad hoc wireless network including the wireless device.

24. The method according to claim 22, wherein the voice short-cut for a service is received from a voice tag registry, across a wireless network.

25. The method according to claim 1, wherein the selecting comprises performing voice recognition processing to identify the service with a voice short-cut matching the voice command.

26. The method according to claim 25, wherein voice recognition processing is performed by comparing the voice command only to voice short-cuts of the recommended services.

27. The method according to claim 25, wherein the voice recognition processing is performed to identify the service with a voice short-cut matching the voice command according to a priority of the recommended services.

28. The method according to claim 25, wherein voice recognition processing is performed by the wireless device.

29. The method according to claim 25, wherein voice recognition processing is performed at a remote server and information identifying the selected service from the subset of recommended services is provided by the remote server to the wireless device.

30. The method according to claim 1, wherein the recommending of a subset of services is performed by the wireless device.

31. The method according to claim 1, wherein the recommending of a subset of services is performed at a remote server and information identifying the subset of recommended services is provided by the remote server to the wireless device.

32. The method according to claim 1, wherein the selecting of a service is performed by the wireless device.

33. The method according to claim 1, wherein the selecting of a service is performed at a remote server and information identifying the selected service from the subset of recommended services is provided by the remote server to the wireless device.

34. The method according to claim 1, further comprising filtering down the subset of recommended services for selection according to past recommendations to the user.

35. The method according to claim 1, further comprising filtering down the subset of recommended services for selection according to user-defined filter categories.

36. The method according to claim 1, further comprising accessing the selected service using the wireless device across a wireless network.

37. The method according to claim 36, further comprising enabling multi-modal input, including at least voice input, to browse the accessed service.

38. The method according to claim 36, further comprising enabling multi-modal input selection, including at least by voice, of a service to be from the subset of recommended services.

39. The method according to claim 1, wherein the voice command matches a plurality of the recommended services, further comprising outputting an indication of the matched services for selection by the user.

40. The method according to claim 39, wherein the indication of the matched services comprises voice short-cuts corresponding to thereto.

41. The method according to claim 1, further comprising maintaining one or more databases of information corresponding to services and associated voice short-cuts.

42. The method according to claim 1, further comprising interacting with at least one of a user input device and a user output device across a wireless short-range link.

43. The method according to claim 1, wherein the voice short-cuts of the recommended services change hierarchically according to a level of service.

44. A wireless device comprising:

a voice input device;

output device;

wireless interface for communicating across at least a wireless network; and

at least one processor for recommending to a user a subset of services from a plurality of services available to the user, each recommended service of the subset having at least one voice short-cut associated therewith, and for selecting a service to be accessed through the user'"'"'s wireless device from the subset of services according to the user'"'"'s voice command received from the voice input device corresponding to the voice short-cut of the service.

45. The wireless device according to claim 44, wherein the plurality of services comprises services previously accessed by the user.

46. The wireless device according to claim 44, wherein the recommended services are transparent to the user.

47. The wireless device according to claim 44, wherein visual information corresponding to the subset of recommended services is visually output via the output device to the user.

48. The wireless device according to claim 47, wherein the visual information includes identification of a voice short-cut for each service of the subset of services.

49. The wireless device according to claim 48, wherein the visual information includes an icon to notify the user of the availability of voice access of the recommended services.

50. The wireless device according to claim 44, wherein audio information corresponding to the subset of recommended services is audibly output via the output device to the user.

51. The wireless device according to claim 50, wherein the audio information includes identification of a voice short-cut for each service of the subset of recommended services.

52. The wireless device according to claim 44, wherein the subset of recommended services is determined based on the user-related filter criteria.

53. The wireless device according to claim 44, wherein the subset of recommended services is determined based on a current context of the user.

54. The wireless device according to claim 44, wherein the current context is inferred based on at least one of a temporal variable, a position variable and a selected profile of the device.

55. The wireless device according to claim 44, wherein the processor further determines the current context based on a current sensed environment of the wireless device.

56. The wireless device according to claim 44, wherein the subset of recommended services is determined based on a service usage history or preference of the user.

57. The wireless device according to claim 44, further comprising one or more sensors for sensing an environment of the wireless device, wherein the subset of recommended services is determined based on a current environment of the wireless device sensed by the one or more sensors.

58. The wireless device according to claim 57, wherein the sensor is selected from the group consisting of a positioning sensor, a compass, a touch sensor, an audio sensor, a light sensor, and a temperature sensor.

59. The wireless device according to claim 44, wherein the voice short-cuts for a service is received in an XML format via the wireless interface.

60. The wireless device according to claim 44, wherein the processor further assigns temporary voice short-cuts to the subset of recommended services.

61. The wireless device according to claim 44, wherein the processor further generates a voice short-cut for a service from the plurality of services based on metadata associated with the service.

62. The wireless device according to claim 44, wherein the processor further enables the user to predefine a voice short-cut for a service from the plurality of services.

63. The wireless device according to claim 44, wherein the processor further enables the user to add or modify voice short-cuts for any one of the plurality of services.

64. The wireless device according to claim 44, wherein a voice short-cut for a service of the plurality of services is predefined by the service provider.

65. The wireless device according to claim 44, wherein a voice short-cut for a service is received from a remote location, across the wireless network.

66. The wireless device according to claim 65, wherein the voice short-cut for a service is received from the remote location, across an ad hoc wireless network.

67. The wireless device according to claim 65, wherein the voice short-cut for a service is received from a voice tag registry, across a wireless network.

68. The wireless device according to claim 44, wherein the processor performs voice recognition processing to identify the service with a voice short-cut matching the voice command.

69. The wireless device according to claim 68, wherein the processor performs voice recognition processing by comparing the voice command only to the voice short-cuts of the recommended services.

70. The wireless device according to claim 68, wherein the voice recognition processing is performed to identify the service with a voice short-cut matching the voice command according to a priority of the recommended services.

71. The wireless device according to claim 44, wherein the processor further filters down the subset of recommended services for selection according to past recommendations to the user.

72. The wireless device according to claim 44, wherein the processor further filters down the subset of recommended services for selection according to user-defined filter categories.

73. The wireless device according to claim 44, wherein the selected service is accessed across the wireless network, via the wireless interface.

74. The wireless device according to claim 73, further comprising a plurality of input devices, including the voice input device, wherein the processor further enables multi-modal input to browse the accessed service.

75. The wireless device according to claim 44, further comprising a plurality of input devices, including the voice input device, wherein the processor enables multi-modal input selection, via the input devices, of a service to be accessed from the subset of recommended services.

76. The wireless device according to claim 44, wherein the voice command matches a plurality of the recommended services, the processor further causes an indication of the matched services to be outputted for selection by the user.

77. The wireless device according to claim 76, wherein the indication of the matched services comprises voice short-cuts corresponding to thereto.

78. The wireless device according to claim 44, further comprising memory for maintaining one or more databases of information corresponding to services and associated voice short-cuts.

79. The wireless device according to claim 44, wherein at least one of the voice input device and the output device interact with the processor or other components of the wireless device across a wireless short-range link.

80. The wireless device according to claim 44, wherein the voice short-cuts of the recommended services change hierarchically according to a level of service.

81. A network system for enabling user access to services through a wireless device of a user, the system comprising:

a wireless device, a server and a wireless network infrastructure to enable communication between the wireless device and the server, the wireless device and the server cooperating (1) to determine a subset of services from a plurality of services available to the user, each recommended service of the subset having at least one voice short-cut associated therewith, and (2) to select a service to be accessed through the wireless device from the subset of services according to the user'"'"'s voice command, inputted to the wireless device, corresponding to the voice short-cut of the service.

82. The system according to claim 81, wherein the plurality of services comprises services previously accessed by the user.

83. The system according to claim 81, wherein the recommended services are transparent to the user.

84. The system according to claim 81, wherein visual information corresponding to the subset of recommended services is visually output at the wireless device to the user.

85. The system according to claim 84, wherein the visual information includes identification of a voice short-cut for each service of the subset of recommended services.

86. The system according to claim 85, wherein the visual information includes an icon to notify the user of the availability of voice access of the recommended services.

87. The system according to claim 81, wherein audio information corresponding to the subset of recommended services is audibly output at the wireless device to the user.

88. The system according to claim 87, wherein the audio information includes identification of a voice short-cut for each service of the subset of recommended services.

89. The system according to claim 81, wherein the subset of recommended services is determined based on the user-related filter criteria.

90. The system according to claim 81, wherein the subset of recommended services is determined based on a current context of the user.

91. The system according to claim 90, wherein the current context is inferred based on at least one of a temporal variable, a position variable and a selected profile of the device.

92. The system according to claim 81, wherein the processor further determines the current context based on a current sensed environment of the wireless device.

93. The system according to claim 81, wherein the subset of recommended services is determined based on a service usage history or preference of the user.

94. The system according to claim 81, wherein the wireless device includes one or more sensors for sensing a surrounding environment, the subset of recommended services being determined based on a current environment of the wireless device sensed by the one or more sensors.

95. The system according to claim 94, wherein the sensor is selected from the group consisting of a positioning sensor, a compass, a touch sensor, an audio sensor, a light sensor, and a temperature sensor.

96. The system according to claim 81, wherein the voice short-cut for a service is received in an XML format via the wireless interface.

97. The system according to claim 81, wherein the wireless device assigns temporary voice short-cuts to the subset of recommended services.

98. The system according to claim 81, wherein one of the wireless device and the server generates a voice short-cut for a service from the plurality of services based on metadata associated with the service.

99. The system according to claim 81, wherein the wireless device enables the user to predefine a voice short-cut for a service from the plurality of services.

100. The system according to claim 81, wherein the wireless device enables the user to add or modify voice short-cuts for any one of the plurality of services.

101. The system according to claim 81, wherein a voice short-cut for a service of the plurality of services is predefined by the service provider.

102. The system according to claim 81, wherein the wireless device receives a voice short-cut for a service from the server.

103. The system according to claim 102, wherein the wireless device receives the voice short-cut for a service from a remote location, across an ad hoc wireless network of the wireless network infrastructure.

104. The system according to claim 102, wherein the wireless device receives the voice short-cut for a service from a voice tag registry, via the wireless network infrastructure.

105. The system according to claim 81, wherein one of the wireless device and the server performs voice recognition processing to identify the service with a voice short-cut matching the voice command.

106. The system according to claim 105, wherein one of the wireless device and the server performs voice recognition processing by comparing the voice command only to the voice short-cuts of the recommended services.

107. The system according to claim 105, wherein the voice recognition processing is performed to identify the service with a voice short-cut matching the voice command according to a priority of the recommended services.

108. The system according to claim 81, wherein the wireless device further filters down the subset of recommended services for selection according to past recommendations to the user.

109. The system according to claim 81, wherein the wireless device further filters down the subset of recommended services for selection according to user-defined filter categories.

110. The system according to claim 81, wherein the wireless device accesses the selected service across the wireless network infrastructure.

111. The system according to claim 110, wherein the wireless device includes a plurality of input devices, including a voice input device and enables multi-modal input by the user to browse the accessed service.

112. The system according to claim 81, wherein the wireless device includes comprising a plurality of input devices, including a voice input device, and enables multi-modal input selection, via the input devices, of a service to be accessed from the subset of recommended services.

113. The system according to claim 81, wherein the voice command matches a plurality of the recommended services, the wireless device further outputs an indication of the matched services for selection by the user.

114. The system according to claim 113, wherein the indication of the matched services comprises voice short-cuts corresponding to thereto.

115. The system according to claim 81, wherein the wireless device further comprises memory for maintaining one or more databases of information corresponding to services and associated voice short-cuts.

116. The system according to claim 81, wherein the wireless device includes at least one of the voice input device and the output device which are communicatively coupled thereto across a wireless short-range link.

117. The system according to claim 81, wherein the voice short-cuts of the recommended services change hierarchically according to a level of service.

118. A system for enabling user access to services through a wireless device of a user, the system comprising:

a plurality of sensors for sensing an environment of a wireless device operated by a user;

a context engine for determining a current context based on the sensed environment;

a recommendation engine for recommending to the user a subset of services from a plurality of services previously used by the user, each recommended service of the subset having at least one voice short-cut associated therewith;

a voice recognition engine for receiving a voice command from the user and comparing the user'"'"'s voice command to the voice short-cuts of the recommended service; and

a browser for accessing a service, from the subset of recommended services, with a voice short-cut matching the voice command.

119. A computer-readable medium encoded with processing instructions for implementing a method of enabling user access to services, performed by a computer, the method comprising:

recommending to a user a subset of services from a plurality of services available to the user, each recommended service of the subset having at least one voice short-cut associated therewith; and

selecting a service to be accessed through the user'"'"'s wireless device from the subset of services according to a voice command by the user corresponding to the voice short-cut of the service.