Facilitating presentation by mobile device of additional content for a word or phrase upon utterance thereof

• US 8,296,377 B1
• Filed: 11/09/2009
• Issued: 10/23/2012
• Est. Priority Date: 08/22/2007
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Canyon IP Holdings LLC (Intellectual Ventures LLC)
• Inventors: Jablokov, Victor Roditis, Jablokov, Igor Roditis, Terrell, James Richard II, Paden, Scott Edward
• Primary Examiner(s): Blair, Douglas
• Assistant Examiner(s): Survillo, Oleg
• Application Number:
  US12/614,677
• Time in Patent Office: 1,079 Days
• Field of Search: 709/206, 709/217, 709/219, 704/270.1, 704/235, 707/705, 707/736
• US Class Current: 709/206
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0256 User search
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 30/0271 Personalized advertisement
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/04 Details of speech synthesis systems, e.g. synthesiser structure or memory management
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04M 1/7243 : with interactive means for internal management of messages
• CPC Class Codes: H04M 2201/40 : using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/4938 : comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A method for presenting additional content for a word that is part of a message, and that is presented by a mobile communication device, includes the steps of: presenting the message, including emphasizing one or more words for which respective additional content is available for presenting by the mobile communication device; receiving an utterance that includes an emphasized word for which additional content is available for presenting by the mobile communication device; and presenting the additional content for the emphasized word included in the utterance received by the mobile communication device. These steps are performed by the mobile communication device.

Claims

1. A computer-implemented method of facilitating presentation of additional content for a word of text on a target communication device, the computer-implemented method comprising:

under control of one or more computing devices configured with specific computer executable instructions,

(a) first,

(i) screening the text to determine one or more words that are appropriate for searching;

(ii) searching for additional content in one or more databases based at least in part on the one or more determined words;

(iii) identifying the one or more words for which respective additional content is found in the searching in a manner configured to allow for emphasis of the identified one or more words when the text is presented by the target communication device;

(iv) communicating the identified one or more words to the target communication device in a manner configured to enable presentation of the text at the target communication device in a manner that emphasizes the identified one or more words; and

(v) maintaining in a database an association between the identified one or more words, the respective additional content found for such words during searching, and an identifier of the target communication device to which the identified one or more words were communicated; and

(b) thereafter,

(i) receiving, from a particular communication device, an identifier of the particular communication device and audio data representing an utterance that includes an identified word of the one or more identified words;

(ii) transcribing the utterance to text based at least in part on the audio data;

(iii) determining that the identifier of the particular communication device matches the identifier of the target communication device and, based at least in part thereon, comparing the transcribed text to the identified one or more words maintained in the database in association with the identifier of the target communication device; and

(iv) communicating the respective additional content associated with the identified word found in the transcribed text to the target communication device based at least in part on the comparison in a manner configured to enable presentation of the communicated respective additional content at the particular communication device.

2. The computer-implemented method of claim 1, wherein the target communication device is a mobile phone.

3. The computer-implemented method of claim 1, wherein identifying the one or more words for which respective additional content is found in the searching comprises highlighting the one or more words such that the one or more words are emphasized when displayed on the target communication device.

4. The computer-implemented method of claim 1, wherein identifying the one or more words for which respective additional content is found in the searching comprises configuring an audio presentation of the text to include pronunciation emphasis of the one or more words for which respective additional content is found in the searching.

5. The computer-implemented method of claim 1, wherein identifying the one or more words for which respective additional content is found in the searching comprises configuring an audio presentation of the text to include aural cueing for the one or more words for which respective additional content is found in the searching.

6. The computer-implemented method of claim 1, wherein the text is included in an instant message and wherein the target communication device is a recipient of the instant message.

7. The computer-implemented method of claim 1, wherein the text is included in an instant message and wherein the target communication device is a sender of the instant message.

8. The computer-implemented method of claim 1, wherein the text is included in a text message and wherein the target communication device is a recipient of the text message.

9. The computer-implemented method of claim 1, wherein the text is included in a text message and wherein the target communication device is a sender of the text message.

10. A system for facilitating presentation of additional content for a word that is part of text on a recipient communication device, the system comprising one or more processors to:

(a) first,

(i) screen the text to identify one or more words that are appropriate for searching;

(ii) search for additional content in one or more databases based at least in part on the one or more words identified as being appropriate for searching;

(iii) mark the one or more words for which respective additional content is found in the searching;

(iv) communicate the text with the marked one or more words to the recipient communication device, so that the text with the marked one or more words for which respective additional content is available; and

(v) maintain, in a database, an association between the marked one or more words, the respective additional content found for such words during searching, and an identifier of the recipient communication device to which the marked one or more words were communicated;

(b) second, by the recipient communication device, present the text of the message, including the marked one or more words for which the respective additional content is available;

(c) third,

(i) receive, from particular communication device, an identifier of the particular communication device and audio data representing an utterance that includes a marked word of the one or more marked words;

(ii) transcribe the utterance to text based at least in part on the audio data;

(iii) match the identifier of the particular communication device to the identifier of the recipient communication device and, upon a match, compare the transcribed text to the identified marked one or more words maintained in the database in association with the identifier of the recipient communication device; and

(iv) communicate the respective additional content associated with the marked word found in the transcribed text to the recipient communication device based at least in part on the comparison; and

(d) thereafter, present by the recipient mobile communication device, the communicated respective additional content.

11. The system of claim 10, wherein searching includes searching based at least in part on one or more of the identified words using a network search engine and analyzing the results provided in response thereto.

12. The system of claim 10, wherein the additional content comprises a network address for passing to a browser of the recipient communication device.

13. The system of claim 10, wherein the additional content comprises a URL for retrieving the additional content for presentation by the recipient communication device.

14. The system of claim 10, wherein searching includes sending a keyword to a third party SMS service and analyzing the results provided in response thereto.

15. The system of claim 10, wherein the additional content comprises a keyword for sending to a third party SMS service, in response to which is provided the additional content found in the searching.

16. The system of claim 10, wherein presenting the text of the message comprises presenting the additional content for the marked one or more words.

17. The system of claim 10, wherein the association between the marked one or more words, respective additional content for such one or more words, and an identifier of the communication device is maintained in the database for an extended period of time, the extended period of time comprising a plurality of days or weeks, whereby additional content may be provided for a marked word communicated to the recipient communication device even though a plurality of days have passed since the marked word was communicated to the communication device.

18. The system of claim 10, wherein communicating the text with the marked one or more words to the recipient communication device includes communicating the text with the marked words emphasized.

19. A non-transitory computer-readable medium whose contents configure one or more computing systems to perform a method of facilitating presentation of additional content for one or more words of text on a target communication device, the computer-implemented method comprising:

(a) first,

(i) screening the text to determine one or more words that are appropriate for searching;

(ii) searching for additional content in one or more databases based at least in part on the one or more determined words;

(iii) identifying the one or more words for which respective additional content is found in the searching in a manner configured to allow for emphasis of the identified one or more words when the text is presented by the target communication device;

(iv) communicating the identified one or more words to the target communication device in a manner configured to enable presentation of the text at the target communication device in a manner that emphasizes the identified one or more words; and

(v) maintaining in a database an association between the identified one or more words, the respective additional content found for such words during searching, and an identifier of the target communication device to which the identified one or more words were communicated; and

(b) thereafter,

(i) receiving, from a particular communication device, an identifier of the particular communication device and audio data representing an utterance that includes an identified word of the one or more identified words;

(ii) transcribing the utterance to text based at least in part on the audio data;

(iii) determining that the identifier of the particular communication device matches the identifier of the target communication device and, based at least in part thereon, comparing the transcribed text to the identified one or more words maintained in the database in association with the identifier of the target communication device; and

(iv) communicating the respective additional content associated with the identified word found in the transcribed text to the target communication device based at least in part on the comparison in a manner configured to enable presentation of the communicated respective additional content at the particular communication device.

20. The non-transitory computer-readable medium of claim 19, wherein identifying the one or more words for which respective additional content is found in the searching comprises highlighting the one or more words such that the one or more words are emphasized when displayed on the target communication device.

21. The non-transitory computer-readable medium of claim 19, wherein identifying the one or more words for which respective additional content is found in the searching comprises configuring an audio presentation of the text to include one of a pronunciation emphasis of, or an aural cueing for the one or more words for which respective additional content is found in the searching.

22. The non-transitory computer-readable medium of claim 19, wherein the text is included in one of an instant or a text message, and wherein the target communication device is one of a recipient or a sender of the instant message.

23. The non-transitory computer-readable medium of claim 19, wherein the additional content comprises one of:

(1) a network address for passing to a browser of the recipient communication device or (2) a URL for retrieving the additional content for presentation by the recipient communication device.

24. The non-transitory computer-readable medium of claim 19, wherein receiving audio data communicated from the particular communication device comprises receiving audio data representing an utterance, wherein the audio data includes a cue that a marked word is included in the utterance and wherein receiving the audio data includes presenting the additional content for the marked word included in the utterance.

25. The non-transitory computer-readable medium of claim 19, wherein the association between the marked words, respective additional content for such words, and an identifier of the communication device is maintained in the database for an extended period of time, the extended period of time comprising a plurality of days or weeks, whereby additional content may be provided for a marked word communicated to the recipient communication device even though a plurality of days have passed since the marked word was communicated to the communication device.