System and method for incorporating multimedia content into a message handled by a mobile device

• US 8,260,331 B2
• Filed: 07/22/2009
• Issued: 09/04/2012
• Est. Priority Date: 08/07/2008
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Wormald, Christopher R., Mallick, Martyn Henri, Balsillie, James Laurence
• Primary Examiner(s): Gelin, Jean
• Assistant Examiner(s): Patel, Mahendra
• Application Number:
  US12/507,355
• Publication Number:
  US 20100041422A1
• Time in Patent Office: 1,140 Days
• Field of Search: 455/466, 709/206, 709/207, 709/203, 709/227, 709/218, 709/217, 709/219, 709/212, 709/228, 705/14.73, 370/352, 370/486, 370/432, 370/270, 370/401, 370/463, 370/389, 600/544, 340/691.6, 340/463, 340/464, 340/988, 340/990, 340/425.5, 187/396, 715/767, 715/808, 348/E7.071, 379/90.01
• US Class Current: 455/466
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: H04L 51/063 Content adaptation, e.g. replacement of unsuitable content
• CPC Class Codes: H04L 65/1089 by adding media; by removing media
• CPC Class Codes: H04L 67/306 User profiles

Abstract

Multimedia content can be incorporated into a message handled by a mobile device with minimum invasiveness by utilizing linking mechanisms that are visually identifiable with certain content and can reveal the multimedia content, e.g. an advertisement, upon selection. This may be done by examining content in the message handled by a mobile device and matching portions of the message with predetermined criteria such as keywords or phrases. Upon finding matches, corresponding multimedia content is associated with a respective portion of the message content and access to the multimedia content is enabled through selection of a linking mechanism that is visually identifiable with the respective portion of the message. The message is modified to include such linking mechanisms such that upon viewing the modified message, a user may reveal the multimedia content by selecting the linking mechanism.

Claims

1. A method for incorporating multimedia content into messages handled by a mobile device, said method comprising:

obtaining a message being exchanged between said mobile device and one or more other entities in a data communication system;

examining content in said message to determine if one or more portions of said content in said message match predetermined criteria related to the relevance of said content to multimedia content;

using one or more profiles associated with a user of said mobile device to determine if the number of matches can be reduced according to the relevance of respective ones of said matches to said user and, if so, removing one or more of said matches;

for each match, identifying particular multimedia content to be associated with the corresponding one of said one or more portions of said message, said multimedia content configured to be accessible to said mobile device through a selection associated with said corresponding one of said one or more portions of said content; and

modifying said message to include, for each match, a linking mechanism visually identifiable with said corresponding one of said one or more portions, wherein said linking mechanism is configured to reveal said particular multimedia content upon selection thereof.

2. The method according to claim 1 wherein said multimedia content comprises advertising content.

3. The method according to claim 1 wherein said predetermined criteria comprises keywords or phrases.

4. The method according to claim 3 wherein said linking mechanism comprises a hyperlink applied to corresponding ones of said keywords or phrases.

5. The method according to claim 1 wherein the method is performed at said mobile device.

6. The method according to claim 1 wherein the method is performed at an intermediary node wherein said modifying occurs on incoming messages prior to being received by said mobile device and occurs on outgoing messages subsequent to being sent by said mobile device.

7. The method according to claim 1 wherein said message is any one or more of an email message, a text message, a multi-media message, a peer-to-peer message, an instant message or a mobile TTY message.

8. The method according to claim 1 wherein said modifying comprises incorporating additional multimedia content in said message that is visible in said message.

9. The method according to claim 8 further comprising wherein upon detecting that said message has been closed, if said additional multimedia content has not been viewed according to predetermined criteria, displaying said additional multimedia content for a predetermined period.

10. The method according to claim 1 further comprising incorporating multiple layers of multimedia content by enabling one layer of multimedia content to be displayed when a focus is placed on said portion and enabling another layer of multimedia content to be displayed upon selection of said linking mechanism or upon selection of said one layer of multimedia content.

21. The method according to claim 1 further comprising enabling providers of said multimedia content to bid on said predetermined criteria.

22. The method according to claim 1 further comprising limiting a number of said linking mechanisms in said message according to a predetermined maximum threshold.

23. The method according to claim 22 wherein said limiting comprises discarding lower priority matches.

24. The method according to claim 1 wherein said one or more profiles are used only if the number of matches is greater than a predetermined number.

11. A non-transitory computer readable medium comprising computer executable instructions for incorporating multimedia content into messages handled by a mobile device or a server device, comprising instructions for:

obtaining a message being exchanged between said mobile device and one or more other entities in a data communication system;

examining content in said message to determine if one or more portions of said content in said message match predetermined criteria related to the relevance of said content to multimedia content;

using one or more profiles associated with a user of said mobile device to determine if the number of matches can be reduced according to the relevance of respective ones of said matches to said user and, if so, removing one or more of said matches;

for each match, identifying particular multimedia content to be associated with the corresponding one of said one or more portions of said message, said multimedia content configured to be accessible to said mobile device through a selection associated with said corresponding one of said one or more portions of said content; and

modifying said message to include, for each match, a linking mechanism visually identifiable with said corresponding one of said one or more portions, wherein said linking mechanism is configured to reveal said particular multimedia content upon selection thereof.

12. A mobile device comprising a display, one or more input mechanisms, a processor, a message application and a memory, said memory storing computer executable instructions for incorporating multimedia content into messages handled by said message application, said instructions including instructions for:

obtaining a message being exchanged between said mobile device and one or more other entities in a data communication system;

examining content in said message to determine if one or more portions of said content in said message match predetermined criteria related to the relevance of said content to multimedia content;

using one or more profiles associated with a user of said mobile device to determine if the number of matches can be reduced according to the relevance of respective ones of said matches to said user and, if so removing one or more of said matches;

for each match, identifying particular multimedia content to be associated with the corresponding one of said one or more portions of said message, said multimedia content configured to be accessible to said mobile device through a selection associated with said corresponding one of said one or more portions of said content; and

modifying said message to include, for each match, a linking mechanism visually identifiable with said corresponding one of said one or more portions, wherein said linking mechanism is configured to reveal said particular multimedia content upon selection thereof.

13. The mobile device according to claim 12 wherein said multimedia content comprises advertising content.

14. The mobile device according to claim 12 wherein said predetermined criteria comprises keywords or phrases.

15. The mobile device according to claim 14 wherein said linking mechanism comprises a hyperlink applied to corresponding ones of said keywords or phrases.

16. The mobile device according to claim 12 wherein said message is any one or more of an email message, a text message, a multi-media message, a peer-to-peer message, an instant message or a mobile TTY message.

17. The mobile device according to claim 12 wherein said modifying comprises incorporating additional multimedia content in said message that is visible in said message.

18. The mobile device according to claim 17 further comprising wherein upon detecting that said message has been closed, if said additional multimedia content has not been viewed according to predetermined criteria, said mobile device is configured for displaying said additional multimedia content for a predetermined period.

19. The mobile device according to claim 12 further configured for incorporating multiple layers of multimedia content by enabling one layer of multimedia content to be displayed when a focus is placed on said portion and enabling another layer of multimedia content to be displayed upon selection of said linking mechanism or upon selection of said one layer of multimedia content.

25. The mobile device according to claim 12 further comprising instructions for limiting a number of said linking mechanisms in said message according to a predetermined maximum threshold.

26. The mobile device according to claim 25 wherein said limiting comprises discarding lower priority matches.

27. The mobile device according to claim 12 wherein said one or more profiles are used only if the number of matches is greater than a predetermined number.

20. A server device for incorporating multimedia content into a message handled by a mobile device, said server device comprising a memory storing computer executable instructions for:

obtaining a message being exchanged between said mobile device and one or more other entities in a data communication system;

examining content in said message to determine if one or more portions of said content in said message match predetermined criteria related to the relevance of said content to multimedia content;

using one or more profiles associated with a user of said mobile device to determine if the number of matches can be reduced according to the relevance of respective ones of said matches to said user and, if so, removing one or more of said matches;

for each match, identifying particular multimedia content to be associated with the corresponding one of said one or more portions of said message, said multimedia content configured to be accessible to said mobile device through a selection associated with said corresponding one of said one or more portions of said content; and

modifying said message to include, for each match, a linking mechanism visually identifiable with said corresponding one of said one or more portions, wherein said linking mechanism is configured to reveal said particular multimedia content upon selection thereof.

28. The server device according to claim 20 wherein said multimedia content comprises advertising content.

29. The server device according to claim 20 wherein said predetermined criteria comprises keywords or phrases.

30. The server device according to claim 29 wherein said linking mechanism comprises a hyperlink applied to corresponding ones of said keywords or phrases.

31. The server device according to claim 20 wherein said message is any one or more of an email message, a text message, a multi-media message, a peer-to-peer message, an instant message or a mobile TTY message.

32. The server device according to claim 20 wherein said modifying comprises incorporating additional multimedia content in said message that is visible in said message.

33. The server device according to claim 32 further comprising instructions for, wherein upon detecting that said message has been closed, if said additional multimedia content has not been viewed according to predetermined criteria, displaying said additional multimedia content for a predetermined period.

34. The server device according to claim 20 further comprising instructions for incorporating multiple layers of multimedia content by enabling one layer of multimedia content to be displayed when a focus is placed on said portion and enabling another layer of multimedia content to be displayed upon selection of said linking mechanism or upon selection of said one layer of multimedia content.

35. The server device according to claim 20 further comprising instructions for enabling providers of said multimedia content to bid on said predetermined criteria.

36. The server device according to claim 20 further comprising instructions for limiting a number of said linking mechanisms in said message according to a predetermined maximum threshold.

37. The server device according to claim 36 wherein said limiting comprises discarding lower priority matches.

38. The server device according to claim 20 wherein said one or more profiles are used only if the number of matches is greater than a predetermined number.