Method and apparatus for pictorial identification of a communication event

• US 8,942,479 B2
• Filed: 10/07/2013
• Issued: 01/27/2015
• Est. Priority Date: 12/12/2005
• Status: Active Grant

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Inventors: Lindroos, Sanna, Jokinen, Paivi
• Primary Examiner(s): Park, Edward
• Application Number:
  US14/047,903
• Publication Number:
  US 20140038570A1
• Time in Patent Office: 477 Days
• Field of Search: 382/181, 382/231
• US Class Current: 382/181
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: H04M 1/2746 Sorting, e.g. according to history or frequency of use
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold

Abstract

The specification and drawings present a new method, apparatus and software product for pictorial identification of a communication event using speech or text recognition in an electronic device. The communication can be (but is not limited to) a telephone call, an electronic mail message, MMS, SMS, an instant message, etc. Words from the communication event are identified using the speech or text recognition by the electronic device and at least one picture out of a library of reference pictures is identified by comparing the identified words with the key picture words using a predetermined criterion. Color background of the identified standard picture can be also identified using the identified words and a further predetermined criterion. The identified picture can be displayed during the communications event or can be stored so the user can identify the topic of the communication event later on.

Claims

1. A method, comprising:

identifying, by a first device of a user, one or more words from a communication event, which is with a second device of a second user, using at least one of speech recognition and text recognition during the communication event;

comparing, by the first device during the communication event, the one or more words identified with a plurality of key picture words to find a picture match, wherein each of the plurality of key picture words are associated with one or more reference pictures from a library of reference pictures;

identifying, based on the picture match, one or more pictures from the reference pictures; and

generating a visual log of the communication event using the one or more pictures identified.

2. The method of claim 1, further comprising at least one of:

displaying the one or more identified pictures on a display of the first device;

displaying the visual log on the display of the first device; and

storing, by the first device, the one or more identified pictures.

3. The method of claim 1, wherein the step of comparing includes using a predetermined criterion to determine when the picture match is found.

4. The method of claim 3, further comprising altering at least one of the predetermined criterion and one or more key picture words based on an instruction from the user of the first device.

5. The method of claim 1, wherein the communication event is at least one event selected from a group of events comprising:

a telephone call;

an electronic mail message;

a multimedia messaging service message;

a short message service message; and

an instant message.

6. The method of claim 1, further comprising:

comparing, by the first device during the communication event, the one or more words identified with a plurality of key color words to find a color match, wherein each of the plurality of key color words are associated with one or more reference colors from a library of reference colors; and

identifying, based on the color match, one or more background colors from the reference colors, wherein generating the visual log further comprises using the one or more background colors.

7. The method of claim 6, further comprising displaying the one or more background colors on a display of the first device to facilitate identification of a topic of the communication event.

8. The method of claim 6, further comprising the first device storing the one or more background colors.

9. The method of claim 6, wherein, when the color match is not found, a predefined default background color is used when generating the visual log.

10. The method of claim 6, wherein the step of comparing the one or more words identified with the plurality of key color words includes using a second predetermined criterion to determine when the color match is found.

11. The method of claim 6, further comprising altering at least one of the second predetermined criterion and one or more of the plurality of key color words based on an instruction from a user of the first device.

12. The method of claim 1, wherein the visual log is a timeline order of the one or more identified pictures for the communication event.

13. The method of claim 1, wherein the visual log is a random order of the one or more identified pictures for the communication event.

14. A non-transitory computer readable medium including code for execution by a processor, wherein the code includes instructions that cause a first device of a first user to at least:

identify one or more words from a communication event, which is between the first device and a second device of a second user, using at least one of speech recognition and text recognition during the communication event;

compare, during the communication event, the one or more words identified with a plurality of key picture words to find a picture match, wherein each of the key picture words are associated with one or more reference pictures from a library of reference pictures;

identify, based on the picture match, one or more pictures from the reference pictures; and

generate a visual log of the communication event using the one or more identified pictures.

15. The non-transitory computer readable medium of claim 14, wherein the visual log is a timeline order of the one or more identified pictures for the communication event.

16. The non-transitory computer readable medium of claim 14, wherein the visual log is a random order of the one or more identified pictures for the communication event.

17. An apparatus of a user, the apparatus comprising a processor and a memory, which includes computer program code, the computer program code configured to, when executed by the processor, cause the apparatus to perform at least the following:

use at least one of speech recognition and text recognition to identify one or more words from a communication event with a second apparatus of a second user;

compare the one or more words identified with a plurality of key picture words to find a picture match, wherein each of the plurality of key picture words are associated with one or more reference pictures from a library of reference pictures;

identify, based on the picture match, one or more pictures from the reference pictures;

generate a visual log of the communication event using the one or more identified pictures; and

store the one or more identified pictures in association with the communication event.

18. The apparatus of claim 17, wherein the apparatus is further caused to create a sequence of the one or more identified pictures in a timeline of the communication event, the timeline being displayable on a display of the apparatus.

19. The apparatus of claim 17, wherein the apparatus is further caused to alter at least one of the plurality of key picture words and one or more reference pictures based on an instruction from a user of the apparatus.

20. The apparatus of claim 17, wherein the apparatus is caused to annotate the communication event using the one or more identified pictures.

21. The apparatus of claim 17, wherein the apparatus is caused to:

compare the one or more words identified with the plurality of key color words to find a color match, wherein each of the plurality of key color words is associated with one or more reference colors from a library of reference colors;

identify, based on the color match, one or more background colors from the reference colors; and

display the background color on a display of the apparatus.

22. The apparatus of claim 17, wherein the apparatus is caused to, when the color match is not found, select a predefined default background color as the background color.

23. The apparatus of claim 17, wherein the communication event is selected from the group comprising:

a telephone call;

an electronic mail message;

a multimedia messaging service message;

a short message service message;

an instant message; and

a combination thereof.

24. The apparatus of claim 17, wherein the visual log is a timeline order of the communication event.

25. The apparatus of claim 17, wherein the visual log is a random order of the communication event.