VOICE CONVERSATIONS IN A UNIFIED AND CONSISTENT MULTIMODAL COMMUNICATION FRAMEWORK

• US 20150140978A1
• Filed: 11/08/2014
• Published: 05/21/2015
• Est. Priority Date: 11/18/2013
• Status: Abandoned Application

• Current Assignee: Wire Swiss GmbH (Wire Group Holdings GmbH)
• Original Assignee: Zeta Project Swiss GmbH
• Inventors: Zilmer, Priidu, Pascual Palomo, Angel Sergio, Reitalu, Oliver, Hoffmann, Martin
• Application Number:
  US14/536,590
• Publication Number:
  US 20150140978A1
• Time in Patent Office: Days
• US Class Current: 455/416
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04L 65/1094 Inter-user-equipment sessions transfer or sharing
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 3/56 Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities video conference systems H04N7/15
• CPC Class Codes: H04W 4/16 Communication-related supplementary services, e.g. call-transfer or call-hold
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals

Abstract

A unified communication framework in which multiple users communicate using multiple modes including voice. Conversations are kept consistent across users'"'"' devices. A backend maintains the true and authoritative version of the conversation within the communication framework. Users may join and leave voice channels of conversations. Users may attempt to get the attention of other users.

Claims

1. A computer-implemented method, operable in a communication framework in which each of a plurality of users has one or more devices associated therewith, and in which the users use at least some of their devices to communicate via a backend system,

the method comprising,

(A) maintaining, in the backend system, a conversation between one or more users of the plurality of users, wherein the conversation comprises a time-ordered sequence of objects, and wherein the conversation maintained by the backend is an authoritative version of the conversation within the communication framework, wherein the conversation includes a logical voice channel;

(B) providing a user interface (UI) on each device, said UI supporting establishing a voice conversation using the voice channel.

2. The method of claim 1 wherein said conversation comprises a logical messaging channel, and wherein UI supports establishing said voice conversation using the voice channel while using said logical messaging channel.

3. The method of claim 2 wherein the UI provides access to a voice menu, said voice menu including at least one voice region that, when selected, causes the device to join the voice channel of the conversation.

4. The method of claim 3 wherein, when the device is actively using the voice channel of the conversation, the voice menu provides at least a second region that, when selected, causes the device to leave the voice channel of the conversation.

5. The method of claim 3 wherein, when the device is actively using the voice channel of the conversation, the voice menu provides at least a third region that, when selected, causes the device selectively to mute or un-mute the voice channel of the conversation.

6. The method of claim 1 wherein each conversation has at least one participant, and wherein, when at least one participant of a conversation is using the voice channel of that conversation, the UI provides a voice header for that conversation, wherein at least some of the participants of the voice channel of the conversation are identified in the voice header of the conversation.

7. The method of claim 6 wherein a particular participant in a voice channel of a conversation is identified in the voice header of the conversation is using an iconic representation of said particular participant.

8. The method of claim 7 wherein the iconic representation of said particular participant is an animated representation of said particular participant.

9. The method of claim 7 wherein the iconic representation is derived from user information about said particular participant maintained in the backend.

10. The method of claim 9 wherein the iconic representation is based on a picture of the particular participant maintained in the backend.

11. The method of claim 6 wherein the voice header is modified based on which users in the conversation are current participants in the voice channel.

12. The method of claim 6 wherein the UI supports a user leaving the voice channel of a conversation by dragging their iconic representation out of the voice header.

13. The method of claim 6 wherein the voice header is ordered based on which user most recently joined the voice channel.

14. The method of claim 1 wherein the UI supports a user using another channel of the conversation while using the voice channel of the conversation.

15. The method of claim 14 wherein the other channel is a text channel of the conversation.

16. The method of claim 14 wherein the UI supports the user sending an image while on the voice channel.

17. The method of claim 14 wherein the UI supports the user listening to music while on the voice channel.

18. The method of claim 14 wherein the UI supports the user playing music to other users on the voice channel.

19. The method of claim 1 wherein, when the user is using the voice channel of a conversation on a first device, the UI supports switching to using the voice channel on a second device.

20. The method of claim 1 wherein the UI supports the user muting other users in the voice channel of the conversation.

21. The method of claim 1 wherein, when a user is on a voice channel with at least one other user, the user automatically leaves the voice channel when all other users leave the voice channel.

22. The method of claim 1 wherein, when the user is first to join the voice channel of a conversation, the user is initially muted in the conversation.

23. The method of claim 1 wherein the UI is provided as part of an application on the device, and wherein, when the user terminates or closes the application on the device, the user leaves the voice channel of the conversation on the device.

24. The method of claim 1 wherein the UI supports a particular user in a conversation attempting to get the attention of at least one other user in the conversation.

25. The method of claim 1 wherein the UI supports a particular user in a conversation attempting to get the attention of all other users in the conversation.

26. The method of claim 24 wherein the UI supports the particular user in a conversation attempting to get the attention of said at least one other user in the conversation by the particular user tapping a number of times on the name or iconic representation of said at least one other user in the conversation.

27. The method of claim 26 wherein said number of times is greater than two.

28. The method of claim 1 wherein the UI supports a particular user in a conversation attempting to get the attention of a user in the conversation, wherein, in response to an attempt by said particular user to get the attention of said user, the UI provides an alert indicator to the user.

29. The method of claim 28 wherein the alert indicator comprises an animated indicator.

30. The method of claim 28 wherein the alert indicator comprises an audio indicator.

31. The method of claim 28 wherein said alert times out after a time out period.

32. The method of claim 31 wherein, when the particular user attempts to get the attention of another user during the time out period, then the UI supports extending the time out period.

33. The method of claim 31 wherein, when the particular user attempts to get the attention of another user during the time out period, then the UI supports increasing an intensity of the alert indicator.

34. The method of claim 26 wherein the UI supports a user responding to another user'"'"'s attempt to get their attention.

35. The method of claim 34 wherein the UI supports a user responding to another user'"'"'s attempt to get their attention by selecting the alert indicator.

36. The method of claim 1 wherein the maintaining in (B) comprises maintaining a substantially consistent version of the conversation.

37. The method of claim 1 wherein conversation maintained by the backend is considered to be the true version of the conversation within the communication framework.

38. The method of claim 1 wherein the one or more devices are selected from:

smartphones, tablet devices, computer devices, set-top boxes, and televisions.

39. The method of claim 1 wherein each object in the conversation represents at least one of:

text, an image, video content, audio content, voice information, a file, a link to an asset, and meta information about the conversation.

40. The method of claim 1 wherein the backend system acts as a persistent store through which users share data.

42. The device of claim 41 wherein the device is constructed and adapted to support the method of claim 1.

44. The device of claim 40 wherein the device is a device selected from:

a smartphone, a tablet device, a computer device, a set-top box, and a television.

45. The device of claim 40 wherein each object in the conversation represents at least one of:

text, an image, video content, audio content, voice, a file, a link to an asset, and meta information about the conversation.

46. The device of claim 40 wherein the conversation maintained by the backend is considered to be the true version of the conversation within the communication framework.

52. The communication framework of claim 47 wherein the backend is constructed and adapted to support the method of claim 1.

57. A computer-implemented method, operable in a communication system in which each of a plurality of users has one or more devices associated therewith, and in which the users use at least some of their devices to communicate via a backend system, the method comprising the method of claim 1.

58. A device comprising hardware, including a processor and a memory, the device being programmed to perform the method of claim 1.

59. The device of claim 58 wherein the device is a device selected from:

a smartphone, a tablet device, a computer device, a set-top box, and a television.

60. A tangible computer-readable non-transitory storage medium comprising instructions for execution on a device, wherein the instructions, when executed, perform acts of a method of claim 1.

61. The storage medium of claim 60 wherein the device is a device selected from:

a smartphone, a tablet device, a computer device, a set-top box, and a television.

41. A device, operable in a communication framework in which each a plurality of users has one or more devices associated therewith, the device being associated with a particular user of the plurality of users, and in which the users use at least some of their devices to communicate via a backend system,

the device being constructed and adapted to:

(a) engage, via the backend, in a conversation with one or more users of the plurality of users, the conversation includes voice, wherein the backend system maintains a substantially consistent and authoritative state of the conversation; and

(b) provide a user interface (UI), wherein the device renders the particular view of the conversation via the UI.

43. The device of claim 41 further comprising a display, wherein the UI is provided using the display.

47. A communication framework in which each a plurality of users has one or more devices associated therewith, the framework comprising:

a backend system, wherein the at least some of the users use at least some of their devices to have conversations via the backend system,

wherein the backend system is constructed and adapted to;

(a) support a particular conversation between one or more users of the plurality of users, said conversation including voice; and

(b) maintain a substantially consistent and authoritative state of the particular conversation.

48. The communication framework of claim 47 wherein the backend system is further constructed and adapted to:

(c) provide at least some of the substantially consistent and authoritative state of the particular compensation to a user involved in the particular conversation.

49. The communication framework of claim 48 wherein the user involved in the particular conversation joined the conversation after the conversation had been ongoing.

50. The communication framework of claim 49 wherein the backend system is constructed and adapted to support a particular conversation by:

(a)(1) supporting establishment of the particular conversation; and

(a)(2) providing at least a subset of the conversation to a device associated with the conversation.

51. The communication framework of claim 49 wherein the particular conversation comprises a time-ordered sequence of objects, and wherein the backend system provides the subset of the conversation to a device associated with the conversation by providing the subset of the sequence of objects to the device.

53. The communication framework of claim 47 wherein each of the one or more devices is a device selected from:

a smartphone, a tablet device, a computer device, a set-top box, and a television.

54. The communication framework of claim 47 wherein each object in the conversation represents at least one of:

text, an image, voice, video content, audio content, a file, a link to an asset, and meta information about the conversation.

55. The communication framework of claim 47 wherein the particular conversation maintained by the backend is considered to be a true version of the particular conversation within the communication framework.

56. A computer-implemented method, operable in a communication system in which each of a plurality of users has one or more devices associated therewith, and in which the users use at least some of their devices to communicate via a backend system, the method comprising:

(A) maintaining in the backend system a substantially consistent version of a conversation between multiple users of the plurality of users, wherein conversation maintained by the backend provides an authoritative version of the conversation within the communication framework; and

(B) establishing a voice conversation using the voice channel.