Multi-modal communications with conferencing and clients

• US 20130294595A1
• Filed: 05/01/2012
• Published: 11/07/2013
• Est. Priority Date: 05/01/2012
• Status: Active Grant

• Current Assignee: Mitel Networks Corporation
• Original Assignee: Mitel Networks Corporation
• Inventors: Michaud, Alain, Trinh, Trung (Tim), Gray, Tom
• Granted Patent: US 8,675,854 B2
• Time in Patent Office: Days
• US Class Current: 379/202.01
• CPC Class Codes: H04M 2201/39 using speech synthesis
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2203/5081 Inform conference party of participants, e.g. of change of participants
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/566 relating to a participants right to speak arrangements for multi-party communication with floor control, e.g. for conferences, H04L65/4038, H04L65/4046, H04L65/4053
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 7/0042 where the data service is a text-based messaging service H04M7/0054 takes precedence

Abstract

A system and method for merging multi-modal communications are disclosed. The multi-modal communications can be synchronous, asynchronous and semi-synchronous. By way of a non-limiting example, at least two devices operating with varied modalities can be connected to a conferencing appliance. The conferencing appliance can integrate the differing modalities from the at least two devices by executing at least one of turn taking, conference identification, participant identification, ordering of interjections, modulation of meaning, expectation of shared awareness, floor domination and combination thereof.

Claims

1. A method of connecting participants into a multi-modal conference comprising:

receiving at least one of an incoming audio signal and incoming text-based message;

when an incoming audio signal is received, transcoding the incoming audio signal to a text-based message, interleaving the text-based message with other incoming text-based messages and providing the interleaved text-based messages to at least one participant having a text-based receiver connected into the multi-modal conference; and

when an incoming text-based message is received, transcoding the incoming text-based message to an audio signal and providing the audio signal to at least one participant having an audio-based receiver connected into the multi-modal conference based on a plurality of mechanisms, the plurality of mechanisms comprising;

when an idle period is present within voice communications on the multi-modal conference unit, turn taking, conference identification, participant identification, ordering of interjections, modulation of meaning, expectation of shared awareness, floor domination and combinations thereof.

2. The method of claim 1, wherein receiving the at least one of the incoming audio signal and incoming text-based message comprises acquiring both the incoming audio signal and incoming text-based message through a transmitter connected into the multi-modal conference.

3. The method of claim 2, wherein providing the interleaved text-based messages to the at least one participant having the text-based receiver and providing the audio signal to the at least one participant having the audio-based receiver connected into the multi-modal conference comprises establishing semi-synchronous communications within the multi-modal conference.

4. The method of claim 1, wherein transcoding the incoming audio signal to the text-based message comprises creating an identifier of a participant providing the incoming audio signal and announcing the identifier with the text-based message.

5. The method of claim 1, wherein transcoding the incoming text-based message to the audio signal comprises creating an identifier of a participant providing the incoming text-based message and announcing the identifier with the audio signal.

6. The method of claim 1, comprising at least one of ordering of idle period present within voice communications on the multi-modal conference unit, interjections, modulation of meaning, expectation of shared awareness and floor domination.

7. The method of claim 1, comprising creating a unique identifier and media negotiation address for the multi-modal conference and notifying potential participants of the unique identifier and media negotiation address.

8. A system comprising:

at least two receivers operating with different modalities connected to a conferencing appliance, wherein the conferencing appliance merges the modalities from the at least two receivers by executing a plurality of mechanisms, the plurality of mechanisms comprising;

turn taking, conference identification, participant identification, ordering of interjections, modulation of meaning, expectation of shared awareness, floor domination and combinations thereof.

9. The system of claim 8, wherein turn taking comprises converting incoming audio to text, waiting for an idle period within other incoming texts, interleaving the text with the other incoming texts and providing the interleaved texts to at least one text-based receiver connected to the conference appliance and converting incoming text to audio, waiting for an idle period and providing the audio to at least one audio-based receiver connected into the conference appliance.

10. The system of claim 8, comprising a sample switching conference unit, the sample switching conference unit receiving audio streams from the at least two transmitters, comparing the audio streams and selecting a largest sample of the audio streams whereby an audio stream associated with the largest sample is provided to participants of the at least two transmitters connected into the conferencing appliance.

11. The system of claim 10, where a second largest sample is provided to a participant if the participant made the largest sample.

12. The system of claim 8, wherein the conferencing appliance stores communications in both text and audio within an archive.

13. The system of claim 12, wherein the communications within the archive can be annotated, extracted and searched.

14. The system of claim 8, wherein at least one document is attached to conversations supported by the conferencing appliance.

15. The system of claim 8, wherein the at least two receivers interact through a second level of communication which is managed by the conference appliance.

16. The system of claim 15, wherein interaction through the second level of communication comprises at least one of presentation of identifying information of participants who are viewing at least one video feed and control of access to the at least one video feed available to at least one participant.

17. A multi-modal conference unit comprising:

at least one processor; and

a memory operatively coupled to the processor, the memory storing program instructions that when executed by the processor, causes the processor to;

receive at least one text-based message from a participant;

buffer the at least one text-based message in a queue;

transcode the at least one text-based message to an audio signal; and

placing the audio signal on at least one outgoing link connected to a participant based on a plurality of mechanisms, the plurality of mechanisms comprising;

when an idle period is present within voice communications on the multi-modal conference unit, turn taking, conference identification, participant identification, ordering of interjections, modulation of meaning, expectation of shared awareness, floor domination and combinations thereof.

18. The multi-modal conference unit of claim 17, wherein the memory storing program instructions, when executed by the processor, causes the processor to determine a primary speaker within the voice communications.

19. The multi-modal conference unit of claim 17, wherein the memory storing program instructions, when executed by the processor, causes the processor to provide whisper announcements if a number of text-based messages exceeds a defined threshold within the queue.

20. The multi-modal conference unit of claim 17, wherein the memory storing program instructions, when executed by the processor, causes the processor to remove text-based messages provided by a participant if a control code is received by the multi-modal conference unit.