Method for visualizing temporal data

• US 9,923,982 B2
• Filed: 06/24/2011
• Issued: 03/20/2018
• Est. Priority Date: 06/24/2011
• Status: Expired due to Fees

• Current Assignee: Avaya Incorporated
• Original Assignee: Avaya Incorporated
• Inventors: FitzGerald, Cary
• Primary Examiner(s): Chea, Philip
• Assistant Examiner(s): Ma, Wing
• Application Number:
  US13/168,716
• Publication Number:
  US 20120331066A1
• Time in Patent Office: 2,461 Days
• Field of Search: 709204
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/54 Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users

Abstract

In one embodiment, a method and system are provided that receive, during a selected time period, a plurality of different media streams exchanged, over a communications network, in one or more communications between a plurality of parties; and generate a multimedia presentation of the plurality of different media streams, wherein, in the multimedia presentation, the different media streams are referenced according to a common time scale.

Claims

1. A communication system, comprising:

a microprocessor; and

a computer readable medium, coupled with the microprocessor and comprising microprocessor readable and executable instructions that program the microprocessor to;

receive, during a selected time period, a plurality of different media streams exchanged, over a communications network, in one or more communications between a plurality of parties;

generate a multimedia presentation of the plurality of different media streams, wherein the multimedia presentation comprises a plurality of display segments associated with a plurality of;

(i) sequential video images from the plurality of different media streams, (ii) at least one audio or video stream from the plurality of different media streams, (iii) one or more text messages from the plurality of different media streams, (iv) any other temporal data stream, and (v) at least one information accessed or created by one of the plurality of parties, the information not being included in the plurality of different media streams and wherein, in the multimedia presentation, different media streams are referenced according to a common time scale;

generate for display, the multimedia presentation to a requestor, wherein the plurality of different media streams are associated with a multimedia session between the plurality of parties, wherein an event association module determines that at least one communication transmitted, by one of the plurality of parties using a first communication device, during the multimedia session, is related to the multimedia session, wherein the at least one communication is not transmitted as part of the multimedia session, wherein the one of the plurality of parties is participating in the multimedia presentation using a second communication device and associates, in the multimedia presentation, a recorded version of the at least one communication with the one or more media streams, and wherein the at least one communication is between the at least one of the plurality of parties and a nonparticipant;

during the multimedia session, determine an electronic address of the first communication device of the one of the plurality of parties; and

track, during the multimedia session, using the electronic address of the first communication device of the one of the multiple participants, a plurality of communications that are separate from the multimedia presentation and sent and received by the first communication device using the electronic address, wherein the at least one communication is one of the plurality of communications that are separate from the conference session.

2. The system of claim 1, wherein the plurality of different media streams comprise a plurality of an audio conversation between two or more of the parties, video images of at least one or more of the parties, instant messages exchanged between two or more of the parties, email messages exchanged between two or more of the parties, text chat messages exchanged between two or more of the parties, keyboard chat between two or more of the parties, whiteboard session, desktop sharing session, application sharing session, and power point session.

3. The system of claim 1, wherein each of the display segments contains a graphical representation of a different media stream and wherein the plurality of display segments are associated with (i) sequential video images from the plurality of different media streams, (ii) at least one audio or video stream from the plurality of different media streams, (iii) one or more text messages from the plurality of different media streams, (iv) any other temporal data stream, and (v) at least one information accessed or created by one of the plurality of parties, the information not being included in the plurality of different media streams.

4. The system of claim 3, wherein the multimedia presentation, when activated, present the progressions of the different media streams as a function of time.

5. The system of claim 4, wherein a first display segment contains a set of text messages between the parties, a second display segment contains a set of voice communications between the parties, and a third display segment contains a video representation of a whiteboard session, a desktop sharing session, an application sharing session, and a power point session.

6. The system of claim 5, wherein the multimedia presentation comprises one or more objects embedded in an object of the same type.

7. The system of claim 1, wherein a first media stream of the plurality of media streams is a pivot and is in a primary display segment, wherein a user selects a second media stream in a secondary display segment as a new pivot, and wherein a processor, in response to the user selection, reorders the multimedia presentation, whereby the second media stream is in the primary display segment and the first media stream is in the secondary display segment.

8. The system of claim 1, wherein a user selects an event along a selected one of the plurality of media streams to navigate to and wherein a processor, in response to the event selection, one of fast forwards and fast reverse automatically to the selected event.

9. The system of claim 1, wherein the transmission of the at least one communication is not controlled by a conferencing application effecting the conference session.

10. The system of claim 9, wherein the at least one communication is one or more of an instant message and an email and wherein the one or more media streams comprise audio information.

11. A method comprising:

receive, by a microprocessor, during a selected time period, a plurality of different media streams exchanged, over a communications network, in one or more communications between a plurality of parties;

generate, by the microprocessor, a multimedia presentation of the plurality of different media streams, wherein the multimedia presentation comprises a plurality of display segments associated with a plurality of;

(i) sequential video images from the plurality of different media streams, (ii) at least one audio or video stream from the plurality of different media streams, (iii) one or more text messages from the plurality of different media streams, (iv) any other temporal data stream, and (v) at least one information accessed or created by one of the plurality of parties, the information not being included in the plurality of different media streams and wherein, in the multimedia presentation, different media streams are referenced according to a common time scale;

generate for display, by the microprocessor, the multimedia presentation to a requestor, wherein the plurality of different media streams are associated with a multimedia session between the plurality of parties, wherein an event association module determines that at least one communication transmitted, by one of the plurality of parties using a first communication device, during the multimedia session, is related to the multimedia session, wherein the at least one communication is not transmitted as part of the multimedia session, wherein the one of the plurality of parties is participating in the multimedia presentation using a second communication device and associates, in the multimedia presentation, a recorded version of the at least one communication with the one or more media streams, and wherein the at least one communication is between the at least one of the plurality of parties and a nonparticipant;

during the multimedia session, determine, by the microprocessor, an electronic address of the first communication device of the one of the plurality of parties; and

track, by the microprocessor, during the multimedia session, and using the electronic address of the first communication device of the one of the multiple participants, a plurality of communications that are separate from the multimedia presentation and sent and received by the first communication device using the electronic address, wherein the at least one communication is one of the plurality of communications that are separate from the conference session.

12. The system of claim 11, wherein the plurality of different media streams are associated with a multimedia session between the plurality of parties and wherein the plurality of different media streams comprise a plurality of an audio conversation between two or more of the parties, video images of at least one or more of the parties, instant messages exchanged between two or more of the parties, email messages exchanged between two or more of the parties, text chat messages exchanged between two or more of the parties, keyboard chat between two or more of the parties, whiteboard session, desktop sharing session, application sharing session, and power point session.

13. The system of claim 11, wherein each of the display segments contains a graphical representation of a different media stream and wherein the plurality of display segments are associated with (i) sequential video images from the plurality of different media streams, (ii) at least one audio or video stream from the plurality of different media streams, (iii) one or more text messages from the plurality of different media streams, (iv) any other temporal data stream, and (v) at least one information accessed or created by one of the plurality of parties, the information not being included in the plurality of different media streams.

14. The system of claim 11, wherein the multimedia presentation, when activated, present the progressions of the different media streams as a function of time.

15. The system of claim 14, wherein a first display segment contains a set of text messages between the parties, a second display segment contains a set of voice communications between the parties, and a third display segment contains a video representation of a whiteboard session, a desktop sharing session, an application sharing session, and a power point session.

16. The system of claim 15, wherein the multimedia presentation comprises one or more objects embedded in an object of the same type.

17. The system of claim 11, wherein a first media stream of the plurality of media streams is a pivot and is in a primary display segment, wherein a user selects a second media stream in a secondary display segment as a new pivot, and wherein a processor, in response to the user selection, reorders the multimedia presentation, whereby the second media stream is in the primary display segment and the first media stream is in the secondary display segment.

18. The system of claim 11, wherein a user selects an event along a selected one of the plurality of media streams to navigate to and wherein a processor, in response to the event selection, one of fast forwards and fast reverse automatically to the selected event.

19. The method of claim 11, wherein the transmission of the at least one communication is not controlled by a conferencing application effecting the conference session.

20. The method of claim 19, wherein the at least one communication is one or more of an instant message and an email and wherein the one or more media streams comprise audio information.