Modifying payloads of digital streams for digital conferencing

• US 8,843,559 B2
• Filed: 09/15/2012
• Issued: 09/23/2014
• Est. Priority Date: 04/30/2001
• Status: Expired due to Term

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Brown, Scott K.
• Primary Examiner(s): Siddiqi, Mohammad A
• Application Number:
  US13/620,906
• Publication Number:
  US 20130063546A1
• Time in Patent Office: 738 Days
• Field of Search: 709/204, 709/205, 709/244, 709/245, 709/231, 370/260, 370/390, 370/261
• US Class Current: 709/204
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 45/16 Multipoint routing
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Using switching technologies to duplicate packets of a digital stream (e.g., digital video stream) sent from one workstation to multiple recipient workstations, where the switching technologies enable the multiple streams sent from the switch to the recipient workstations to be generated from a single digital stream sent from the sending workstation to the switch. Data units, such as video data units, may be transmitted by using a switch to enable receipt of a stream of data units including a payload portion and an attribute portion from at least two conferencing participants. The switch is used to duplicate at least a subportion of the payload portion of a data unit within the stream of data units, and to enable access to the duplicated subportion of the data unit by two or more conferencing participants.

Claims

1. A method comprising:

receiving a first data unit from a first conference terminal, the first data unit comprising a payload portion and a first attribute portion;

modifying, by at least one processor, a content of the payload portion of the first data unit to generate a modified payload portion, wherein modifying the content of the payload portion of the first data unit to generate the modified payload portion comprises removing a video signal or an audio signal from the payload portion of the first data unit;

duplicating the payload portion of the data unit;

associating a second attribute portion with the duplicated payload portion to generate a second data unit;

associating a third attribute data portion with the modified payload portion to generate a third data unit;

sending the second data unit to a second conference terminal; and

sending the third data unit to a third conference terminal.

2. The method as recited in claim 1, wherein the modified payload portion comprises text content.

3. The method as recited in claim 1, further comprising:

determining one or more capabilities of the third conference terminal; and

modifying the content of the payload portion of the first data unit to generate the modified payload portion based on the capabilities of the third conference terminal.

4. The method as recited in claim 3, wherein the third conference terminal comprises a mobile device.

5. The method as recited in claim 4, wherein the third conference terminal comprises a wireless phone.

6. The method as recited in claim 3, wherein determining one or more capabilities of the third conference terminal comprises determining one or more hardware dictated capabilities.

7. The method as recited in claim 6, wherein detecting one or more hardware dictated capabilities of the third conference terminal comprises detecting a display capability of the third conference terminal.

8. The method as recited in claim 1, further comprising modifying one or more attributes of the payload portion of the first data unit to generate the modified payload portion.

9. The method as recited in claim 8, wherein the one or more attributes of the payload portion of the first data unit comprise one or more of a resolution or a frame rate.

10. The method as recited in claim 8, further comprising:

identifying a user-defined filtering parameter associated with the third conference terminal; and

modifying the content of the payload portion of the first data unit to generate the modified payload portion based on the user-defined filtering parameter associated with the third conference terminal.

13. The method as recited in claim 1, further comprising:

enabling the second conference terminal to perform synchronous conferencing; and

sending data units to the third conference terminal.

11. The method as recited in 10, wherein the user-defined filtering parameter comprises a request to mute audio from a particular conferencing participant.

12. The method as recited in claim 11, wherein modifying the content of the payload portion of the first data unit to generate the modified payload portion comprises removing an audio signal associated with the particular conference participant from the payload portion of the first data unit.

14. A method comprising:

receiving a first data unit from a first conference terminal, the first data unit comprising a payload portion and a first attribute portion;

determining one or more capabilities of a second conference terminal;

modifying, by at least one processor, a content of the payload portion of the first data unit to generate a modified payload portion based on the capabilities of the second conference terminal by removing a video signal or an audio signal from the payload portion of the first data unit;

duplicating the payload portion of the data unit;

associating a second attribute portion with the modified payload portion based on the capabilities of the second conference terminal to generate a second data unit;

sending the second data unit to a second conference terminal;

determining one or more capabilities of a third conference terminal;

modifying, by at least one processor, the content of the payload portion of the first data unit to generate a modified payload portion based on the capabilities of the third conference terminal;

associating a third attribute portion with the modified payload portion based on the capabilities of the third conference terminal to generate a third data unit; and

sending the third data unit to the third conference terminal.

15. The method as recited in claim 14, wherein the second conference terminal comprises a mobile device.

16. The method as recited in claim 15, wherein the second conference terminal comprises a wireless phone.

17. The method as recited in claim 16, wherein determining one or more capabilities of the second conference terminal comprises determining one or more hardware dictated capabilities.

18. The method as recited in claim 17, wherein determining one or more hardware dictated capabilities of the second conference terminal comprises detecting a display capability of the second conference terminal.

19. The method as recited in claim 18, further comprising modifying one or more attributes of the payload portion of the first data unit to generate the modified payload portion.

20. The method as recited in claim 19, wherein the one or more attributes of the payload portion of the first data unit comprise one or more of a resolution or a frame rate.

21. The method as recited in claim 14, further comprising:

identifying a user-defined filtering parameter associated with the second conference terminal; and

modifying the content of the payload portion of the first data unit to generate the modified payload portion based on the user-defined filtering parameter associated with the second conference terminal.

22. The method as recited in claim 21, wherein the user-defined filtering parameter comprises a request to mute audio from a particular conferencing participant.

23. The method as recited in claim 22, wherein modifying the content of the payload portion of the first data unit to generate the modified payload portion comprises removing an audio signal associated with the particular conference participant from the payload portion of the data unit.

24. The method as recited in claim 14, wherein associating a second attribute portion with the modified payload portion to generate a second data unit comprises changing an IP destination address in an IP header of the data unit to reflect destination address information of the second conference terminal.

25. The method as recited in claim 14, further comprising:

determining one or more capabilities of the second conference terminal, wherein determining one or more capabilities of the second conference terminal comprises determining whether the second conference terminal has a camera from which to generate video content.

26. The method as recited in claim 25, wherein modifying the content of the payload portion of the first data unit comprises removing video content from the payload portion based on a determination that the second conference terminal does not have a camera from which to generate video content.

27. The method as recited in claim 14, wherein determining one or more capabilities of the second conference terminal comprises determining an input capability of the second conference terminal.

28. The method as recited in claim 14, wherein determining one or more capabilities of the second conference terminal comprises determining an output capability of the second conference terminal.

29. A system comprising:

at least one processor; and

at least one non-transitory computer readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to;

receive a first data unit from a first conference terminal, the first data unit comprising a payload portion and a first attribute portion;

modify a content of the payload portion of the first data unit to generate a modified payload portion, wherein modifying the content of the payload portion of the first data unit to generate the modified payload portion comprises removing a video signal or an audio signal from the payload portion of the first data unit;

duplicating the payload portion of the data unit;

associate a second attribute portion with the modified payload portion to generate a second data unit;

send the second data unit to a second conference terminal;

associate a third attribute portion with the modified payload portion to generate a third data unit; and

send the third data unit to a third conference terminal.

30. The system as recited in claim 29, wherein the second conference terminal comprises a mobile device.

31. The system as recited in claim 30, further comprising instructions that, when executed by the at least one processor, cause the system to modify one or more attributes of the payload portion of the first data unit to generate the modified payload portion.

32. The system as recited in claim 31, wherein the one or more attributes of the payload portion of the first data unit comprise one or more of a resolution or a frame rate.

33. The system as recited in claim 29, further comprising instructions that, when executed by the at least one processor, cause the system to:

identify a user-defined filtering parameter associated with the second conference terminal; and

modify the content of the payload portion of the first data unit to generate the modified payload portion based on the user-defined filtering parameter associated with the second conference terminal.