Duplicating digital streams for digital conferencing using switching technologies

• US 9,537,667 B2
• Filed: 05/01/2015
• Issued: 01/03/2017
• Est. Priority Date: 04/30/2001
• Status: Expired due to Term

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Brown, Scott K.
• Primary Examiner(s): Siddiqi, Mohammad A
• Application Number:
  US14/702,505
• Publication Number:
  US 20150270982A1
• Time in Patent Office: 613 Days
• US Class Current: 1/1
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 45/16 Multipoint routing
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Using switching technologies to duplicate packets of a digital stream (e.g., digital video stream) sent from one workstation to multiple recipient workstations, where the switching technologies enable the multiple streams sent from the switch to the recipient workstations to be generated from a single digital stream sent from the sending workstation to the switch. Data units, such as video data units, may be transmitted by using a switch to enable receipt of a stream of data units including a payload portion and an attribute portion from at least two conferencing participants. The switch is used to duplicate at least a subportion of the payload portion of a data unit within the stream of data units, and to enable access to the duplicated subportion of the data unit by two or more conferencing participants.

Claims

1. A method comprising:

concurrently receiving a plurality of data streams that correspond to a plurality of conferencing participants;

determining, by at least one processor, that a first participant is active, wherein the first participant corresponds to a first data stream of the plurality of data streams;

based on determining that the first participant is active, assigning a first priority to the first data stream;

determining, by the at least one processor, that the first priority assigned to the first data stream is higher than priorities of all other data streams of the plurality of data streams; and

based on determining that the first priority is higher than the priorities of all other data streams of the plurality of data streams, providing the first data stream corresponding to the first participant for display in a first position of a user interface.

2. The method as recited in claim 1, wherein determining that the first participant is active comprises determining, based on content of the first data stream, that the first participant has recently spoken into a microphone.

3. The method as recited in claim 1, wherein determining that the first participant is active comprises determining, based on content of the first data stream, that the first participant has recently moved while on camera.

4. The method as recited in claim 1, wherein determining that the first participant is active comprises determining, based on content of the first data stream, that the first participant has recently typed text.

5. The method as recited in claim 1, wherein providing the first data stream from the first participant for display in the first position of the user interface comprises replacing a previously displayed data stream of the plurality of data streams in the first position of the user interface.

6. The method as recited in claim 1, further comprising:

determining, by the at least one processor, that a second participant is active, wherein the second participant corresponds to a second data stream of the plurality of data streams;

based on determining that the second participant is active, assigning a second priority to the second data stream;

determining, by the at least one processor, that the second priority assigned to the second data stream is higher than the first priority assigned to the first data stream; and

based on determining that the second priority is higher than the first priority, providing the second data stream corresponding to the second participant for display in the first position of the user interface.

7. The method as recited in claim 6, further comprising increasing a volume of an audio signal associated with the second data stream from the second participant in response to displaying the second data stream in the first position of the user interface.

8. The method as recited in claim 6, further comprising:

determining that the first participant is inactive;

based on determining the first participant is inactive, assigning the first data stream a lower priority than the first priority; and

ceasing to provide the first data stream in the first position of the user interface based on the lower priority assigned to the first data stream.

9. The method as recited in claim 8, further comprising decreasing a volume of an audio signal associated with the first data stream from the first participant in response to ceasing to provide the first data stream in the first position of the user interface.

10. The method as recited in claim 8, wherein determining that the first participant is inactive comprises determining that the first participant is not speaking into a microphone, moving while on camera, or typing text.

11. The method as recited in claim 1, further comprising:

determining, by the at least one processor, that a second participant is active, wherein the second participant corresponds to a second data stream of the plurality of data streams;

based on determining that the second participant is active, assigning a second priority to the second data stream;

determining, by the at least one processor, that the second priority assigned to the second data stream is higher than the first priority assigned to the first data stream;

receiving, via a client device, user input indicating a selection to display the first data stream in the first position of the user interface; and

based on the selection to display the first data stream, providing the first data stream in the first position of the user interface regardless of the second priority assigned to the second data stream being higher than the first priority assigned to the first data stream.

12. A system comprising:

at least one processor;

at least one non-transitory computer-readable storage medium storing instructions thereon that, when executed by the at least one processor, cause the system to;

concurrently receive a plurality of data streams that correspond to a plurality of conferencing participants;

determine that a first participant is active, wherein the first participant corresponds to a first data stream of the plurality of data streams;

based on determining that the first participant is active, assign a first priority to the first data stream;

determine that the first priority assigned to the first data stream is higher than priorities of all other data streams of the plurality of data streams; and

based on determining that the first priority is higher than the priorities of all other data streams of the plurality of data streams, provide the first data stream corresponding to the first participant for display in a first position of a user interface.

13. The system as recited in claim 12, further comprising instructions that, when executed by the at least one processor, cause the system to determine that the first participant is active comprises determining, based on content of the first data stream, that the first participant has recently spoken into a microphone, moved while on camera, or typed text.

14. The system as recited in claim 12, further comprising instructions that, when executed by the at least one processor, cause the system to:

determine that a second participant is active, wherein the second participant corresponds to a second data stream of the plurality of data streams;

based on determining that the second participant is active, assign a second priority to the second data stream;

determine that the second priority assigned to the second data stream is higher than the first priority assigned to the first data stream; and

based on determining that the second priority is higher than the first priority, provide the second data stream corresponding to the second participant for display in the first position of the user interface.

15. The system as recited in claim 14, further comprising instructions that, when executed by the at least one processor, cause the system to:

determine that the first participant is inactive;

based on determining the first participant is inactive, assigning the first data stream a lower priority than the first priority; and

cease to provide the first data stream in the first position of the user interface based on the lower priority assigned to the first data stream.

16. A non-transitory computer readable medium storing instructions thereon that, when executed by at least one processor, cause a computer system to:

concurrently receive a plurality of data streams that correspond to a plurality of conferencing participants;

determine that a first participant is active, wherein the first participant corresponds to a first data stream of the plurality of data streams;

based on determining that the first participant is active, assign a first priority to the first data stream;

determine that the first priority assigned to the first data stream is higher than priorities of all other data streams of the plurality of data streams; and

based on determining that the first priority is higher than the priorities of all other data streams of the plurality of data streams, provide the first data stream corresponding to the first participant for display in a first position of a user interface.

17. The non-transitory computer readable medium as recited in claim 16, further comprising instructions that, when executed by the at least one processor, cause the computer system to determine that the first participant is active comprises determining, based on content of the first data stream, that the first participant has recently spoken into a microphone, moved while on camera, or typed text.

18. The non-transitory computer readable medium as recited in claim 16, further comprising instructions that, when executed by the at least one processor, cause the computer system to:

determine that a second participant is active, wherein the second participant corresponds to a second data stream of the plurality of data streams;

determine that the second priority assigned to the second data stream is higher than the first priority assigned to the first data stream; and

based on determining that the second priority is higher than the first priority, provide the second data stream corresponding to the second participant for display in the first position of the user interface.

19. The non-transitory computer readable medium as recited in claim 18, further comprising instructions that, when executed by the at least one processor, cause the computer system to:

determine that the first participant is inactive;

based on determining the first participant is inactive, assigning the first data stream a lower priority than the first priority; and

cease to provide the first data stream in the first position of the user interface based on the lower priority assigned to the first data stream.

20. The non-transitory computer readable medium as recited in claim 19, further comprising instructions that, when executed by the at least one processor, cause the computer system to:

decrease a volume of an audio signal associated with the first data stream from the first participant in response to ceasing to provide the first data stream in the first position of the user interface; and

increase a volume of an audio signal associated with the second data stream from the second participant in response to providing the second data stream for display in the first position of the user interface.