Method and apparatus for synchronizing audio and video in encrypted videoconferences

• US 7,464,262 B2
• Filed: 09/12/2003
• Issued: 12/09/2008
• Est. Priority Date: 09/12/2003
• Status: Active Grant

• Current Assignee: Applied Minds LLC
• Original Assignee: Applied Minds, Inc.
• Inventors: Hillis, W. Daniel, Ferren, Bran, Roccanova, Gerard
• Primary Examiner(s): Revak; Christopher A
• Application Number:
  US10/661,110
• Publication Number:
  US 20050058287A1
• Time in Patent Office: 1,915 Days
• Field of Search: None
• US Class Current: 713/150
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

The invention provides a system that preserves the synchronization of the audio and video presented at a secure conferencing site without necessitating decryption, decompression, compression, and encryption of signals at the hub. The presently preferred embodiment of the invention provides an apparatus and method for synchronizing audio and video in encrypted videoconferences that comprises a plurality of conference sites; and a hub for receiving a compressed and encrypted, composite audio and video signal from each site, for determining a currently active site, and for transmitting said composite audio and video signal from said currently active site to all other sites; said hub receiving a compressed and encrypted audio only signal from each site; wherein said hub routes all incoming compressed and encrypted audio only signals to each site.

Claims

1. A method for synchronizing audio and video in encrypted videoconferences, comprising the steps of:

providing a plurality of conference sites; and

providing a hub for receiving a compressed and encrypted, composite audio and video signal from each site, for determining a currently active site, and for transmitting said composite audio and video signal from said currently active site to all other sites;

said hub separately receiving a compressed and encrypted audio only signal from each site;

wherein said hub separately routes all incoming compressed and encrypted audio only signals to each site.

2. The method of claim 1, wherein audio for a site comprises:

a mixed audio signal composed of audio obtained from several microphones at said site.

3. The method of claim 1, performing at each site the steps comprising:

decrypting and decompressing video within said composite audio and video signal for said currently active site.

4. The method of claim 1, further comprising performing at each site the steps comprising:

decrypting and decompressing said compressed and encrypted audio only signal from each site.

5. The method of claim 1, performing at each site the steps comprising:

deselecting an audio only signal corresponding to an audio portion of said composite audio and video signal for said currently active site; and

mixing said audio portion of said composite audio and video signal for said currently active site with all other audio only signals at said site;

wherein audio associated with displayed video is synchronized with said displayed video.

6. The method of claim 5, said audio deselection and mixing steps further comprising the step of:

aligning said audio only signals with said composite audio and video signal.

7. The method of claim 1, wherein said hub transmits at least two composite audio and video signals to each site to provide a split screen display at each site.

8. The method of claim 7, wherein those of said audio only signals which correspond to said at least two composite audio and video signals are deselected at each said site.

9. The method of claim 1, further comprising the step of:

deselecting those audio only signals not directly associated with an ongoing conversation.

10. An apparatus for synchronizing audio and video in encrypted videoconferences, comprising:

a hub for receiving a compressed and encrypted, composite audio and video signal from a plurality of sites, for determining a currently active site, and for transmitting said composite audio and video signal from said currently active site to all other sites;

said hub separately receiving a compressed and encrypted audio only signal from each site;

wherein said hub routes all incoming compressed and encrypted audio only signals to each site, separately from said composite audio and video signal.

11. An apparatus for synchronizing audio and video in encrypted videoconferences among a plurality of sites, at least two of said sites comprising:

a decoder for decrypting and decompressing video within a composite audio and video signal for a currently active site;

a decoder for decrypting and decompressing a compressed and encrypted audio only signal from each site separately from said composite audio and video signal; and

an audio deselection and mixing device for deselecting an audio only signal corresponding to an audio portion of said composite audio and video signal for said currently active site, and for mixing said audio portion of said composite audio and video signal for said currently active site with all other audio only signals at said site;

wherein audio associated with displayed video is synchronized with said displayed video.

12. A method for synchronizing audio and video in encrypted videoconferences, comprising the steps of:

receiving a compressed and encrypted, composite audio and video signal from a plurality of sites at a hub;

determining a currently active site;

transmitting said composite audio and video signal from said currently active site to all other sites with said hub;

separately receiving a compressed and encrypted audio only signal at said hub from each site; and

routing all incoming compressed and encrypted audio only signals to each site from said hub separately from said composite audio and video signal.

13. A method for synchronizing audio and video in encrypted videoconferences among a plurality of sites, comprising at least two of said sites the steps of:

decrypting and decompressing video within a composite audio and video signal for a currently active site;

decrypting and decompressing a compressed and encrypted audio only signal separately received from each site; and

deselecting an audio only signal corresponding to an audio portion of said composite audio and video signal for said currently active site; and

mixing said audio portion of said composite audio and video signal for said currently active site with audio only signals separately received from each site at said currently active site;

wherein audio associated with displayed video is synchronized with said displayed video.