Systems and methods for enhancing teleconferencing collaboration

• US 8,159,521 B2
• Filed: 02/26/2008
• Issued: 04/17/2012
• Est. Priority Date: 08/03/2004
• Status: Active Grant

• Current Assignee: Applied Minds LLC
• Original Assignee: Applied Minds LLC
• Inventors: Ferren, Bran, Hillis, W. Daniel, McKnight, Thomas, Yukich, Rudy, Gaskill, Braddock
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US12/037,898
• Publication Number:
  US 20080204545A1
• Time in Patent Office: 1,512 Days
• Field of Search: 348 1401- 1416, 370260-261, 709204-205
• US Class Current: 348/14.08
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

An advanced video teleconferencing system facilitates an engaging and realistic video conferencing experience. Key design elements and video, audio, and control capabilities are provided for a video conferencing experience that cannot be attained with conventional methods, which elements and capabilities include careful design of the table and room at each site, supplementary displays showing imagery in a mirrored manner, networked environmental control, an AutoDirector with keyword and gesture recognition, and audio reflection from a display or beam splitter.

Claims

1. An apparatus for synchronizing an environment of each of two or more conference sites to strengthen a same-room experience of conference participants at each of said two or more conference sites, comprising any of:

means for adjusting lighting levels at both the first site and at any synchronized, remote sites when a participant at said first site adjusts lighting controls at said first site; and

a database for storing conference state in a hierarchical, tree-like data structure to effect synchronization between each of said two or more conference sites;

wherein a root node of said tree-like structure corresponds to an entire conference state; and

wherein primary branches of said tree-like structure represent any of lighting, audio, climate, and security.

2. The apparatus of claim 1, further comprising:

means for adjusting any of audio levels, climate settings, and security levels at both the first site and at any synchronized, remote sites when a participant at said first site adjusts any of audio levels, climate setting, and security levels at said first site.

3. The apparatus of claim 2, said means for adjusting security levels comprising:

means for detecting when a participant entering one site does not possess clearance to view material currently displayed on any of supplementary displays and a collaboration interface; and

means for blanking any of said supplementary displays and collaborative interface at all sites when said participant is detected by said detecting means.

4. The apparatus of claim 1, wherein a smaller sub-branch of said tree-like structure corresponds to an individual bank of lights.

5. The apparatus of claim 1, wherein at least one primary branch of said tree-like structure tracks any of which participant stations are occupied and a state of collaboration tools associated with said participant stations.

6. The apparatus of claim 5, wherein said associated collaboration tools comprise any of:

collaborative whiteboard contents and senders, recipients, and contents of private messages.

7. The apparatus of claim 1, wherein each site maintains a local copy of an entire conference state and, at any time, one site is designated as a conference master;

wherein conference sites synchronize a portion of a conference state by notifying said conference master by subscribing as a listener to a particular node within said tree-like structure;

wherein if a subscribing site detects a change in said conference state within a portion of said tree-like structure radiating from a subscribed node, it informs said conference master of said change in state;

wherein said conference master then notifies all sites that have subscribed to said portion of said tree-like structure affected by said change in state;

wherein said notification contains updated values of said conference state in said affected portion of said tree-like structure; and

wherein each notified site then updates its local copy of said conference state accordingly.

8. The apparatus of claim 1, wherein said database stores a conference state and maintains synchronization of said conference state.

9. The apparatus of claim 8 wherein state is maintained in an event driven manner.

10. The apparatus of claim 8, wherein state is stored in a distributed fashion.

11. The apparatus of claim 8, wherein said database effects redundant storage of said conference state.

12. The apparatus of claim 8, wherein said state ensures that a new conference master is selected should an existing conference master become unavailable due to a failure.

13. The apparatus of claim 1, further comprising:

means for polling said database for all or a portion of said conference state;

wherein sites can join a conference already in progress;

wherein upon joining a conference and subscribing to one or more nodes within said tree-like structure, said joining site polls said database for a subscribed portion of said tree-like structure and synchronizes its state to a state shared by conference sites already present in said conference.

14. The apparatus of claim 1, wherein each site additionally stores a local state for site dependent information.

15. The apparatus of claim 1, further comprising:

a network transparent programming language for implementing said database, comprising means for linking multiple interpreters together over a network and for providing network transparency of stack symbol lookups.

16. The apparatus of claim 15, said programming language further comprising:

an event notification system for notifying sites of changes to structures;

wherein sites can subscribe as listeners to a node, and receive notification of changes made to said node.

17. The apparatus of claim 16, said notification system further comprising:

a communications layer for passing and broadcasting at least one message to interested parties anywhere on a teleconference site network by setting a value field of known node to the content of said message.