Systems and method for enhancing teleconferencing collaboration

• US 7,092,002 B2
• Filed: 08/03/2004
• Issued: 08/15/2006
• Est. Priority Date: 09/19/2003
• Status: Expired due to Fees

• Current Assignee: Applied Minds LLC
• Original Assignee: Applied Minds, Inc.
• Inventors: Hillis, W. Daniel, Ferren, Bran
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US10/911,079
• Publication Number:
  US 20050062844A1
• Time in Patent Office: 742 Days
• Field of Search: 348 1401- 1409, 348/14.1, 348/14.11, 348/14.12, 348/14.13, 370/260, 370/261, 709/204
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

An advanced video teleconferencing (AVTC) system uniquely combines a number of features to promote a realistic “same room” experience for meeting participants. These features include an autodirector to select audio and video sources and to compose shots, a collaboration interface for each participant to communicate nonverbal information, directional LEDs to privately alert participants, audio reflected from the main display, and a collaborative table to share a view of objects or papers on a table. When implemented with sufficient bandwidth for take advantage of these features and to keep latency time low, this AVTC system results in a highly realistic and productive teleconferencing experience.

Claims

1. A video teleconferencing (VTC) system comprising:

at least one site with at least one station at each said site, each station accommodating one participant;

a first display screen within view of each participant;

a videocamera associated with each station and positioned wherein a participant at said each station is located within said videocamera'"'"'s field of view;

at least one microphone, wherein each participant situated at each station falls within the audio range of said microphone;

an automated video switching system that, based on audio activity and operating modes;

automatically selects, from among one or more video camera feeds and inputs, a video signal for transmission to one or more remote videoconferencing sites; and

selects from among incoming video signals a single incoming signal for display on said first display, wherein each of said at least one video conferencing sites receives one or more incoming video signals; and

an interface at each station comprising a second display screen and collaboration tools for communication of nonverbal information between said each participant.

2. The VTC of claim 1, wherein said system contains more than one station at a site.

3. The VTC of claim 1, wherein said automated video switching system has operating modes that adjust video selection criteria and parameters.

4. The VTC of claim 3, wherein said operating modes can be created by the user.

5. The VTC of claim 3, wherein said operating modes can be adjusted by the user.

6. The VTC of claim 3, wherein said automated video switching system comprises a speech mode, wherein the image of a specified participant at a site is displayed continuously to all participants at other sites.

7. The VTC of claim 3, wherein said automated video switching system comprises a lecture mode, wherein two specified participants at different sites view only each other, and wherein all participants at other than said different sites view said two specified participants alternately.

8. The VTC of claim 3, wherein said automated video switching comprises a view force mode, wherein an individual site can force selection of a particular videocamera at said individual site, such that all other sites when viewing said individual site will view only the video signal from said particular videocamera.

9. The VTC of claim 1, wherein, said automated video switching comprise a fast switching mode, wherein videocameras are selected quickly and often to track rapid exchanges such as that occur in an initial phase of a videoconference, when individuals introduce themselves and meet one another.

10. The VTC of claim 1, wherein said collaboration tools comprise a means of sending notes to other stations.

11. The VTC of claim 1 further comprising at least one speaker wherein audio produced by said speaker is reflected from said display screen, such that said audio appears to said each participant to be originating from said display screen.

12. The VTC of claim 1, further comprising a collaborative table, comprising:

a table videocamera positioned to capture images of a table surface situated at a first of said at least one site; and

a projector, located at another of said at least one site, communicatively coupled with said table videocamera and positioned to project images received from said table videocamera onto a viewing surface.

13. The VTC of claim 12, wherein stationary portions of the image from said table videocamera are encoded for transmission at relatively high resolution and moving portions of said image are encoded for transmission at relatively low resolution for efficient use of available communications bandwidth.

14. The VTC of claim 12, wherein said image is decomposed into a multiscale stack of Images, comprised of a low resolution base image and successively higher resolution terms, and wherein said higher resolution terms can be combined with said low resolution base image to form images of selectable quality and size to accommodate available communications bandwidth.

15. The VTC of claim 1, said automated video switching system comprising a speech recognition system for detecting key expressions comprising any of said each participant names and key phrases and for adjusting switching behavior accordingly.

16. The VTC of claim 1, further comprising a means for identifying participants by a signal from participant transponders, such as radio frequency identification (RFID) tags.

17. The VTC of claim 1, further comprising selectably energizable light sources, positioned to gain attention of specific participants without alerting other participants.

18. The VTC of claim 17, wherein said light sources are LEDs, affixed to said videocan,era associated with each station, wherein said LEDs are aligned with the optical axis of said videocamera associated with each station and mounted so as to alert only the participant at said each station.

19. The VTC of claim 17, wherein said light sources are LEDS, affixed to said videocamera associated with each station, wherein said LEDs are aligned with the optical axis of said videocamera associated with each station and mounted so as to alert only the participant at said each station.

20. The VTC of claim 1, further comprising selectably energizable light sources, positioned to gain attention of specific participants without alerting other participants.

21. A video teleconferencing (VTC) system comprising:

at least one site with at least one station at each said site, each station accommodating one participant;

a first display screen within view of each participant;

a videocamera associated with each station and positioned wherein a participant at said each station is located within said videocamera'"'"'s field of view;

at least one microphone, wherein each participant situated at each station falls within the audio range of said; and

an automated video switching system that, based on audio activity and operating modes for adjusting selection criteria and parameters;

automatically selects, from among one or more video camera feeds and inputs, a video signal for transmission to one or more remote videoconferencing site; and

selects from among incoming video signals a single incoming signal for display on said first display, wherein each of said at least one video conferencing sites receives one or more incoming video signals.

22. The VTC of claim 21, wherein said system contains more than one station at a site.

23. The VTC of claim 21, each of said stations further comprising an interface comprising a second video display and collaboration tools for communication of nonverbal information between said each participant.

24. The VTC of claim 23, wherein said collaboration tools comprise a means for sending notes to other stations.

25. The VTC of claim 21, wherein said operating modes can be created by the user.

26. The VTC of claim 21, wherein said operating modes can be adjusted by the user.

27. The VTC of claim 21, wherein said operating modes comprise a speech mode, wherein the image of a specified participant at a site is displayed continuously to all participants at other sites.

28. The VTC of claim 21, wherein said operating modes comprise a lecture mode, wherein two specified participants at different sites view only each other, and wherein all participants at other than said different sites view said two specified participants alternately.

29. The VTC of claim 21, wherein said operating modes comprise a view force mode, wherein an individual site can force selection of a particular videocamera at said individual site, such that all other sites when viewing said individual site will view only the video signal from said particular videocamera.

30. The VTC of claim 21, wherein said operating modes comprise a fast switching mode, wherein videocameras are selected quickly and often to track rapid exchanges such as that occur in an initial phase of a videoconference, when individuals introduce themselves and meet one another.

31. The VTC of claim 30, wherein stationary portions of the image from said table videocamera are encoded, for transmission at relatively high resolution and moving portions of said image are encoded for transmission at relatively low resolution for efficient use of available communications bandwidth.

32. The VTC of claim 30, wherein said image is decomposed into a multiscale stack of images, comprised of a low resolution base image and successively higher resolution terms;

and wherein said higher resolution terms can be combined with said low resolution base image to form images of selectable quality and size to accommodate available communications bandwidth.

33. The VTC of claim 21, further comprising at least one speaker wherein audio provided by said speaker is reflected from said display screen, such that said audio appears to said participants to be originating from said display screen.

34. The VTC of claim 21, further comprising a collaborative table, the collaborative table comprising:

a table videocamera positioned to capture images of a table surface situated

at a first of said at least one site; and

a projector, located at another of said at least one site, communicatively coupled with said table videocamera and positioned to project images received from said table videocamera onto a viewing surface.

35. The VTC of claim 21, said automated video switching system comprising a speech recognition system for detecting any of said each participant names and key phrases and for adjusting switching behavior accordingly.

36. The VTC of claim 21, further comprising a means by identifying participants by a signal from participant transponders, such as radio frequency identification (RFID) tags.