Interactive conference content distribution device and methods of use thereof

• US 6,760,749 B1
• Filed: 05/10/2000
• Issued: 07/06/2004
• Est. Priority Date: 05/10/2000
• Status: Expired due to Term

• Current Assignee: Polycom Incorporated (Plantronics, Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Dunlap, Wayne, Hogan, Michael, Dunn, Kristin, Ba, DahRenn, VanderKam, Rick, McMillan, Oden J., Kha, Samantha
• Primary Examiner(s): Lim, Krisna
• Application Number:
  US09/568,642
• Time in Patent Office: 1,518 Days
• Field of Search: 709/204, 348/14.08, 348/14.09, 345/716, 345/719, 345/730, 370/260, 370/270
• US Class Current: 709/204
• CPC Class Codes: G09G 2370/06 Consumer Electronics Control, i.e. control of another device by a display or vice versa
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A multimedia distribution device includes an embedded stream encoder and an embedded stream server for encoding and transmitting, through utilization of streaming technology, audio and video content originating from a videoconference site and received through a network interface, to network-connected terminals. In situations in which the videoconference includes the presentation of slides or other content, the device may include a file conversion engine for converting the presentation content received through a data interface into a standard graphic image format, for synchronous distribution with the audio and video content stream. The multimedia content may be viewed in a multiple-window interface, wherein the audio and video content is presented by a streaming media player, and the presentation content is displayed in a separate window. Additionally, the interface may include an interactive text entry interface, through which the viewer may submit comments or questions to the conference presenters. In an operating architecture that includes a separate remote streaming server and a separate network server, a method of distributing content to a large number of viewers includes continuously transmitting the current and successive presentation images to the network server for caching, whereby the viewer web browser can request and locally cache the images prior to arrival of the associated audio and video content.

Claims

1. A multimedia distribution device, comprising:

a network interface, for coupling the distribution device to a network, the network interface operative to receive audio and video data from a peripheral videoconferencing device at a conference site, the audio data representative of speech and the video data representative of human behavior,

an encoder in communication with the network interface, for creating a stream of data from the audio data and the video data, the stream being encoded in a streaming technology format; and

a stream server, for transmitting the stream to at least one remote terminal connected to the network.

2. The distribution device of claim 1, further comprising a medium for storing the stream for future viewing.

3. A multimedia distribution device, comprising:

a network interface, for coupling the distribution device to a network, the network interface operative to receive audio and video data from a peripheral videoconferencing device at a conference site, the audio data representative of speech and the video data representative of human behavior;

an encoder in communication with the network interface, for creating a stream of data from the audio data and the video data, the steam being encoded in a streaming technology format;

a stream server, for transmitting the stream to at least one remote terminal connected to the network;

a data interface, for receiving presentation data from a source; and

a file conversion engine, for creating a graphic image file by converting the presentation data into a graphic image format;

wherein the stream includes the audio data and the video data and a link to the location of the graphic image.

4. The distribution device of claim 3, further comprising:

a web server, for transmitting the graphic image to the at least one remote terminal connected to the network, the graphic image representing the presentation data currently being displayed at the conference site.

5. The distribution device of claim 4, wherein the presentation data comprises a file created through utilization of a presentation, word processing, or spreadsheet application.

6. The distribution device of claim 4, wherein the web server transmits a web page, the web page including a presenter toolbar enabling the user of the at least one remote terminal to remotely transmit the presentation data to the data interface.

7. The distribution device of claim 4, further comprising a display module for displaying the audio data and the video data and the presentation data at the conference site.

8. The distribution device of claim 4, wherein the web server transmits a web page, the web page comprising:

a first window, for viewing a decoded display of the encoded video data;

a second window, for viewing the graphic image; and

a third window, including a text entry interface for the user of the at least one remote terminal to communicate with the persons located at the conference site by inserting text into the text entry interface and transmitting the text to the distribution device for display by the display module, for viewing by the persons located at the conference site.

9. The distribution device of claim 4, wherein the device is operative to utilize an external web server for transmitting the graphic image to the at least one remote terminal.

10. The distribution device of claim 9, wherein the graphic image is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

11. The distribution device of claim 10, wherein a second graphic image representing a second presentation data successive to the one currently being displayed at the conference site is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

12. The distribution device of claim 9, wherein the graphic image is cached at the at least one remote terminal to facilitate rapid display of the graphic image at the at least one remote terminal.

13. The distribution device of claim 12, wherein a second graphic image representing a second presentation data successive to the one currently being displayed at the conference site is cached at the at least one remote terminal to facilitate rapid display of the graphic image at the at least one remote terminal.

14. The distribution device of claim 3, wherein the source comprises an internal device for reading information stored on a portable data storage medium.

15. The distribution device of claim 3, wherein the source comprises an external application device coupled to the distribution device through the network interface.

16. The distribution device of claim 3, wherein the device is operative to utilize an external stream server coupled to the device through the network for transmitting the stream to at least one remote terminal connected to the network.

17. A multimedia distribution device for use with a network, a videoconferencing device at a conference site, a source providing presentation data and at least one remote terminal connected to the network, the distribution device, comprising:

a network interface for coupling to the network;

an audio and video interface for receiving audio and video data from the videoconferencing device, the audio data representative of speech and the video data representative of human behavior;

an encoder coupled to the audio and video interface for encoding the audio and the video data received through the audio and video interface into a streaming technology format;

a data interface for receiving presentation data from the source; and

a file conversion engine coupled to the data interface for creating a graphic image file by converting the presentation data into a graphic image format and storing the graphic image file at a location; and

a stream server coupled to the encoder, the file conversion engine, and the network interface for transmitting streaming data for receipt by at least one remote terminal connected to the network, wherein the streaming data includes the audio and video data in streaming technology format and a link to the location of the graphic image file.

18. The distribution device of claim 17, further comprising:

a web server coupled to the file conversion engine and the network interface for transmitting the graphic image file to the network for receipt by at least one remote terminal connected to the network, the graphic image file representing the presentation data currently being displayed at the conference site.

19. The distribution device of claim 18, wherein the presentation data comprises a file created through utilization of a presentation, word processing, or spreadsheet application.

20. The distribution device of claim 18, wherein the web server is for transmitting a web page, the web page including a presenter toolbar enabling the user of the at least one remote terminal to remotely transmit the presentation data to the data interface.

21. The distribution device of claim 18, further comprising a display module for displaying the audio data, the video data and the presentation data at the conference site.

22. The distribution device of claim 18, wherein the web server is for transmitting a web page, the web page operative to cause the development of:

a first window for viewing a decoded display of the encoded video data;

a second window for viewing the graphic image; and

a third window including a text entry interface for the user of the at least one remote terminal to communicate with the persons located at the conference site by inserting text into the text entry interface and transmitting the text to the distribution device for display by the display module, for viewing by the persons located at the conference site.

23. The distribution device of claim 18, wherein the device is operative to utilize an external web server for transmitting the graphic image to the at least one remote terminal.

24. The distribution device of claim 23, wherein the graphic image is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

25. The distribution device of claim 24, wherein a second graphic image representing a second presentation data successive to the one currently being displayed at the conference site is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

26. The distribution device of claim 17, wherein the presentation data source is external to the distribution device and the data interface is the network interface.

27. The distribution device of claim 17, wherein the device is operative to utilize an external steam server coupled to the device through the network for transmitting the stream to at least one remote terminal.

28. The distribution device of claim 17, further comprising a medium for storing the strewing data for future viewing.

29. A multimedia distribution device for transmitting audio, video and/or other data between a local site and remote sites via a digital electronic network, comprising:

a network interface for communicating with other devices on the network;

an audio and video interface for receiving audio and video data from a peripheral videoconferencing device at a local site;

a streaming encoder coupled to the audio and video interface for creating streaming audio and video data in streaming technology format from the received audio and video data;

a streaming server coupled to the network interface and the streaming encoder for transmitting streaming audio and video data in streaming technology format; and

a web server coupled to the network interface for receiving and transmitting image data and text data.

30. The multimedia distribution device of claim 29, further comprising:

a file conversion engine coupled to the web server for creating image data by converting presentation data to image data.

31. The multimedia distribution device of claim 30, wherein the presentation data comprises at least one of slide presentations, word processing documents or spreadsheets.

32. The multimedia distribution device of claim 29, further comprising:

a storage device coupled to the streaming server for storing data including at least one of streaming audio and video data, presentation data, text data or image data.

33. The multimedia distribution device of claim 29, wherein the web server is operative to receive user input and to authenticate user identity.

34. The multimedia distribution device of claim 33, wherein the web server is operative to transmit a web page, the web page operative to cause the development of:

a first window for displaying streaming video data and playing streaming audio data;

a second window for displaying images; and

a third window for displaying text data and accepting text data from a user of at least one remote terminal to communicate with the persons located at the local site.

35. The multimedia distribution device in claim 34, wherein the web server is operative to receive a command from a user to display a requested image in the second window.

36. The multimedia distribution device in claim 34, wherein the streaming video and audio data contain links to the images, and wherein an image would be displayed in the second window when the audio and video data which contain the corresponding link would be displaying in the first window.

37. A method for multimedia conferencing wherein audio, video, still image and text data are received and transmitted through a network, the method comprising:

receiving audio and video data from a local multimedia conferencing unit through an audio and video interface;

encoding audio and video data to streaming audio and video data streaming technology format;

transmitting streaming audio and video data in streaming technology format through the network;

transmitting still images through the network; and

transmitting text data through the network.

38. The method for multimedia conferencing of claim 37, further comprising:

converting presentation data into still images for transmission.

39. The method for multimedia conferencing of claim 37, further comprising:

receiving text data from a user; and

authenticating the user identity.

40. The method for multimedia conferencing of claim 39, further comprising:

allowing the user to manipulate the transmission of the still images and text data including uploading presentation data and selecting still images for transmission.

41. The method for multimedia conferencing of claim 37,

wherein the network is the Internet;

and

wherein the streaming audio and video data, the still images and the text data are transmitted for displaying in three windows in a web browser.

42. The method for multimedia conferencing of claim 37, further comprising:

receiving the streaming audio and video data, the still images and text data at an intermediate server; and

the intermediate server retransmitting the streaming audio and video data, the still images and text data.

43. The method for multimedia conferencing of claim 37, further comprising:

embedding a control signal in the streaming audio and video data, wherein the control signal controls the timing of when the still images are transmitted.

44. A multimedia distribution device for use with a network, a videoconferencing device at a conference site and at least one remote terminal connected to the network, the distribution device comprising:

an interface for coupling to the network and the video conferencing device to receive audio and video data from the videoconferencing device;

an encoder coupled to the interface for creating a stream of data from the received audio and video data; and

a stream server coupled to the encoder and the interface for transmitting the stream of data over the network for receipt by the remote terminal.

45. The distribution device of claim 44, wherein the interface includes a network interface for coupling to the network and an audio and video interface for coupling to the videoconferencing device.

46. A multimedia distribution device for use with a network, videoconferencing device at a conference site and at least one remote terminal connected to the network, the distribution device further for use with a source providing presentation data, wherein the interface is further for coupling to the presentation data source to receive presentation data, the distribution device comprising:

an interface for coupling to the network and the video conferencing device to receive audio and video data from the videoconferencing device;

an encoder coupled to the interface for creating a stream of data from the received audio and video data;

a stream server coupled to the encoder and the interface for transmitting the stream of data over the network for receipt by the remote terminal;

a file conversion engine coupled to the interface for creating and storing a graphic image file by converting the received presentation data into a graphic image format, and

wherein the stream server is coupled to the file conversion engine and includes a link to the location of the graphic image file in the stream.

47. The distribution device of claim 46, further comprising:

a web server coupled to the interface and the file conversion engine for transmitting the graphic image file to the network for receipt by at least one remote terminal, the graphic image file representing the presentation data currently being displayed at the conference site.

48. The distribution device of claim 47, wherein the presentation data comprises a file created through utilization of a presentation, word processing, or spreadsheet application.

49. The distribution device of claim 47, wherein the web server is for transmitting a web page, the web page including a presenter toolbar enabling the user of the at least one remote terminal to remotely transmit the presentation data to the data interface.

50. The distribution device of claim 47, comprising a display module for displaying the audio data, the video data and the presentation data at the conference site.

51. The distribution device of claim 47, wherein the web server is for transmitting a web page, the web page operative to cause the development of:

a first window for viewing a decoded display of the encoded video data;

a second window for viewing the graphic image; and

a third window including a text entry interface for the user of the at least one remote terminal to communicate with the persons located at the conference site by inserting text into the text entry interface and transmitting the text to the distribution device for display by the display module, for viewing by the persons located at the conference site.

52. The distribution device of claim 47, wherein the device is operative to utilize an external web server for transmitting the graphic image to the at least one remote terminal.

53. The distribution device of claim 52, wherein the graphic image is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

54. The distribution device of claim 53, wherein a second graphic image representing a second presentation data successive to the one currently being displayed at the conference site is cached at the external web server to facilitate rapid transmission to the at least one remote terminal.

55. The distribution device of claim 46, wherein the presentation data source is external to the distribution device.

56. The distribution device of claim 46, wherein the device is operative to utilize an external stream server coupled to the device through the network for transmitting the stream to at least one remote terminal.

57. The distribution device of claim 46, further comprising a medium for storing the streaming data for future viewing.