Data processor having controlled scalable input data source and method thereof

• US 6,404,776 B1
• Filed: 12/10/1997
• Issued: 06/11/2002
• Est. Priority Date: 03/13/1997
• Status: Expired due to Term

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: 8X8, Inc.
• Inventors: Joe, Truman, Bednarz, Philip Stanley, Andrews, Barry Dean, Voois, Paul Augustin
• Primary Examiner(s): Kizou, Hassan
• Assistant Examiner(s): NGUYEN, HANH N
• Application Number:
  US08/987,800
• Time in Patent Office: 1,644 Days
• Field of Search: 370/468, 370/470, 370/473, 370/477, 370/535-544, 370/465, 370/447, 709/217, 348/14, 348/17, 348/19, 345/302, 707/101-104
• US Class Current: 370/468
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6137 involving transmission via a telephone network, e.g. POTS
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A multimedia communication arrangement processes and multiplexes different types of data, including data from an adaptive data rate data source and a nonadaptive data rate data source, to substantially increase data throughput over a communication channel. The rate at which data is collected from the adaptive data rate data source varies based on the available channel bandwidth of the modem. The transmission rate is optionally adjusted in response to a detected error rate. Furthermore, the amount of filtering performed by a video camera on an image before the image is encoded by a codec can be adjusted. In addition, a data recovery terminal optionally selectively adjusts intervals at which received audio data is sampled to potentially reduce latency periods.

Claims

1. A multimedia communication arrangement for transmitting video and other signal types for communication over a communication channel having an indication of an available bandwidth, comprising:

a first data source including a video image processor constructed to capture images and to present the images as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

at least one additional data source generating at least one additional data signal; and

a data signal processing circuit configured and arranged to collect the first type of data from the first data source at a rate that varies in response to the available channel bandwidth, to collect at least one additional type of data from the at least one additional data source at at least one established rate, and to adjust a rate at which the data collected from at least one of the first and the at least one additional data sources is transmitted in response to a detected error rate.

2. A multimedia communication arrangement, according to claim 1, wherein the data signal processing circuit comprises a multiplexer configured and arranged to detect the error rate.

3. A multimedia communication arrangement, according to claim 1, wherein the error rate is provided externally at least in part, either over the communication channel or by another communication path, and received by the data signal processing circuit.

4. A multimedia communication arrangement, according to claim 1, wherein the data signal processing circuit comprises a multiplexer configured and arranged to detect the error rate by detecting requests for retransmission of data.

5. A multimedia communication arrangement, according to claim 1, wherein the first type of data is presented as one or more data packets, wherein the data signal processing circuit comprises a prediction filter configured and arranged to generate a control signal for adjusting a size of the data packets in response to the detected error rate.

6. A multimedia communication arrangement, according to claim 5, wherein the prediction filter is configured and arranged to provide the control signal to the modem for controlling a transmission rate of the modem.

7. A multimedia communication arrangement, according to claim 1, wherein the data signal processing circuit is further configured and arranged to adjust filtering performed by a video camera.

8. A multimedia communication arrangement, according to claim 1, further comprising a data recovery terminal configured and arranged to selectively adjust an interval at which received audio data is processed.

9. A multimedia communication arrangement, according to claim 1, wherein the data signal processing circuit is further configured and arranged to adjust filtering performed by a video camera, and further comprising a data recovery terminal configured and arranged to selectively adjust an interval at which received audio data is processed.

57. The multimedia communication arrangement of claim 1, wherein the data signal processing circuit is further configured and arranged to receive the error rate over the communication channel.

58. The multimedia communication arrangement of claim 1, wherein the data signal processing circuit is further configured and arranged to detect error rate as a function of requests for retransmissions over the communication channel.

10. A multimedia communication arrangement for transmitting video and other signal types for communication over a communication channel having an indication of an available bandwidth, comprising:

a first data source including a video image processor constructed to capture images from a video camera and to present the images as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

at least one additional data source generating at least one additional data signal; and

a data signal processing circuit configured and arranged to collect the first type of data from the first data source at a rate that varies in response to the available channel bandwidth, to collect at least one additional type of data from the at least one additional data source at at least one established rate, and to adjust filtering performed by the video camera.

11. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is configured and arranged to adjust the amount of filtering performed by the video camera by providing a control signal to the video camera.

12. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is configured and arranged to adjust filtering performed by the video camera by using a video processor.

13. A multimedia communication arrangement, according to claim 12, wherein the video processor comprises a line filter for filtering the images with respect to a first direction.

14. A multimedia communication arrangement, according to claim 13, wherein the video processor further comprises a filter block for filtering the images with respect to a second direction.

15. A multimedia communication arrangement, according to claim 14, further comprising a compressor configured and arranged to compress the filtered images.

16. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is configured and arranged to adjust the amount of filtering performed by the video camera by using a video decoder.

17. A multimedia communication arrangement, according to claim 10, wherein the video decoder comprises a filtering control block configured and arranged to provide a control signal to the data signal processing circuit.

18. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is configured and arranged to adjust the amount of filtering performed by the video camera by using a rate controller configured and arranged to provide a control signal to at least one of the video camera and the data signal processing circuit.

19. A multimedia communication arrangement, according to claim 18, wherein the rate controller is configured and arranged to generate the control signal based on a level of motion in at least some of the captured images.

20. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is further configured and arranged to defocus the video camera to an extent determined at least in part as a function of the level of motion.

21. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is further configured and arranged to adjust a rate at which the collected data is transmitted in response to a detected error rate.

22. A multimedia communication arrangement, according to claim 10, further comprising a data recovery terminal configured and arranged to selectively adjust an interval at which received audio data is processed.

23. A multimedia communication arrangement, according to claim 10, wherein the data signal processing circuit is further configured and arranged to adjust a rate at which the collected data is transmitted in response to a detected error rate, and further comprising a data recovery terminal configured and arranged to selectively adjust an interval at which received audio data is processed.

24. For use in a multimedia communication arrangement for transmitting video and other signal types for transmission over a communication channel having an indication of an available bandwidth, a data recovery arrangement comprising:

a memory configured and arranged to store data received from the communication channel; and

a data signal processing circuit responsive to the memory and configured and arranged to sample audio data from the memory at selectively adjustable intervals.

25. A data recovery arrangement, according to claim 24, wherein the data signal processing circuit is configured and arranged to monitor a time period during which audio data had been resident in the memory before being sampled.

26. A data recovery arrangement, according to claim 25, wherein at least one of the intervals is adjusted in response to the time period being relatively long.

27. A data recovery arrangement, according to claim 25, further comprising a scheduling block responsive to the data signal processing arrangement and configured and arranged to adjust at least one of the intervals in response to the time period being relatively long.

28. A data recovery arrangement, according to claim 24, wherein the data signal processing arrangement is configured and arranged to monitor a quantity of shifts performed in connection with sampling the audio data from the memory.

29. A data recovery arrangement, according to claim 28, wherein at least one of the intervals is adjusted in response to the quantity of shifts being relatively low.

30. A data recovery arrangement, according to claim 28, further comprising a scheduling block responsive to the data signal processing arrangement and configured and arranged to adjust at least one of the intervals in response to the quantity of shifts being relatively low.

31. A method for formatting multiple types of data, including data representing images, for transmission over a communication channel having an indication of an available bandwidth, the method comprising:

presenting captured images as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

generating at least one additional type of data;

collecting the first type of data at a rate that varies in response to the available channel bandwidth;

collecting the at least one additional type of data at at least one established rate; and

adjusting a rate at which the data collected from at least one of the first and the at least one additional data sources is transmitted in response to a detected error rate.

32. A method, according to claim 31, further comprising receiving the error rate.

33. A method, according to claim 31, further comprising using a multiplexer to detect the error rate.

34. A method, according to claim 33, further comprising using the multiplexer to detect requests for retransmission of data.

35. A method, according to claim 31, further comprising:

presenting the first types of data as one or more data packets;

using a prediction filter to generate a control signal based on the detected error rate; and

in response to the control signal, adjusting a size of the data packets based on the detected error rate.

36. A method, according to claim 35, further comprising using the control signal to adjust the rate at which the collected data is transmitted.

37. A method, according to claim 31, further comprising adjusting filtering performed by a video camera.

59. The method of claim 31, further including receiving the error rate over the communication channel.

60. The method of claim 31, further including detecting the error rate as a function of requests for retransmissions over the communication channel.

38. A method for formatting multiple types of data, including data representing images, for transmission over a communication channel having an indication of an available bandwidth, the method comprising:

presenting images captured using a video camera as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

generating at least one additional type of data;

collecting the first type of data at a rate that varies in response to the available channel bandwidth;

collecting the at least one additional type of data at at least one established rate; and

adjusting filtering performed by the video camera.

39. A method, according to claim 38, further comprising providing a control signal to the video camera for adjusting the filtering performed by the video camera.

40. A method, according to claim 38, further comprising using a video processor to adjust the filtering performed by the video camera.

41. A method, according to claim 38, further comprising using a line filter to filter the images with respect to a first direction.

42. A method, according to claim 39, further comprising using a filter block to filter the images with respect to a second direction.

43. A method, according to claim 42, further comprising using a compressor to compress the filtered images.

44. A method, according to claim 38, further comprising using a video decoder to adjust the filtering performed by the video camera.

45. A method, according to claim 38, further comprising using at least one of a filtering control block and a rate controller to provide a control signal to at least one of the video camera and the data signal processing circuit.

46. A method, according to claim 45, further comprising generating the control signal based at least in part on a level of motion in at least some of the captured images.

47. A method, according to claim 46, further comprising defocusing the video camera to an extent determined at least in part as a function of the level of motion.

48. A method, according to claim 38, further comprising adjusting a rate at which the collected data is transmitted in response to a detected error rate.

49. A method for recovering data transmitted over a communication channel, comprising:

storing data received from the communication channel in a memory; and

using a data signal processing circuit to sample audio data from the memory at selectively adjustable intervals.

50. A method, according to claim 49, further comprising monitoring a time period during which audio data had been resident in the memory before being decoded.

51. A method, according to claim 50, further comprising scheduling a decode operation in response to the time period the date has been resident in memory.

52. A method, according to claim 50, further comprising monitoring a quantity of shifts performed in connection with sampling the audio data from the memory.

53. A method, according to claim 52, further comprising adjusting at least one of the intervals in response to the quantity of shifts being relatively low.

54. An arrangement for formatting multiple types of data, including data representing images, for transmission over a communication channel having an indication of an available channel bandwidth, the system comprising:

means for presenting captured images as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

means for generating at least one additional type of data;

means for collecting the first type of data at a rate that varies in response to the available channel bandwidth;

means for collecting at least one additional type of data at at least one established rate; and

means for adjusting a rate at which the data collected from at least one of the first and the at least one additional data sources is transmitted in response to a detected error rate.

55. An arrangement for formatting multiple types of data, including data representing images, for transmission over a communication channel having an indication of an available channel bandwidth, the system comprising:

means for presenting images captured using a video camera as a first type of data at a rate that varies in response to an available bandwidth factor for the communication channel;

means for generating at least one additional type of data;

means for collecting the first type of data at a rate that varies in response to the available channel bandwidth;

means for collecting the at least one additional type of data at at least one established rate; and

means for adjusting filtering performed by the video camera.

56. A data recovery arrangement for recovering data transmitted over a communication channel, comprising:

means for storing data received from the communication channel in a memory; and

means for using a data signal processing circuit to sample audio data from the memory at selectively adjustable intervals.