Video telephone system

• US 5,539,452 A
• Filed: 09/06/1994
• Issued: 07/23/1996
• Est. Priority Date: 02/21/1990
• Status: Expired due to Fees

• Current Assignee: Alkanox Corporation
• Original Assignee: Alkanox Corporation
• Inventors: Patel, Ashok, Bush, Daniel R., Zetterower, Charlie W.
• Primary Examiner(s): Kuntz, Curtis
• Assistant Examiner(s): Woo, Stella L.
• Application Number:
  US08/301,893
• Time in Patent Office: 686 Days
• Field of Search: 348/14, 348/17, 348/15, 348/16, 348/18, 379/96
• US Class Current: 348/14.13
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 19/04 using predictive techniques
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/619 the transform being operated outside the prediction loop
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/6137 involving transmission via a telephone network, e.g. POTS
• CPC Class Codes: H04N 21/6187 involving transmission via a telephone network, e.g. POTS
• CPC Class Codes: H04N 7/148 Interfacing a video terminal to a particular transmission medium, e.g. ISDN

Abstract

Apparatus and method are provided for the simultaneous transmission of video information and audio information in substantially real time over an ordinary voice grade telephone line having limited bandwidth in the range of about 300-3400 Hz. Because of the limited bandwidth of the ordinary telephone line, the video and audio information are compressed before transmission thereof. Each of the video information and audio information is separately compressed, mixed together and then further compressed. After the further compression, a composite signal, which includes the mixture of video and audio information, is asynchronously transmitted over the same bandwidth of the ordinary telephone line. Upon reception, the compressed information is expanded and separate video information and audio information are reproduced for viewing and hearing by the receiving party. To reduce the size of the apparatus, application specific integrated circuits (ASICs) are employed. A state machine controller apparatus is integrated with the ASIC technology to control the transfer and storing of video information and audio information and also to control the operation of the various compression and expansion stages associated with the transmitting and receiving channels.

Claims

1. A method for transmitting and receiving video and audio signals over an ordinary telephone line in substantially real time, comprising:

generating at a transmitting station a video signal having video information;

generating at said transmitting station an audio signal having audio information;

producing a signal wherein said signal includes a mixture of compressed video information and compressed audio information, with said video and audio information being provided to form said signal in a manner that permits accurate restoration thereof at a receiving station and proper synchronization of said video information and said audio information;

modulating said signal;

transmitting said signal after said modulating step using an ordinary telephone line having a limited bandwidth in the range of 300-3,400 Hz;

receiving said signal at a receiving station after having been sent over the ordinary telephone line;

demodulating said signal after said receiving step; and

reproducing said video information and said audio information at the receiving station using said signal.

2. A method, as claimed in claim 1, wherein:

said step of generating a video signal includes providing first means having a number of pixels with said number of pixels together comprising a frame and wherein said video signal is generated using a number of frames with an updating of frames being provided at a rate less than 30 frames per second.

3. A method, as claimed in claim 2, wherein:

said video signal is generated using a number of frames with an updating of frames being provided at a rate of about 7.5 frames per second.

4. A method, as claimed in claim 1, wherein:

said compressed video information and compressed audio information are provided using at least a first state machine means and ASIC means.

5. A method, as claimed in claim 1, wherein:

said step of producing includes compressing said video information and separately compressing said audio information.

6. A method, as claimed in claim 1, wherein:

said step of producing includes using a linear predictive coding apparatus to provide compressed audio information.

7. A method, as claimed in claim 6, wherein:

said step of producing includes using correlation function generator means for determining at least one of;

predictor coefficients, pitch period and gain associated with said audio information.

8. A method, as claimed in claim 7, wherein:

said step of producing includes determining a pitch period associated with a predetermined number of samples of said audio information.

9. A method, as claimed in claim 7, wherein:

said step of producing includes determining whether said audio information is voiced or unvoiced.

10. A method, as claimed in claim 7, wherein:

said step of producing includes determining said gain factor using at least some of said audio information and said pitch period.

11. A method, as claimed in claim 7, wherein:

said step of producing includes determining said predictor coefficients using recursively solved equations and correlation function generator means.

12. A method, as claimed in claim 7, wherein:

said step of producing includes comparing sampled audio information with a threshold value to generate a sequence of values for use in determining said pitch period.

13. A method, as claimed in claim 7, wherein:

said step of producing includes correlating samples of said audio information to provide an output used in determining whether said audio information is voiced or unvoiced.

14. A method, as claimed in claim 1, wherein:

said step of producing includes controlling the sending of said compressed audio information and said compressed video information using state machine means.

15. A method, as claimed in claim 1, wherein:

said step of transmitting includes using substantially the same bandwidth to send both said video information and said audio information.

16. A method, as claimed in claim 1, wherein:

said step of transmitting includes asynchronously sending said modulated composite signal.

17. A method, as claimed in claim 1, wherein:

said step of reproducing includes inputting at said receiver station at least one of the following;

predictor coefficients, pitch period and gain factor.

18. A method, as claimed in claim 17, wherein:

said step of reproducing includes controlling at least one of an impulse generator means and a random noise generator means, depending upon whether said audio information is voiced or unvoiced.

19. A method, as claimed in claim 18, wherein:

said step of reproducing includes using at least one of the value of said pitch period and state machine means to control transmission from said impulse generator means and said random noise generator means.

20. A method, as claimed in claim 18, wherein:

said step of reproducing includes outputting a train of impulses from said impulse generator means having a pitch period corresponding to said determined pitch period.

21. A method, as claimed in claim 18, wherein:

said step or reproducing includes outputting an a periodic signal from said random noise generator means when said audio information is unvoiced.

22. A method, as claimed in claim 18, wherein:

said step of reproducing includes inputting an output from one of said impulse generator means and said random noise generator means to gain factor circuit means for controlling the gain associated with an inputted signal.

23. A method, as claimed in claim 22, wherein:

said step of reproducing includes inputting said gain factor to said gain factor circuit means.

24. A method, as claimed in claim 17, wherein:

said step of reproducing includes inputting said predictor coefficients to time-varying digital filter means and using said predictor coefficients to restore said compressed audio information.

25. An apparatus for substantially simultaneously transmitting and receiving video and audio signals over an ordinary voice grade telephone line, comprising:

first means for generating video information;

second means for generating audio information;

third means for producing compressed video information and compressed audio information for transmission, in substantially real time, over an ordinary voice grade telephone line having a bandwidth in the range of 300-3,400 Hz, and said compressed video information and said compressed audio information being transmitted using the same bandwidth, one of said compressed video information and said compressed audio information being used as real numbers and the other one of said compressed video information and said compressed audio information being used as imaginary numbers, said third means including means for determining a difference between previously transmitted video information and current video information;

fourth means for reproducing video information and audio information from said compressed video information and said compressed audio information after transmission thereof;

fifth means for displaying images using said video information; and

sixth means for generating sounds using said audio information.

26. An apparatus, as claimed in claim 25, wherein:

said third means includes means for providing a composite signal having said video information and said audio information mixed together in a manner that permits accurate restoration thereof and proper synchronization between said video information and said audio information at a receiving station.

27. An apparatus, as claimed in claim 26, wherein:

said third means includes modulator means in which said composite signal is used to modulate a first carrier wave.

28. An apparatus, as claimed in claim 27, wherein:

said modulated carrier wave is asynchronously transmitted over the ordinary voice grade telephone line.

29. An apparatus, as claimed in claim 25, wherein:

said third means includes means for providing a single data stream of said compressed video information and said compressed audio information wherein both said compressed video information and said compressed audio information are adapted to be transmitted using the same bandwidth over the ordinary voice grade telephone line.

30. An apparatus, as claimed in claim 25, wherein:

said third means includes means for correlating samples of said audio information.

31. An apparatus, as claimed in claim 30, wherein:

said third means includes predictor coefficient calculator means for receiving outputs from said means for correlating and for determining predictor coefficients associated with said audio information using recursively solved equations.

32. An apparatus, as claimed in claim 25, wherein:

said third means includes pitch period detecting means for determining a value of pitch period associated with a predetermined number of samples of said audio information.

33. An apparatus, as claimed in claim 32, wherein:

said third means includes means for determining whether said audio information is voiced or unvoiced.

34. An apparatus, as claimed in claim 32, wherein:

said third means includes gain factor determinator means for determining a gain factor associated with said audio information.

35. An apparatus, as claimed in claim 25, wherein:

said third means includes a linear predictive coding apparatus that includes a linear predictive coding coder and a linear predictive coding decoder.

36. An apparatus, as claimed in claim 35, wherein:

said linear predictive coding decoder includes impulse generator means for receiving a value of pitch period associated with audio information for outputting an impulse train having a pitch period corresponding to said pitch period value.

37. An apparatus, as claimed in claim 35, wherein:

said linear predictive coding decoder includes random noise generator means for outputting a substantially a periodic signal when unvoiced audio information is being receiving by said decoder.

38. An apparatus, as claimed in claim 35, wherein:

said linear predictive coding decoder includes gain factor circuit means for receiving a magnitude of gain factor and outputting a digital signal having a waveform dependent upon whether audio information is voiced or unvoiced and an amplitude depending upon the magnitude of said gain factor.

39. An apparatus, as claimed in claim 35, wherein:

said linear predictive coding decoder includes time-varying filter digital means for receiving predictor coefficients and for outputting synthesized audio information that substantially represents said audio information generated by said second means.