Videoconferencing systems with recognition ability

• US 6,693,663 B1
• Filed: 06/14/2002
• Issued: 02/17/2004
• Est. Priority Date: 06/14/2002
• Status: Active Grant

• Current Assignee: CDN Innovations, LLC (IP Investments Group LLC)
• Original Assignee: Scott C Harris
• Inventors: Harris, Scott C.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US10/064,158
• Time in Patent Office: 613 Days
• Field of Search: 379/52, 379/93.15, 348/14-1-, 348/14.1, 348/14-1-, 704/2, 704/3, 704/271, 704/277
• US Class Current: 348/14.08
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A videoconferencing system which encodes different streams of information. The information may include video, audio, speech recognized versions of the audio, and language translated versions of the audio. The different streams of information may be recorded along with timing indicia. Timing may be aligned in this way. In addition, the system may prevent two people from talking at once.

Claims

1. A communication device, comprising:

a first communication device, obtaining both video and audio communications to be sent over a channel, and producing time markers for each of said audio information and said video information, said time markers associated times of production of said audio information and said video information and operating to compress said audio information and said video information separately and to transmit compressed audio information and video information separately along with said time markers; and

a second communication device, also connected to the channel, and operating to receive said video and audio communications from the channel, and using said time marker to align said audio information with said video information and to display video information that is time aligned with said audio information.

2. A device as in claim 1, further comprising a language converting part, which converts words within said audio communication into words in another language.

3. A communication device as in claim 1, wherein said audio information and video information is associated with time markers used for time-aligning said audio information and said video information.

4. A communication device as in claim 1, further comprising a part in said first communication device that informs said second communication device that a first communication from said first communication device is in progress and prevents said second communication device from transmitting when said first communication is in progress.

5. A communication device as in claim 4, wherein said second communication device operates to record contents of a desired transmission during a time that said second communication device is being prevented from transmitting.

6. A videoconferencing device, comprising:

an input for a video camera, receiving information indicative of a video image;

an input for a microphone, receiving information indicative of an audio information;

a computer, that compresses said video image into compressed video information, and separately compresses said audio information into compressed audio information, and time alignment information for both of said compressed video information and said compressed audio information which can be used to provide a time-aligned composite stream of information; and

a transmission device that transmits said audio information, video information, and alignment information over a channel; and

a second communication device, also connected to the channel, and operating to receive said video and audio communications from the channel, and using said time marker to align said audio information with said video information and to display video information that is time aligned with said audio information.

7. A videoconferencing device as in claim 6, wherein said computer also produces additional information from at least one of said inputs and time synchronization information for said additional information, and sends said additional information over said channel time aligned with said compressed video information and said compressed audio information.

8. A videoconferencing device as in claim 7, wherein said additional information includes voice recognized information indicative of the audio information.

9. A videoconferencing device as in claim 7, wherein said additional information includes information in a different language that is automatically obtained.

10. A videoconferencing device as in claim 7, wherein said computer sends a signal over the channel when a transmission is started, said signal being one that informs other units, including said second communication device, that a transmission has been started.

11. A device as in claim 10, wherein said second unit operates based on said signal to stop transmitting once the transmission has started.

12. A device as in claim 11, wherein said other unit includes a recorder which records the transmission while said signal is active.

13. A method, comprising:

obtaining information indicative of a video image;

obtaining information indicative of an audio information that is associated with

said video image;

compressing said video image into compressed video information, and separately compressing said audio information into compressed audio information,

determining timing information for both said compressed video information and said compressed audio information;

transmitting said audio and video information over a channel, including said timing information; and

sending a signal over the channel that prevents other units from sending once said transmitting has started.

14. A method as in claim 13, further comprising producing additional information from at least one of said inputs, and producing time synchronization information for said additional information, and sending said additional information over said channel including said timing information, and with said compressed video information and said compressed audio information.

15. A method as in claim 13, wherein said producing additional information comprises voice recognizing information indicative of the audio information, and wherein said sending comprises sending information indicative of the voice-recognized information, along with said video and audio information, and with said timing information for said voice recognized information.

16. A method as in claim 13, wherein said producing additional information comprises automatically translating said audio information into a different language to produce different—

language information, and wherein said sending comprises sending information indicative of the different language information, along with said video and audio information, and with said timing information for said voice recognized information.

17. A method as in claim 13, further comprising allowing said other units to record a transmission once said transmission has been started.