Network conference system using limited bandwidth to generate locally animated displays

• US 5,963,217 A
• Filed: 11/18/1996
• Issued: 10/05/1999
• Est. Priority Date: 11/18/1996
• Status: Expired due to Term

• Current Assignee: Afluo LLC (L2 Technology LLC)
• Original Assignee: 7th Street.com, Inc.
• Inventors: Hickman, French E., Gillespie, Douglas W., Wyatt, Trent M., Grayson, George D., Bell, James W.
• Primary Examiner(s): Feild, Joseph H.
• Assistant Examiner(s): Kindred, Alford W.
• Application Number:
  US08/751,506
• Time in Patent Office: 1,051 Days
• Field of Search: 345/473, 345/115, 345/330, 345/333, 345/335, 345/329, 707/531
• US Class Current: 345/473
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 19/0018 Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis
• CPC Class Codes: G10L 2021/105 Synthesis of the lips movements from speech, e.g. for talking heads
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04N 19/27 involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text

Abstract

Electronic conferencing is provide over a computer network, such as the Internet, by passing streams of text with embedded explicit audio and graphics commands. Text is translated to audible speech at the end-user computers by a text-to-speech processor to reduce the amount of data transferred between computers. Implicit commands are generated from the text at the end-user computers as the audible speech is generated. Implicit command may control, for example, the animation of lips to provide a realistic image of the words of the text being spoken. Explicit commands can be used to control the voice characteristics by the text-to-speech processor or to control animation.

Claims

1. A method of communicating over a network using a limited bandwidth, comprising the steps of:

transferring a data stream of text and explicit commands from a transmitting computer to one or more receiving computers having, pre-stored graphic image files comprising representations of a limited number of movements of entities for display at the one or more receiving computers;

generating audible speech at the one or more receiving computers responsive to said text;

generating implicit commands responsive to said text; and

generating animation of said entities at said one or more receiving computers responsive to said implicit and explicit commands using information from said graphic image files that has a bandwidth exceeding that of respective explicit commands.

2. The method of claim 1 wherein said step of generating implicit commands includes the step of generating lip synch commands for generating lip movements of said entities corresponding to the audible speech.

3. The method of claim 2 wherein said lip synch commands for generating lip movements of said entities comprise phoneme identifiers corresponding to the audible speech.

4. The method of claim 2 wherein said step of generating implicit commands further comprises the step of generating gesture commands for animating gestures of said entities responsive to punctuation.

5. The method of claim 1 wherein step of transferring a data stream includes the step of transferring explicit animation commands and explicit speech commands for said entities.

6. The method of claim 5 wherein said explicit speech commands define voice characteristics of said entities and said step of generating audible speech comprises the step of generating audible speech responsive to said text and said explicit speech commands.

7. The method of claim 1 wherein said one or more receiving computers comprise at least two receiving computers and further comprising the step of transferring said data stream from one of said receiving computers to said transmitting computer and transferring said data stream from said transmitting computer to one or more receiving computers to allow communication between said receiving computers.

8. The method of claim 1 and further comprising the steps of storing said graphic image files in said one or more receiving computers prior to transferring said data stream.

9. The method of claim 8 wherein said step of generating animation of said entities comprises the step of manipulating said graphic image files responsive to said explicit commands.

10. The method of claim 8 and further comprising the step of storing background files in said one or more receiving computers.

11. The method of generating a presentation on a plurality of participant computers from a host computer over a network using a limited bandwidth, comprising the steps of:

downloading a data stream including text and animation control signals from said host to said participant computers over a network connection using a limited bandwidth, said animation control signals defining an animation sequence of display entities using a plurality of image files stored at the participant computers;

generating animation on said participant computers by displaying information regarding said entities from said image files responsive to said animation control signals, wherein the bandwidth of the information from said image files exceeds that of the animation control signals in said data stream;

generating audible speech on said participant computers responsive to said text; and

generating additional animation of said entities on said participant computers responsive to said text.

12. The method of claim 11 wherein said step of generating additional animation on said participating computers comprises the step of generating lip movement animation of said entities.

13. The method of claim 12 and further comprising the step of generating phoneme information as the audible speech is generated on said participating computers.

14. The method of claim 12 wherein said step of generating additional animation on said participating computers comprises the step of generating facial expressions of said entities responsive to punctuation in said text.

15. The method of claim 11 wherein said step of downloading includes downloading speech control signals for defining a voice characteristic of said entities associated with said text.

16. A method of enabling two or more participant computers to communicate over a network using a limited bandwidth, comprising the steps of:

transferring a data stream including text and commands regarding movements of animated entities from one of said participant computers to others of said participant computers, said others of said participating computers having locally stored graphic image files comprising representations of a limited number of movements of entities for display;

generating audible speech on said other participant computers responsive to said text; and

generating animation on said other participant computers responsive to said data steam using said graphic image files to generate information representing respective movements of said entities at a bandwidth exceeding that of said commands regarding movements of the animated entities.

17. The method of claim 16 wherein said step of generating animation of said entities comprises the steps of:

generating phoneme identifiers corresponding the audible speech; and

mapping said phoneme identifiers to the graphic image files stored on said other participant computers.

18. The method of claim 16 wherein said transferring step comprises the step of uploading a data stream including text and explicit commands from said one participant computers to said other participant computers.

19. The method of claim 18 and further comprising the step of generating animation of said entities responsive to one or more of said explicit commands.

20. The method of claim 19 wherein said step of generating audible speech comprises the step of generating audible speech related to said entities on said other participant computers responsive to said text and one or more of said explicit commands as the data stream is received.

21. The method of claim 16 wherein said transferring step comprises the step of transferring a data stream including text from said one of said participant computers to said other participant computers via a host computer.