Audio interactive system

• US 5,930,752 A
• Filed: 09/11/1996
• Issued: 07/27/1999
• Est. Priority Date: 09/14/1995
• Status: Expired due to Term

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Kawaguchi, Naohisa, Matsui, Kazuki, Ohno, Takashi, Iwakawa, Akinori, Harada, Hiroaki
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Wieland, Susan
• Application Number:
  US08/712,317
• Time in Patent Office: 1,049 Days
• Field of Search: 704/260, 704/278, 704/235
• US Class Current: 704/270.1
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04L 12/6418 Hybrid transport
• CPC Class Codes: H04L 2012/6481 Speech, voice
• CPC Class Codes: H04L 2012/6489 Buffer Management, Threshold setting, Scheduling, Shaping
• CPC Class Codes: H04L 2012/6494 Silence suppression
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/401 wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

An audio interactive system including a plurality of terminals each having an audio input means for converting voices into aural signals and an audio output means for converting aural signals into voices, the plurality of terminals being connected to a communication line; and a server connected with the plurality of terminals via the communication line to perform collection and distribution of the aural signals, in which a conversation is made through voices between the plurality of terminals. The server comprises a buffer for temporarily storing the aural signals transmitted from the terminals, and a scheduler for controlling the distribution of the aural signals stored in the buffer.

Claims

1. An audio interactive system comprising:

a plurality of terminals each having an audio input means for converting voices into aural signals and an audio output means for converting aural signals into voices, said plurality of terminals being connected to a communication line; and

a server connected with said plurality of terminals via said communication line to perform collection and distribution of the aural signals, in which a conversation is made through voices between said plurality of terminals,

wherein said server comprises a buffer means for temporarily storing the aural signals transmitted from the terminals, and a scheduler means for controlling the distribution of the aural signals stored in said buffer means, and wherein the aural signals are transmitted on a digital basis to the server and the server distributes the aural signals to the respective terminals on a digital basis.

2. An audio interactive system according to claim 1, wherein said server controls a distribution sequence of the aural signals stored in said buffer means.

3. An audio interactive system according to claim 1, wherein said server has means for managing a number of simultaneous speakers that simultaneously transmit speeches, and inhibits a simultaneous transmission of the aural signals from the terminal, a number of said aural signals exceeding a predetermined number.

4. An audio interactive system according to claim 1, wherein said server or said terminal has a silence detection means for detecting a silence portion of the aural signal, and said scheduler controls a distribution sequence of the aural signals in units of speeches each separated with the silence portion of the aural signal.

5. An audio interactive system according to claim 1, wherein said scheduler controls a distribution sequence of the aural signals in such a manner that the server distributes the aural signals in the order in which the aural signals arrive at said server.

6. An audio interactive system according to claim 1, wherein said server has means for transmitting to the terminal a command indicating transmission of an internal time of the terminal;

each of said terminals has means responsive to the command for transmitting one'"'"'s own internal time to said server, and means for transmitting to said server the aural signal together with one'"'"'s own internal time at time of transmission; and

said scheduler controls a distribution sequence of the aural signals in such a manner that the server distributes the aural signals in the order in which the aural signals are transmitted from said terminals.

7. An audio interactive system according to claim 1, wherein said server has a mixer for mixing the aural signals.

8. An audio interactive system according to claim 7, wherein said scheduler controls a distribution time of the aural signals on the basis of time at which the aural signals arrive at said server.

9. An audio interactive system according to claim 7, wherein said server has means for transmitting to the terminal a command indicating transmission of an internal time of the terminal;

each of said terminals has means responsive to the command for transmitting one'"'"'s own internal time to said server, and means for transmitting to said server the aural signal together with one'"'"'s own internal time at time of transmission; and

said scheduler controls a distribution time of the aural signals on the basis of time at which the aural signals are transmitted from said terminals.

10. An audio interactive system according to claim 1, wherein each of said terminals has a logical personal image, and said scheduler controls a distribution of the aural signals on the basis of at least one of logical positional relation, distance, surroundings, eyes direction, view area and posture of the logical personal image within space constructed by the logical personal images.

11. An audio interactive system according to claim 1, wherein each of said terminals has a logical personal image, and has an effector for making a sound effects to the aural signal on the basis of at least one of logical positional relation, distance, surroundings, eyes direction, view area and posture of the logical personal image within space constructed by the logical personal images.

12. An audio interactive system according to claim 1, wherein said server has one or more group management tables registering terminals, which belong to an interaction group in which a conversation is made, of said plurality of terminals, and

said scheduler controls a distribution of the aural signals in such a manner that received aural signals are distributed to terminals which belong to the same interaction group as the terminal which generated the received aural signals.

13. An audio interactive system according to claim 12, wherein a password is assigned to said interaction group,

each of said terminals has a password input means for inputting the password to transmit the same to said server, and

said server inspects the passwords transmitted from the terminals and causes the terminal transmitting a proper password to join an associated interaction group.

14. An audio interactive system according to claim 1, wherein each of said terminals has a listening mode selection means for selecting any one of a plurality of listening modes for designating a transmitting terminal as a transmitting source.

15. An audio interactive system according claim 1, wherein each of said terminals has an interruption inhibit informing means for informing said server of an interruption inhibit to designate a terminal as an originating source of the aural material, on which a reception of aural signals addressed and transmitted to oneself is rejected, and

said server stops a transfer of the aural signals to the terminal at the transmitting destination, when a transmitting destination of received aural signals is the terminal which informed of interruption inhibit through said interruption inhibit informing means and an originating source of the received aural signals is the terminal designated by interruption inhibit information through said interruption inhibit informing means.

16. An audio interactive system according to claim 1, wherein each of said terminals has a transmitting mode selection means for selecting any one of a plurality of transmitting modes for designating a receiving terminal as a receiving destination to receive an aural signal.

17. An audio interactive system according to claim 1, wherein each of said terminals has a display means for displaying a speaker and a listener.

18. An audio interactive system according to claim 1, wherein said server has an effector for changing acoustics of the aural signals.

19. An audio interactive system according to claim 1, wherein said server has a sound effect buffer for storing a sound effect signal representative of a predetermined sound effect, and

said scheduler means controls a distribution of the aural signals transmitted and also controls a distribution of the aural signals stored in said sound effect buffer.

20. An audio interactive system according to claim 1, wherein said server or said terminal has audio recognition means for converting the aural signals into text data.

21. An audio interactive system according to claim 1, wherein said server and said terminals are connected to each other via an analog line, and said system further comprises:

a tone sound generating means for generating tone sounds to discriminate starting point and terminating point of aural signals at starting and terminating of aural signals in the form of analog signals, and

a tone sound detecting means for detecting received tone sounds.

22. An audio interactive system according to claim 1, wherein said server has storage means for storing conversations between the terminals.

23. An audio interactive system according to claim 22, wherein when said storage means stores conversations between the terminals, said server adds associated attribute information to the conversation to be stored in said storage means.

24. An audio interactive system according to claim 23, wherein said server has a retrieval means for retrieving a desired conversation portion of the conversation stored in said storage means on the basis of the attribute information.

25. An audio interactive system according to claim 22, wherein said system further comprises a conversation rate conversion means for converting a conversation rate.