User-Customized, low bit-rate speech vocoding method and communication unit for use therewith

• US 5,774,856 A
• Filed: 10/02/1995
• Issued: 06/30/1998
• Est. Priority Date: 10/02/1995
• Status: Expired due to Term

• Current Assignee: CDC Propriete Intellectuelle
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Haber, William Joe, Kroncke, George Thomas, Schmidt, William George, O'Sullivan, Martin John
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Opsasnick, Michael N.
• Application Number:
  US08/537,583
• Time in Patent Office: 1,002 Days
• Field of Search: 375/2.79, 375/2.28-2.33, 375/2.09, 375/2.1, 379/58-63, 379/84-92.02, 704/270, 704/219-224, 704/201
• US Class Current: 704/270
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G10L 25/00 Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 muting semiconductor-based amplifiers when some special characteristics of a signal are sensed by a speech detector, e.g. sensing when no signal is present, H03G3/34

Abstract

A voice encoding method and apparatus initialize! initializes (160) transmit and receive vocoders operated within communication units (12, 42) with a user-unique speech characteristic model (SCM) table (320) and an input stimulus table (340). The SCM table (320) and input stimulus table (340) are created during a training task (120) and stored (144) in a user information card (360), within a communication unit (60), or at a control facility (90). During call setup, the tables are exchanged (180) between the transmit and receive vocoders and the user'"'"'s speech is encoded (200) using the SCM table (320) and input stimulus table (340). During encoding (200), either compressed table entries that most closely match the input speech, or indexes that identify the closest table entries are sent (220) in a bitstream to the receive vocoder. The SCM table (320) and input stimulus table (340) can be updated (240) during or after the call.

Claims

1. A method for encoding and decoding speech during a call between a speech encoder for a first communication unit and a speech decoder for a second communication unit, the method comprising the steps of:

a) accessing, by the first communication unit, user-unique speech encoding information for a user of the first communication unit, wherein the user-unique speech encoding information is used to encode input speech of the user but not used to encode input speech of a user of the second communication unit;

b) establishing a connection between the first communication unit and the speech decoder;

c) encoding, by the speech encoder, input speech frames by determining closest entries of the user-unique speech encoding information; and

d) sending information describing the closest entries to the speech decoder.

2. The method as claimed in claim 1, wherein the user-unique speech encoding information comprises a speech characteristic model (SCM) table and an input stimulus table, and the step a) of accessing the user-unique speech encoding information comprises the steps of:

a1) accessing the SCM table for the user, where the SCM table contains most common SCMs associated with the user; and

a2) accessing the input stimulus table for the user, where the input stimulus table contains most common input stimulus associated with the user,

and wherein the step d) of encoding the input speech frames comprises the step of using the SCM table and the input stimulus table to encode the input speech frames.

3. The method as claimed in claim 2, further comprising the steps performed before step a) of:

f) collecting training speech frames of input speech data from the user,

g) determining the most common SCMs from the training speech fames;

h) storing the most common SCMs in the SCM table; and

i) storing the most common input stimulus from the training speech frames in the input stimulus table.

4. The method as claimed in claim 2, wherein the step a1) of accessing the SCM table comprises the step of reading the SCM table from a user information card inserted into the first communication unit, and the step a2) of accessing the input stimulus table comprises the step of reading the input stimulus table from the user information card.

5. The method as claimed in claim 2, further comprising the step of:

f) updating the SCM table and the input stimulus table during the call with new SCM table entries and new input stimulus table entries derived from the input speech frames.

6. The method as claimed in claim 5, wherein the step f) of updating comprises the steps of:

f1) compressing the new SCM table entries and the new input stimulus table entries; and

f2) sending compressed, new SCM table entries and compressed, new input stimulus table entries to the speech decoder.

7. The method as claimed in claim 1, further comprising the step of:

f) obtaining a user identification number for the user; and

g) using the user identification number to access the user-unique speech encoding information.

8. A method for encoding and decoding speech during a call between a speech encoder for a first communication unit and a speech decoder for a second communication unit, the method comprising the steps of:

a) receiving, by the first communication unit, an input speech frame spoken by a communication unit user;

b) determining a closest input stimulus table entry by comparing the input speech frame with at least one input stimulus table entry contained in an input stimulus table for the communication unit user, wherein the at least one input stimulus table entry were created before the call, and the at least one input stimulus table entry is used to encode input speech of the user but not used to encode input speech of a user of the second communication unit;

c) calculating a speech characteristic model (SCM) from the input speech frame;

d) determining the closest SCM table entry by comparing the SCM with an SCM table containing at least one SCM table entry for the communication unit user, wherein the at least one SCM table entry were created before the call;

e) generating a bitstream that includes information identifying the closest input stimulus table entry and the closest SCM table entry; and

f) sending the bitstream to the speech decoder.

9. The method as claimed in claim 8, further comprising the steps, performed prior to step a) of:

g) sending, by the first communication unit, the input stimulus table and the SCM table for the communication unit user to the speech decoder;

h) receiving, by the speech decoder, the input stimulus table and the SCM table; and

i) storing the input stimulus table and the SCM table in a memory device accessible to the speech decoder.

10. The method as claimed in claim 9, further comprising the steps of:

j) receiving the bitstream by the speech decoder,

k) extracting the information identifying the closest input stimulus table entry and the closest SCM table entry from the bitstream;

l) looking up the closest SCM table entry in the SCM table using the information;

m) looking up the closest input stimulus table entry in the input stimulus table using the information;

n) exciting the closest SCM table entry with the closest input stimulus table entry, resulting in a simulated speech frame; and

o) outputting the simulated speech frame to an audio output device.

11. The method as claimed in claim 8, further comprising the steps performed before step a) of:

g) determining an identification number of the communication unit user;

h) sending a message containing the identification number to a control facility;

i) reading the SCM table and the input stimulus table for the identification number from a memory device accessible to the control facility; and

j) sending the SCM table and the input stimulus table for the identification number to the first communication unit.

12. The method as claimed in claim 11, further comprising the steps of:

k) determining whether the communication unit user is one of a set of registered users, where a registered user is a user that has a user-unique SCM table and a user-unique input stimulus table prestored in the memory device; and

l) when the communication unit user is not in the set of registered users, sending a message to the first communication unit indicating that the communication unit user is not in the set of registered users.

13. The method as claimed in claim 11, further comprising the steps of:

k) sending the SCM table and the input stimulus table for the identification number to the speech decoder.

14. The method as claimed in claim 8, further comprising the steps performed before step a) of:

g) determining an identification number of the communication unit user; and

h) reading the SCM table and the input stimulus table for the communication unit user from a memory device.

15. The method as claimed in claim 14, wherein the memory device is a user information card and the step g) of determining the identification number comprises the step of reading the identification number from the user information card.

16. The method as claimed in claim 14, further comprising the steps of:

i) determining, from the identification number, whether the communication unit user is one of a set of registered users, a registered user is a user that has a user-unique SCM table and a user-unique input stimulus table prestored in the memory device;

j) when the communication unit user is not in the set of registered users, reading a default SCM table and a default input stimulus table from the memory device; and

k) using the default SCM table and the default input stimulus table as the SCM table and the input stimulus table.

17. The method as claimed in claim 14, further comprising the steps of:

i) determining, from the identification number, whether the communication unit user is one of a set of registered users, where a registered user is a user that has a user-unique SCM table and a user-unique input stimulus table prestored in the memory device;

j) when the communication unit user is not in the set of registered users, registering the communication unit user by assigning a new user identification number and creating a new SCM table and a new input stimulus table for the communication unit user, and

k) using the new SCM table and the new input stimulus table as the SCM table and the input stimulus table.

18. The method as claimed in claim 17, wherein the step j) of registering comprises the steps of:

j1) assigning the new user identification number to the communication unit user;

j2) collecting frames of input speech data from the communication unit user;

j3) determining speech characteristic models from the frames;

j4) storing most common models of the speech characteristic models in the new SCM table; and

j5) storing most common input stimulus from the frames in the new input stimulus table.

19. The method as claimed in claim 8, further comprising the steps performed before step a) of:

g) assigning a new user identification number to the communication unit user;

h) collecting frames of input speech data from the communication unit user;

i) determining speech characteristic models from the frames;

j) storing most common models of the speech characteristic models in the SCM table; and

k) storing most common input stimulus from the frames in the input stimulus table.

20. The method as claimed in claim 19, further comprising the step of:

l) updating the SCM table and the input stimulus table during the call with new SCM table entries and new input stimulus table entries derived from the frames of speech data.

21. The method as claimed in claim 20, wherein the step 1) of updating comprises the steps of:

11) compressing the new SCM table entries and the new input stimulus table entries; and

12) sending compressed, new SCM table entries and compressed, new input stimulus table entries to the speech decoder.

22. A method for encoding and decoding speech between a speech encoder for a first communication unit and a speech decoder for a second communication unit, the method comprising the steps of:

a) receiving, by the first communication unit, an input speech frame from a known user;

b) determining a first index to a closest input stimulus table entry by comparing the input speech frame with an input stimulus table containing at least one input stimulus entry for the known user, wherein the at least one input stimulus table entry is used to encode input speech of the known user but not used to encode input speech of a user of the second communication unit;

c) calculating a speech characteristic model (SCM) from the input speech frame;

d) determining a second index to a closest SCM table entry by comparing the SCM with at least one SCM table entry contained in an SCM table for the known user,. wherein the at least one SCM table entry is used to encode input speech of the known user but not used to encode input speech of the user of the second communication unit;

e) generating a bitstream that includes the first index and the second index; and

f) sending the bitstream to the speech decoder.

23. A method for encoding and decoding speech during a call between a speech encoder for a first communication unit and a speech decoder for a second communication unit, the method comprising the steps of:

b) collecting frames of input speech data from the communication unit user;

c) determining speech characteristic models from the frames;

d) storing most common models of the speech characteristic models in a user-unique speech characteristic model (SCM) table;

e) storing most common input stimulus from the frames in a user-unique input stimulus table;

f) establishing a connection between the first communication unit, which is used by the communication unit user, and the speech decoder;

g) receiving an input speech frame from the communication unit user;

h) determining a closest input stimulus table entry by comparing the input speech frame with the user-unique input stimulus table;

i) calculating an SCM from the input speech frame;

j) determining a closest SCM table entry by comparing the SCM with the most common models in the user-unique SCM table;

k) generating a bitstream that includes information identifying the closest input stimulus table entry and the closest SCM table entry;

l) sending the bitstream to the speech decoder; and

m) repeating steps g) through m) for a duration of the call.

24. The method as claimed in claim 23, wherein step d) comprises the step of storing the user-unique input stimulus table in a user information card, step e) comprises the step of storing the user-unique SCM table in the user information card, and the method further comprises the step of storing a user identification number in the user information card.

25. The method as claimed in claim 23, further comprising the steps of:

n) updating the user-unique SCM table with the SCM calculated in step i);

o) updating the user-unique input stimulus table with the input speech frame; and

p) sending changes to the user-unique SCM table and the user-unique input stimulus table to the speech decoder.

26. The method as claimed in claim 23, further comprising the steps of:

n) creating an SCM table copy and an input stimulus table copy before a first performance of step g);

o) updating the SCM table copy with the SCM calculated in step i);

p) updating the input stimulus table copy with the input speech frame; and

q) after completion of the call between the first communication unit and the second communication unit, replacing the user-unique SCM table with the SCM table copy and replacing the user-unique input stimulus table with the input stimulus table copy.

27. A communication unit apparatus comprising:

a speech input device for receiving input speech frames;

a processor coupled to the speech input device for establishing a connection between a speech encoder for the communication unit apparatus and a speech decoder for a second communication unit, and for encoding the input speech frames by determining closest entries in user-unique encoding information tables for the input speech frames, wherein the user-unique encoding information tables contain encoding information for a known user, and the user-unique encoding information tables are used to encode input speech of the known user but not used to encode input speech frames of a user of the second communication unit; and

a transceiver coupled to the processor for sending information describing the closest entries to the speech decoder.

28. The communication unit apparatus as claimed in claim 27, further comprising:

a user information card interface coupled to the processor for reading the user identification number from a user information card (UIC) inserted into the communication unit apparatus, for accessing the user-unique encoding information tables stored on the UIC for the user identification number.

29. The communication unit apparatus as claimed in claim 27, further comprising:

a memory device coupled to the processor for storing the user-unique encoding information tables for the user identification number.

30. The communication unit apparatus as claimed in claim 27, wherein the transceiver comprises:

a receiving unit for receiving the user-unique encoding information tables from a control facility.