Mobile telephone unit using singing voice synthesis and mobile telephone system

• US 7,010,291 B2
• Filed: 04/05/2002
• Issued: 03/07/2006
• Est. Priority Date: 12/03/2001
• Status: Expired due to Fees

• Current Assignee: Oki Semiconductor Company Limited (ROHM Co., Ltd.)
• Original Assignee: OKI Electric Industry Company Limited
• Inventors: Iwanaga, Tomohiro
• Primary Examiner(s): Corsaro, Nick
• Assistant Examiner(s): Persino, Raymond B.
• Application Number:
  US10/115,991
• Publication Number:
  US 20030104785A1
• Time in Patent Office: 1,432 Days
• Field of Search: 455/66.1, 455/422.1, 455/418, 455/419, 455/466, 455/566, 455/567, 455/556.1, 704/258, 704/268, 846/00, 846/04, 846/31, 846/45, 846/09, 434/307.A
• US Class Current: 455/414.1
• CPC Class Codes: H04M 1/578 associated with a synthesized vocal announcement
• CPC Class Codes: H04M 1/724 User interfaces specially adapted for cordless or mobile telephones

Abstract

A mobile telephone unit of the invention comprises a storage section for storing karaoke piece data, a controller for reading the karaoke piece data from the storage section, analyzing the karaoke piece data, and fetching melody information and singing voice synthesis information based on the karaoke piece data, a sound generator for analyzing the melody information received from the controller and producing multiple melody signals, a singing voice synthesizing section for analyzing the singing voice synthesis information received from the controller and producing multiple synthetic singing voice signals, and an audio reproducing section for receiving the multiple melody signals outputted from the sound generator and the multiple synthetic singing voice signals outputted from the singing voice synthesizing section in synchronization with timings when the multiple melody signals are outputted, thereby sounding a karaoke piece.

Claims

1. A mobile telephone unit using singing voice synthesis comprising:

a storage section for storing karaoke piece data;

a controller for reading the karaoke piece data from the storage section, analyzing the karaoke piece data, and fetching melody information and singing voice synthesis information based on the karaoke piece data;

a sound generator for analyzing the melody information received from the controller and producing multiple melody signals;

a singing voice synthesizing section for analyzing the singing voice synthesis information received from the controller and producing multiple synthetic singing voice signals; and

an audio reproducing section for receiving the multiple melody signals outputted from the sound generator and the multiple synthetic singing voice signals outputted from the singing voice synthesizing section in synchronization with timings when the multiple melody signals are outputted, thereby sounding a karaoke piece;

wherein the controller fetches melody data from part data using a melody part assignment data of a part assignment data when analyzing the karaoke piece data having tempo data, the part assignment and the part data; and

wherein the controller includes a data analyzing section for fetching singing data from the part data using the singing part assignment data of the part assignment data, thereby changing the melody information to information containing the tempo data, the melody part assignment data and the melody data, and changing the singing voice synthesis information to information containing the tempo data and the singing data;

wherein the melody data comprises multiple melody part data, said multiple melody part data comprise corresponding tones, multiple note data and multiple rest data;

said singing data comprises text data which are given to the multiple rest data and the multiple note data with one-to-one relation as a rule, and display data which are given to the multiple rest data and the multiple note data with one-to-one relation,

further comprising;

a memory for storing information relating to the singing voice synthesis received from the controller;

a processing section for reading the tempo data and the singing data of the singing voice synthesis information from the memory at the same time when the multiple melody signals are outputted form the sound generator or the multiple synthetic singing voice signals are outputted from the singing voice synthesizing section;

display data for receiving and displaying a given unit of multiple rest data and multiple note data, and the text data respectively corresponding to a given unit of multiple rest data and multiple note data, said display data being outputted from said processing section with reference to the tempo data;

a display reproducing section for receiving and displaying the display data displaying the note data and the text data corresponding to the multiple synthetic singing voice signals outputted in synchronization with the timing when the synthetic singing voice signals are outputted from the singing voice synthesizing section; and

a display data output counter for counting the number of outputs of the display data;

wherein the controller reads the karaoke piece data from the storage section upon reception of instruction representing change of the multiple note data or multiple text data of the singing data which has been inputted through the input section, said controller fetches the singing data from the karaoke piece data when it is analyzed by the data analyzing section, and transmits the singing data together with the instruction representing change of data to the display;

said display reproducing section receives the text data corresponding to a given unit of the multiple rest data, multiple note data of the singing data or the text data corresponding to the multiple rest data and the multiple note data which are read from the processing section and stored in the memory and received from the controller, and displays them on the display;

said display data output counter section changes the counted number when the data is inputted through the input section; and

said processing section specifies the note data to be changed or text data to be changed of the displayed multiple note data or multiple text data based on the changed counted number which is outputted from the display data output counter;

wherein the change of the specified note data to be changed or the text data to be changed is effected by inputting through the input section; and

comprising;

a first base station having a first radio zone for receiving a karaoke piece number from the first mobile telephone when directly effecting a radio communication with the first mobile telephone belonging to the first radio zone;

a control station having a karaoke piece server for transmitting karaoke piece data corresponding to the karaoke piece number received from the first base station and for detecting the karaoke piece data by retrieving a karaoke piece data base located therein;

the control station changing the karaoke piece data received from the first data station by changing the multiple note data or multiple text data of the singing data of the karaoke piece data, receiving the changed karaoke piece data transmitted by the first mobile telephone, and a telephone number of the second mobile telephone via the first base station and retrieving the second mobile telephone corresponding to the telephone number thereof; and

a second base station having a second radio zone for transmitting the changed karaoke piece data which is received from the control station to the second mobile telephone when directly effecting a radio communication with the second mobile station belonging to the second radio zone.

2. The mobile telephone system according to claim 1, wherein the control station transmits the changed karaoke piece data, then transmits a notification of verification of the transmission to the first mobile telephone.

3. A mobile telephone unit using singing voice synthesis comprising:

a storage section for storing karaoke piece data;

a controller for reading the karaoke piece data from the storage section, analyzing the karaoke piece data, and fetching melody information and singing voice synthesis information based on the karaoke piece data;

a sound generator for analyzing the melody information received from the controller and producing multiple melody signals;

a singing voice synthesizing section for analyzing the singing voice synthesis information received from the controller and producing multiple synthetic singing voice signals; and

an audio reproducing section for receiving the multiple melody signals outputted from the sound generator and the multiple synthetic singing voice signals outputted from the singing voice synthesizing section in synchronization with timings when the multiple melody signals are outputted, thereby sounding a karaoke piece;

wherein the controller fetches melody data from part data using a melody part assignment data of a part assignment data when analyzing the karaoke piece data having tempo data, the part assignment and the part data; and

wherein the controller includes a data analyzing section for fetching singing data from the part data using the singing part assignment data of the part assignment data, thereby changing the melody information to information containing the tempo data, the melody part assignment data and the melody data, and changing the singing voice synthesis information to information containing the tempo data and the singing data;

wherein the melody data comprises multiple melody part data, said multiple melody part data comprise corresponding tones, multiple note data and multiple rest data;

said singing data comprises text data which are given to the multiple rest data and the multiple note data with one-to-one relation as a rule, and display data which are given to the multiple rest data and the multiple note data with one-to-one relation;

wherein the singing voice synthesizing section comprises;

a Japanese analyzing section for analyzing Japanese of the multiple text data of the singing voice data using a wordbook when analyzing singing voice synthesis information and deciding multiple pauses, multiple basic accents of the multiple text data using the note data and the rest data corresponding to the respective multiple text data when analyzing Japanese;

a parameter producing section for deciding a rhythm control pattern of the multiple text data, which are analyzed in Japanese, relating to a frequency and continuation time using a rhythm control data based on multiple pauses, multiple basic accents, the tempo data, the multiple rest data and the multiple note data, said parameter producing section further deciding singing voice synthesis units of the multiple text data which are decided in the rhythm control pattern;

a voice synthesizing section for fetching singing voice elements corresponding to the respective singing voice synthesis units from a singing voice element book, thereby preparing the multiple synthetic singing voice signals;

further comprising;

a memory for storing information relating to the singing voice synthesis received from the controller;

a processing section for reading the tempo data and the singing data of the singing voice synthesis information from the memory at the same time when the multiple melody signals are outputted form the sound generator or the multiple synthetic singing voice signals are outputted from the singing voice synthesizing section;

display data for receiving and displaying a given unit of multiple rest data and multiple note data, and the text data respectively corresponding to a given unit of multiple rest data and multiple note data, said display data being outputted from said processing section with reference to the tempo data;

a display reproducing section for receiving and displaying the display data displaying the note data and the text data corresponding to the multiple synthetic singing voice signals outputted in synchronization with the timing when the synthetic singing voice signals are outputted from the singing voice synthesizing section; and

a display data output counter for counting the number of outputs of the display data;

wherein the controller reads the karaoke piece data from the storage section upon reception of instruction representing change of the multiple note data or multiple text data of the singing data which has been inputted through the input section, said controller fetches the singing data from the karaoke piece data when it is analyzed by the data analyzing section, and transmits the singing data together with the instruction representing change of data to the display;

said display reproducing section receives the text data corresponding to a given unit of the multiple rest data, multiple note data of the singing data or the text data corresponding to the multiple rest data and the multiple note data which are read from the processing section and stored in the memory and received from the controller, and displays them on the display;

said display data output counter section changes the counted number when the data is inputted through the input section; and

said processing section specifies the note data to be changed or text data to be changed of the displayed multiple note data or multiple text data based on the changed counted number which is outputted from the display data output counter;

wherein the change of the specified note data to be changed or the text data to be changed is effected by inputting through the input section; and

comprising

a first base station having a first radio zone for receiving a karaoke piece number from the first mobile telephone when directly effecting a radio communication with the first mobile telephone belonging to the first radio zone;

a control station having a karaoke piece server for transmitting karaoke piece data corresponding to the karaoke piece number received from the first base station and for detecting the karaoke piece data by retrieving a karaoke piece data base located therein;

the control station changing the karaoke piece data received from the first data station by changing the multiple note data or multiple text data of the singing data of the karaoke piece data, receiving the changed karaoke piece data transmitted by the first mobile telephone, and a telephone number of the second mobile telephone via the first base station and retrieving the second mobile telephone corresponding to the telephone number thereof; and

a second base station having a second radio zone for transmitting the changed karaoke piece data which is received from the control station to the second mobile telephone when directly effecting a radio communication with the second mobile station belonging to the second radio zone.

4. The mobile telephone system according to claim 3, wherein the control station transmits the changed karaoke piece data, then transmits a notification representing verification of the transmission to the first mobile telephone.

5. A mobile telephone unit using sinning voice synthesis comprising:

a storage section for storing karaoke piece data;

a controller for reading the karaoke piece data from the storage section, analyzing the karaoke piece data, and fetching melody information and singing voice synthesis information based on the karaoke piece data;

a sound generator for analyzing the melody information received from the controller and producing multiple melody signals;

a singing voice synthesizing section for analyzing the singing voice synthesis information received from the controller and producing multiple synthetic singing voice signals; and

an audio reproducing section for receiving the multiple melody signals outputted from the sound generator and the multiple synthetic singing voice signals outputted from the singing voice synthesizing section in synchronization with timings when the multiple melody signals are outputted, thereby sounding a karaoke piece;

wherein the controller fetches melody data from part data using a melody part assignment data of a part assignment data when analyzing the karaoke piece data having tempo data, the part assignment and the part data; and

wherein the controller includes a data analyzing section for fetching singing data from the part data using the singing part assignment data of the part assignment data, thereby changing the melody information to information containing the tempo data, the melody part assignment data and the melody data, and changing the singing voice synthesis information to information containing the tempo data and the singing data;

wherein the melody data comprises multiple melody part data, said multiple melody part data comprise corresponding tones, multiple note data and multiple rest data;

said singing data comprises text data which are given to the multiple rest data and the multiple note data with one-to-one relation as a rule, and display data which are given to the multiple rest data and the multiple note data with one-to-one relation;

wherein the sound generator includes a melody analyzing section for fetching the multiple melody part data from the melody data using the melody part assignment data, deciding tone parameters of the multiple melody signals using respective tones of the melody part data, and deciding sound generator parameters of the multiple melody signals based on the tempo data, the multiple note data and the multiple rest data of the melody part data respectively when analyzing the melody information;

further comprising;

a memory for storing information relating to the singing voice synthesis received from the controller;

a processing section for reading the tempo data and the singing data of the singing voice synthesis information from the memory at the same time when the multiple melody signals are outputted form the sound generator or the multiple synthetic singing voice signals are outputted from the singing voice synthesizing section;

display data for receiving and displaying a given unit of multiple rest data and multiple note data, and the text data respectively corresponding to a given unit of multiple rest data and multiple note data, said display data being outputted from said procession section with reference to the tempo data;

a display reproducing section for receiving and displaying the display data displaying the note data and the text data corresponding to the multiple synthetic singing voice signals outputted in synchronization with the timing when the synthetic singing voice signals are outputted from the signing voice synthesizing section; and

a display data output counter for counting the number of outputs of the display data;

wherein the controller reads the karaoke piece data from the storage section upon reception of instruction representing change of the multiple note data or multiple text data of the singing data which has been inputted through the input section, said controller fetches the singing data from the karaoke piece data when it is analyzed by the data analyzing section, and transmits the singing data together with the instruction representing change of data to the display;

said display reproducing section receives the text data corresponding to a given unit of the multiple rest data, multiple note data of the singing data or the text data corresponding to the multiple rest data and the multiple note data which are read from the processing section and stored in the memory and received from the controller, and displays them on the display;

said display data output counter section changes the counted number when the data is inputted through the input section; and

said processing section specifies the note data to be changed or text data to be changed of the displayed multiple note data or multiple text data based on the changed counted number which is outputted from the display data output counter;

wherein the change of the specified note data to be changed or the text data to be changed is effected by inputting through the input section; and

comprising

a first base station having a first radio zone for receiving a karaoke piece number from the first mobile telephone when directly effecting a radio communication with the first mobile telephone belonging to the first radio zone;

a control station having a karaoke piece server for transmitting karaoke piece data corresponding to the karaoke piece number received from the first base station and for detecting the karaoke piece data by retrieving a karaoke piece data base located therein;

the control station changing the karaoke piece data received from the first data station by changing the multiple note data or multiple text data of the singing data of the karaoke piece data, receiving the changed karaoke piece data transmitted by the first mobile telephone, and a telephone number of the second mobile telephone via the first base station and retrieving the second mobile telephone corresponding to the telephone number thereof; and

a second base station having a second radio zone for transmitting the changed karaoke piece data which is received from the control station to the second mobile telephone when directly effecting a radio communication with the second mobile station belonging to the second radio zone.

6. The mobile telephone system according to claim 5, wherein the control station transmits the changed karaoke piece data, then transmits a notification representing verification of the transmission to the first mobile telephone.

7. A mobile telephone unit using singing voice synthesis comprising:

a storage section for storing karaoke piece data;

a controller for reading the karaoke piece data from the storage section, analyzing the karaoke piece data, and fetching melody information and singing voice synthesis information based on the karaoke piece data;

a sound generator for analyzing the melody information received from the controller and producing multiple melody signals;

a singing voice synthesizing section for analyzing the singing voice synthesis information received from the controller and producing multiple synthetic singing voice signals; and

an audio reproducing section for receiving the multiple melody signals outputted from the sound generator and the multiple synthetic singing voice signals outputted from the singing voice synthesizing section in synchronization with timings when the multiple melody signals are outputted, thereby sounding a karaoke piece;

wherein the controller fetches melody data from part data using a melody part assignment data of a part assignment data when analyzing the karaoke piece data having tempo data, the part assignment and the part data; and

wherein the controller includes a data analyzing section for fetching singing data from the part data using the singing part assignment data of the part assignment data, thereby changing the melody information to information containing the tempo data, the melody part assignment data and the melody data, and changing the singing voice synthesis information to information containing the tempo data and the singing data;

wherein the melody data comprises multiple melody Part data, said multiple melody part data comprise corresponding tones, multiple note data and multiple rest data;

said singing data comprises text data which are given to the multiple rest data and the multiple note data with one-to-one relation as a rule, and display data which are given to the multiple rest data and the multiple note data with one-to-one relation;

wherein the singing voice synthesizing section comprises;

a Japanese analyzing section for analyzing Japanese of the multiple text data of the singing voice data using a wordbook when analyzing singing voice synthesis information and deciding multiple pauses, multiple basic accents of the multiple text data using the note data and the rest data corresponding to the respective multiple text data when analyzing Japanese;

a parameter producing section for deciding a rhythm control pattern of the multiple text data, which are analyzed in Japanese, relating to a frequency and continuation time using a rhythm control data based on multiple pauses, multiple basic accents, the tempo data, the multiple rest data and the multiple note data, said parameter producing section further deciding singing voice synthesis units of the multiple text data which are decided in the rhythm control pattern;

a voice synthesizing section for fetching singing voice elements corresponding to the respective singing voice synthesis units from a sinning voice element book, thereby preparing the multiple synthetic singing voice signals;

wherein the sound generator includes a melody analyzing section for fetching the multiple melody part data from the melody data using the melody part assignment data, deciding tone parameters of the multiple melody signals using respective tones of the melody part data, and deciding sound generator parameters of the multiple melody signals based on the tempo data, the multiple note data and the multiple rest data of the melody part data respectively when analyzing the melody information;

further comprising;

a memory for storing information relating to the singing voice synthesis received from the controller;

a processing section for reading the tempo data and the singing data of the singing voice synthesis information from the memory at the same time when the multiple melody signals are outputted form the sound generator or the multiple synthetic singing voice signals are outputted from the singing voice synthesizing section;

display data for receiving and displaying a given unit of multiple rest data and multiple note data, and the text data respectively corresponding to a given unit of multiple rest data and multiple note data, said display data being outputted from said processing section with reference to the tempo data;

a display reproducing section for receiving and displaying the display data displaying the note data and the text data corresponding to the multiple synthetic singing voice signals outputted in synchronization with the timing when the synthetic singing voice signals are outputted from the singing voice synthesizing section; and

a display data output counter for counting the number of outputs of the display data;

wherein the controller reads the karaoke piece data from the storage section upon reception of instruction representing change of the multiple note data or multiple text data of the singing data which has been inputted through the input section, said controller fetches the singing data from the karaoke piece data when it is analyzed by the data analyzing section, and transmits the singing data together with the instruction representing change of data to the display;

said display reproducing section receives the text data corresponding to a given unit of the multiple rest data, multiple note data of the singing data or the text data corresponding to the multiple rest data and the multiple note data which are read from the processing section and stored in the memory and received from the controller, and displays them on the display;

said display data output counter section changes the counted number when the data is inputted through the input section; and

said processing section specifies the note data to be changed or text data to be changed of the displayed multiple note data or multiple text data based on the changed counted number which is outputted from the display data output counter;

wherein the change of the specified note data to be changed or the text data to be changed is effected by inputting through the input section; and

comprising

a first base station having a first radio zone for receiving a karaoke piece number from the first mobile telephone when directly effecting a radio communication with the first mobile telephone belonging to the first radio zone;

a control station having a karaoke piece server for transmitting karaoke piece data corresponding to the karaoke piece number received from the first base station and for detecting the karaoke piece data by retrieving a karaoke piece data base located therein;

the control station changing the karaoke piece data received from the first data station by changing the multiple note data or multiple text data of the singing data of the karaoke piece data, receiving the changed karaoke piece data transmitted by the first mobile telephone, and a telephone number of the second mobile telephone via the first base station and retrieving the second mobile telephone corresponding to the telephone number thereof; and

a second base station having a second radio zone for transmitting the changed karaoke piece data which is received from the control station to the second mobile telephone when directly effecting a radio communication with the second mobile station belonging to the second radio zone.

8. The mobile telephone system according to claim 7, wherein the control station transmits the changed karaoke piece data, then transmits a notification representing verification of the transmission to the first mobile telephone.