System and Method for Grading Singing Data

• US 20060246407A1
• Filed: 04/26/2006
• Published: 11/02/2006
• Est. Priority Date: 04/28/2005
• Status: Abandoned Application

• Current Assignee: Media NAVI Incorporated
• Original Assignee: Nayio Media Incorporated
• Inventors: Kang, Sangwook, Park, Jangyeon
• Application Number:
  US11/380,312
• Publication Number:
  US 20060246407A1
• Time in Patent Office: Days
• US Class Current: 434/307.A
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10H 1/361 Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/005 Non-interactive screen display of musical or status data
• CPC Class Codes: G10H 2230/015 PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used

Abstract

This invention is singing evaluation system and evaluation method for all type Karaoke. Offline, online, wireless Karaoke has Karaoke track and visual display feature. The singing evaluation system extracts user'"'"'s singing melody in realtime. Extracted melody is expressed in notes of 4-tuple: pitch, onset, duration and sound intensity. User'"'"'s melody information is visualized and displayed in comparison to original melody of the song. User'"'"'s singing melody and original melody of the song is compared by each note and when the difference is above pre-set level, grading system'"'"'s octave is automatically adjusted. User can choose karaoke track type freely enabled by offsent sequence. Another distinctive characteristic of this invention is practice-by-phrase and evaluate-by-phrase function. The function allows users to break down a song to the length of 2 to 3 phrase and practice the specific phrases till perfect.

Claims

1. For Sing-a-long background music track and display function provided online, off-line, wire and wireless environment Karaoke using evaluation system,

Song track related lyric information, background music information, and database of pitch and/or tempo information of the song to display pitch and tempo of each phrase or note of the song;

Above background music data is exported via speaker, and audio data processing block that changes to a format that is comparable to user'"'"'s singing performance data;

Video data processing block that displays comparison of song data processed through above audio data processing block and above pitch and tempo data; and

Evaluation block that evaluates based on the matching level of above song data and pitch &

tempo data.

This singing evaluation system includes such as a distinctive feature.

2. In claim 1, above audio data processing block consists of

Above song data digitalizing A/D converter and, above digitalized song data filtering digital filter

This singing evaluation system includes such as a distinctive feature.

3. In claim 1, above evaluation block consists of

Onset voice region detection that detects filtered song data'"'"'s each phrase or note starting point based on the size of sound energy;

Note duration time detection that finds above song data'"'"'s each phrase or note ending point and calculates duration of each phrase or note;

Note information extracting function that extracts pitch value of above each phrase or note; and

Evaluation function that compares above song data'"'"'s each phrase or note continue time and at least one of above pitch value to above pitch and tempo data and calculates evaluation assessment.

This singing evaluation system includes such as a distinctive feature.

4. In claim 3, above note duration time detection

Considers each phrase or note'"'"'s ending point as where there is sudden decrease in sound energy size.

This singing evaluation system includes such as a distinctive feature.

5. In claim 4, above note duration time detection

Considers from above onset voice region detection point to new onset detected point as where previous phrase or note ends.

This singing evaluation system includes such as a distinctive feature.

6. In claim 3, above note information extracting function

Determines note value by the sound'"'"'s distinctive basic audio frequency and pitch value which expresses sound'"'"'s high and low in numerical value.

This singing evaluation system includes such as a distinctive feature.

7. In claim 3, above evaluation function

makes evaluation assessment by average of matching level of duration time between above song data and above pitch and tempo data duration time;

and above pitch value.

This singing evaluation system includes such as a distinctive feature.

8. In claim 3, above evaluation function

Gives weight to one of the followings above matching level of duration time between above song data and above pitch and tempo data duration time;

or above pitch value. Based on the weight-based recalculation, evaluation assessment is made

This singing evaluation system includes such as a distinctive feature.

9. In claim 1, above video data processing block

Displays note that has each song'"'"'s pitch and tempo data at a specific location based on the above each note'"'"'s high-low and length, in a pre-defined length bar format pitch and tempo graphs.

This singing evaluation system includes such as a distinctive feature.

10. In claim 9, above video processing block

Displays note'"'"'s duration and pitch value extracted by above evaluation function in above pitch and tempo graph.

This singing evaluation system includes such as a distinctive feature.

11. Sing-a-long background music track and display function provided online, off-line, wire and wireless environment Karaoke using evaluation system includes,

Input step where based on users selection, background music track is played via speaker and receives user'"'"'s singing performance data information;

Change step which changes above singing performance data input to a format that is comparable to pitch and tempo data—

above pitch and tempo data is for displaying pitch &

tempo information of each song'"'"'s each phrase or note—

;

Display step which above changed song data and above pitch &

tempo data is compared and displayed; and

Evaluation step which evaluates based on the matching level of above song data and pitch and tempo data.

This singing evaluation method includes such as a distinctive feature.

12. In claim 11, above background music track data and above pitch and tempo data may be saved in database in advance or downloaded in real-time via communication network.

This singing evaluation method includes such as a distinctive feature.

13. In claim 11, above evaluation step has

Phrase or note beginning point finding process of filtered song data based on the size of sound energy;

Phrase or note ending point finding process;

Each phrase or note duration time calculation process using above beginning point and ending point;

Pitch value extracting process for above phrase or note; and

Evaluation assessment calculating process based on the comparison of above song data'"'"'s each phrase or note duration time and at least one of above pitch and tempo data.

This singing evaluation method includes such as a distinctive feature.

14. In claim 13, above evaluation assessment calculation step has

Above note'"'"'s duration time matching level and above note value matching level between above song data and above pitch and tempo data calculating and the average value calculating step. This singing evaluation method includes such as a distinctive feature.

This singing evaluation method includes such as a distinctive feature.

15. In claim 13, above evaluation assessment calculation step includes

Giving weight to one of the followings above matching level of duration time between above song data and above pitch and tempo data duration time;

or above pitch value. Based on the weight-based recalculation, evaluation assessment is made.

This singing evaluation method includes such as a distinctive feature.

16. In claim 11, above display step has

Note included in above each song'"'"'s pitch and tempo data graphic displaying step based on each note'"'"'s high-long and length;

and

Duration time pitch value extracted from note in above song data graphic displaying step.

This singing evaluation method includes such as a distinctive feature.

17. In claim 11, above song evaluation method has

Above evaluation result by each phrase saving step;

User chosen, and generated each phrase based evaluation result extracting and displaying step; and

Re-evaluation step for specific phrase chosen by the user to be re-performed and evaluated based on the new input.

This singing evaluation method includes such as a distinctive feature.

18. Recording-medium with computer programming to execute either one of claim 17.