Method of displaying music information in multimedia playback and related electronic device

• US 8,168,876 B2
• Filed: 04/10/2009
• Issued: 05/01/2012
• Est. Priority Date: 04/10/2009
• Status: Active Grant

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Hsieh, Kuo-Chiang
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US12/421,653
• Publication Number:
  US 20100262909A1
• Time in Patent Office: 1,117 Days
• Field of Search: 846/09
• US Class Current: 84/609
• CPC Class Codes: G10H 1/06 Circuits for establishing the harmonic content of tones , or other arrangements for changing the tone colour
• CPC Class Codes: G10H 2210/046 for differentiation between music and non-music signals, based on the identification of musical parameters, e.g. based on tempo detection
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Music information is displayed during playback of multimedia content performed by a multimedia playback device. The multimedia content comprises audio and video. To obtain the music information, audio of the multimedia content is retrieved, environmental noise is filtered out of the audio to generate filtered audio, a rhythm of the filtered audio is obtained, and the music information is generated based on the rhythm of the filtered audio. The music information is displayed simultaneously during playback of the multimedia content.

Claims

1. A method of providing music information during playback of multimedia content performed by a multimedia playback device, the multimedia content comprising audio and video, the method comprising:

marking a desired section of the multimedia content;

retrieving desired audio corresponding to the desired section of the multimedia content;

filtering environmental noise out of the desired audio to generate filtered audio;

obtaining a rhythm of the filtered audio;

generating the music information based on the rhythm of the filtered audio; and

simultaneously displaying the music information during playback of the multimedia content.

2. The method of claim 1, wherein the step of generating the music information comprises:

identifying at least one record in a database relevant to the rhythm of the filtered audio; and

searching a plurality of information using the identified record;

wherein the music information is generated by parsing the searched information.

3. The method of claim 2, wherein the step of identifying the record in the database relevant to the rhythm of the filtered audio comprises:

comparing a tempo information of record with a tempo of the filtered audio; and

comparing a beat information of record with a beat of the filtered audio.

4. The method of claim 1, wherein the step of retrieving audio of the multimedia content comprises

reproducing the desired section of the multimedia content;

and

recording an audio portion from the desired section of the multimedia content, wherein the audio portion is used in the filtering step.

5. The method of claim 1, further comprising:

uploading the music information to a social network website.

6. The method of claim 5, further comprising:

uploading a user'"'"'s comment on the multimedia content to a website in response to the music information.

7. The method of claim 1, wherein displaying the music information during playback of the multimedia content is displaying on an on-screen display.

8. The method of claim 1, further comprising:

generating a link to a website selling an original soundtrack comprising the multimedia content according to the music information.

9. The method of claim 8, further comprising:

the multimedia playback device browsing to the website when the link is clicked.

10. The method of claim 1, further comprising:

generating a link to a website for downloading a song relevant to the music information.

11. The method of claim 10, further comprising:

the multimedia playback device downloading the song from the website after the link is clicked.

12. The method of claim 11, further comprising:

displaying a list of downloaded songs.

13. The method of claim 1, further comprising:

generating a link to a website of a music forum according to the music information.

14. The method of claim 13, further comprising:

the multimedia playback device browsing to the website when the link is clicked.

15. The method of claim 1, wherein the step of displaying the music information comprises displaying a title of a song corresponding to the filtered audio.

16. The method of claim 15, further comprising:

entering an audio-only mode for playback of the music.

17. The method of claim 16, wherein the music is retrieved by streaming.

18. The method of claim 16, wherein the music is retrieved by downloading.

19. The method of claim 1, further comprising:

accessing a lyrics database for receiving lyrics corresponding to the music information.

20. The method of claim 19, further comprising:

displaying a link to the lyrics database corresponding to the music information.

21. The method of claim 19, further comprising:

parsing the lyrics according to the filtered audio of the multimedia; and

displaying the parsed lyrics during playback of the multimedia content.

22. The method of claim 1, wherein the step of generating the music information comprises:

obtaining a title of a song, wherein a rhythm of the song matches with the rhythm of the filtered audio; and

searching for music information according to the obtained title.

23. The method of claim 1, wherein the music information comprises:

an artist, an album, a song title, a genre, a year of production, and a link to a website.

24. An electronic device for displaying a mixed video signal in response to a multimedia file, the electronic device comprising:

an input interface controller for receiving a first mark and a second mark of the multimedia file;

an audio processing module comprising;

an audio extraction module for extracting an audio portion from the multimedia file according to the first mark and the second mark;

a filter for filtering environmental noise out of the audio portion to generate filtered audio; and

a rhythm analyzer for extracting a rhythm of the filtered audio;

a network module for sending the rhythm of the filtered audio to a server to search for information corresponding to the filtered audio;

a processor for parsing the information corresponding to the filtered audio received from the server to generate the music information, and overlaying the music information onto a video signal generated from the multimedia file to generate a mixed video signal; and

a display controller for controlling a display to simultaneously display the mixed video signal.

25. The electronic device of claim 24, further comprising:

an optical disc reader for reading the multimedia file from an optical medium.

26. The electronic device of claim 24, further comprising:

an input interface controller for receiving an input signal;

wherein the input signal triggers the electronic device to display the mixed video signal in response to the multimedia file.

27. A multimedia playback device for providing music information during the playback of multimedia content, the multimedia content comprising audio and video, the multimedia content playback device comprising:

a network module for transmitting a first mark and a second mark of the multimedia content to a database to search information corresponding to a melody section of the multimedia content, wherein the melody section is determined according to the first mark and the second mark;

a processor for parsing the information relevant to the melody section received from the database to generate the music information; and

a display controller for controlling a display to simultaneously display the video and the generated music information.

28. The multimedia playback device of claim 27 further comprising:

an input interface controller for receiving the first mark and the second mark.

29. The multimedia playback device of claim 27 further comprising:

a tempo analyzing module to determining the first mark and the second mark according to tempo of the audio.

30. The multimedia playback device of claim 27, wherein the network module further transmits a unique identifier of the multimedia content to the database to search for music information corresponding to the melody section.

31. The multimedia playback device of claim 27, wherein the database is coupled with an audio processing module, and the audio processing module is for extracting an audio portion from the multimedia content according to the first mark and the second mark, filtering environmental noise out of the audio portion to generate filtered audio and extracting the melody section from the filtered audio.