System and method for synchronizing a graphic image and a media event

• US 6,275,222 B1
• Filed: 09/06/1996
• Issued: 08/14/2001
• Est. Priority Date: 09/06/1996
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Desain, Petrus Wilhelmus Maria
• Primary Examiner(s): Alam, Hosain T.
• Assistant Examiner(s): Kindred, Alford W.
• Application Number:
  US08/708,286
• Time in Patent Office: 1,803 Days
• Field of Search: 345/116-302, 841/01--49, 707/500, 707/526
• US Class Current: 715/202
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/921 Spatial
• CPC Class Codes: Y10S 707/99954 Version management

Abstract

In an illustrative embodiment, the invention discloses a computer system in which an arbitrary set of graphical images can be used to navigate through a musical score. The musical score may be read through by a user while listening to the music and pointing to a corresponding position in the music. To this end, tracking information may be stored with image as a time-place mapping. In navigation through the musical score, the mapping may be used inversely to calculate musical time from a place pointed at in the score. In collaboration, the mapping may be used to calculate corresponding positions in different versions (parts) of the same musical score presented to different users.

Claims

1. A computer system comprising:

1) means for storing a time-based media file that corresponds to a portion of a media event;

2) means for storing a graphic image that corresponds to the portion of the media event; and

3) means for relating time position in the media file with spatial position in the graphic image that corresponds to the portion of the media event, so that a time-place mapping is created between the media file and the graphic image.

2. A computer system according to claim 1, wherein the time-based media file comprises an audio file.

3. A computer system according to claim 1, wherein the time-based media file comprises a video.

4. A computer system according to claim 1, wherein the graphic image corresponds to a musical score.

5. A computer system according to claim 1, comprising means for moving a pointing device over the graphic image while the media file is presented, thereby constructing the time-place mapping.

10. A computer system as recited in claim 1, further including

means for storing said time-place mapping.

11. A computer system as recited in claim 10, further including

means for accessing a portion of said graphic image from storage based upon a selected position in said media file.

12. A computer system as recited in claim 10, further including

means for accessing a portion of said media file from storage based upon a selected spatial position in said graphic image.

13. A computer system as recited in claim 11, further including

means for accessing a sequence of portions of said graphic image in accordance with presentation of said media file.

14. A computer system as recited in claim 13, further including

means for accessing a sequence of portions of another graphic image in accordance with presentation of said media file.

15. A computer system as recited in claim 14, wherein said graphic image and said another graphic image include different sets of pointing, annotation and selecting action information.

6. A computer method comprising the steps of:

1) storing a time-based media file that corresponds to a portion of a media event;

2) storing a graphic image that corresponds to a portion of the media event; and

3) relating time position in the media file with spatial position in the graphic image that corresponds to a portion of the media event by moving a pointing device over the graphic image while the media file is presented, thereby constructing a time-place mapping between the media file and the graphic image.

7. A method according to claim 6, comprising a step of displaying a state of the media file by indicating a selected portion of the graphic image.

8. A method according to claim 6, comprising a step of selecting a fragment of the media file pointing at the graphic image.

9. A method according to claim 6, comprising a step of displaying pointing gestures and selections made by one user in the graphical image to appear in the appropriate position in another graphical image with another layout presented to another user by first relating a space position in the first image to a time position using the map corresponding to that image and then relating this time position to a space position in the other image using the map of this second image.

16. A method as recited in claim 6, including the further step of

storing said time-place mapping.

17. A method as recited in claim 16, including the further step of

accessing a portion of said media file in accordance with a selected location in said graphic image.

18. A method as recited in claim 16, including the further step of

accessing a portion of said graphic image in accordance with a selected location in said media file.

19. A method as recited in claim 18, wherein said accessing step is repeated in accordance with a presentation of said media file.

20. A method as recited in claim 18, including the further step of

accessing a portion of another graphic image in accordance with a selected location in said media file.