Electronic image visualization system and communication methodologies

• US 20030110925A1
• Filed: 01/29/2003
• Published: 06/19/2003
• Est. Priority Date: 07/10/1996
• Status: Active Grant

• Current Assignee: Bama Gaming LLC (Equitable IP Corporation), Intellectual Ventures Assets 28 LLC (Intellectual Ventures LLC)
• Original Assignee: David H Sitrick
• Inventors: Sitrick, David H., Fling, Russell T.
• Granted Patent: US 7,098,392 B2
• Time in Patent Office: Days
• US Class Current: 84/477R
• CPC Class Codes: G09B 15/002 Electrically operated systems
• CPC Class Codes: G09B 15/023 Electrically operated
• CPC Class Codes: G10G 1/00 Means for the representation of music
• CPC Class Codes: G10H 1/365 the accompaniment information being stored on a host computer and transmitted to a reproducing terminal by means of a network, e.g. public telephone lines
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2210/101 Music Composition or musical creation; Tools or processes therefor
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/145 Multiplayer musical games, e.g. karaoke-like multiplayer videogames
• CPC Class Codes: G10H 2220/206 Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
• CPC Class Codes: G10H 2220/241 on touchscreens, i.e. keys, frets, strings, tablature or staff displayed on a touchscreen display for note input purposes
• CPC Class Codes: G10H 2220/326 Control glove or other hand or palm-attached control device
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• CPC Class Codes: G10H 2230/015 PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used touch-screen interfaces G10H2220/096
• CPC Class Codes: G10H 2240/131 Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
• CPC Class Codes: G10H 2240/211 Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound beam G10H2220/405
• CPC Class Codes: G10H 2240/301 Ethernet, e.g. according to IEEE 802.3
• CPC Class Codes: G10H 2240/311 MIDI transmission G10H2240/056 takes precedence

Abstract

An electronic image visualization system, such as a music stand system and display, management and communications methodologies relating thereto are presented. The electronic music stand system is comprised of a performer subsystem comprising a processing subsystem, librarian logic, performance logic, and communications management logic. The communications management logic provides management of communication via the communications interface with external apparatus responsive to the performance logic and the librarian logic. The user input apparatus and the display apparatus can be integrated into a touch-screen input display. The user input apparatus can alternatively be at least one of a touch-tablet, a stylus-based writing tablet, a mouse, a keyboard, a joystick, a game controller, and a switch. In a preferred embodiment, the librarian logic, the performance logic and the communications management logic are defined by program data stored in the data storage apparatus, and the processor is responsive to the program data for managing data formatting, displaying music, and management of communications of data with the external apparatus. In one embodiment, two Performer subsystems are operable alternatively as one of a single appliance as a linked set a linked mode and as two independent appliances a stand-alone mode, wherein in the linked mode each of the two Performer subsystems operate cooperatively with each other as a linked set to provide a two page display on the video presentation, and wherein in the stand alone mode each of the two Performer subsystems operates independently and mutually exclusive of the other to provide two independent and mutually exclusive single page displays on the video presentation. The present invention also relates to a method for providing for video display of music responsive to the music data stored in a music database. The method is comprised of defining a page of music image data from the music database; defining ordered logical sections; storing the mapping in a memory for selective retrieval; and providing for the video display of the music responsive to the mapping and the storing.

Claims

1. A method for providing for video display of an image responsive to image data stored in an image database, the method comprising:

defining a page of image data from the image database;

defining first slices of the image data for a first orientation;

defining in a second orientation second slices of the first slices to define logical sections;

ordering the first slices from beginning to end;

ordering the second slices from beginning to end;

mapping the first slices, the second slices, the logical sections, and the ordering of the first slices and of the second slices;

storing the mapping in a memory for selective retrieval; and

providing for the video display of the image responsive to the mapping and the storing.

2. The method as in claim 1, further characterized in that the first orientation equals vertical, the second orientation equals horizontal, wherein the beginning equals top for vertical, wherein the end equals bottom for vertical, wherein the beginning equals left side for horizontal, and wherein the end equals right side for horizontal.

3. The method as in claim 1, wherein the step of providing for the display of the image is further comprised of:

defining a display width and display height for the windows to be used for display of the image;

selecting from the logical sections to determine a best fit to the display width and the display height responsive to the mapping and the storing;

and displaying the selected ones of the logical sections on a video display to provide a best fit responsive to the selecting.

4. The method as in claim 3, further characterized in that the display width equals a maximum width for the display, and the display height equals a maximum height for the display.

5. The method as in claim 1, further comprising:

selecting portions of the image data of the selected logical sections for bookmarking;

selecting a specific location within the portions;

associating an associated identification (ID) with the specific locations;

providing bookmark information;

associating the bookmark information with the associated ID and the specific location;

providing for selective video display of the specific locations responsive to user input based on the respective bookmark information.

6. The method as in claim 5, further comprising:

associating the bookmark information with a second associated bookmark ID;

selecting a first bookmark responsive to a user input;

searching for a second bookmark having the respective first associated ID equal to the second associated ID of the respective first bookmark, responsive to the selecting of the first bookmark;

obtaining the specific locations associated with the second bookmark responsive to the searching; and

providing for visual display of the specific locations associated with the second bookmark.

7. The method as in claim 5, further comprising:

providing for user input of selections for bookmarking, specific locations and bookmark information via at least one of a user touch-screen input display, at least one switch input, and at least one button input.

8. The method as in claim 5, further comprising:

providing a bookmark selection mode for displaying the bookmark information and the respective associated ID;

providing for selection of the specific locations responsive to a bookmark selection input; and

displaying a music visual display for the selected specific locations.

9. The method as in claim 8, further comprising:

providing a display for a table of bookmarks representative of the bookmark information for at least some of the bookmarked locations.

10. The method as in claim 9, further comprising:

structuring layout of bookmarks in the display of the table of bookmarks in a physical juxtaposition and relationship to convey information content by relative placement of the bookmarks in the visual display.

11. The method as in claim 10, wherein the structured layout provides information content relating to major movements, minor movements, relatively close sections, and relatively far sections via color and position of display of the bookmarks in the table in the visual display.

12. The method, as in claim 1,

wherein the image is music, wherein the image data is music data, and wherein the image database is a music database.

13. An image display system comprising:

a source of an image database providing image data representative of visual images;

a video display providing a video presentation having a defined display size;

a processing subsystem comprised of a processor, memory providing instruction data and other data; and

a user input providing at least for user selection of the display size,

wherein the processor is responsive to the user selection of the display size and to the instruction data for compatibility with the defined display size, providing for successive sub-sectioning of a composition of the image data providing for definition of a page of image data from the image database;

definition of first slices of the image data for a first orientation; and

definition of a second orientation of second slices of the first slices to define logical sections;

wherein the processor provides for ordering the first slices from beginning to end; and

then ordering the second slices from beginning to end;

wherein the processor provides for storing in the memory a mapping of the first slices and of the second slices for selective retrieval; and

wherein the video display provides a visual presentation of visual images responsive to the mapping.

14. The system as in claim 13,

wherein the visual images are representative of visual images of music notation.

15. The system as in claim 13,

wherein the visual images are representative of visual images of text.

16. The system as in claim 13,

wherein the first orientation equals vertical and the second orientation equals horizontal;

wherein the beginning equals top for vertical;

wherein the end equals bottom for vertical; and

wherein the beginning equals left side for horizontal, and wherein the end equals right side for horizontal.

17. The system as in claim 13,

wherein the display size provided is utilized in defining a maximum display width and a maximum display height for the video presentation;

wherein selected ones of the logical sections are selected to determine a best fit to the maximum display width and the maximum display height responsive to the mapping and the storing; and

wherein the selected ones of the logical sections are provided as a video presentation on the video display so as to provide a best fit.

18. The system as in claim 13,

wherein responsive to the user input of selecting portions of the image data of the selected logical sections for bookmarking, and selecting a specific location within the portions and providing bookmark information, the system associates an associated identification (ID) with the specific location;

and

wherein the system further provides for associating the bookmark information with the associated ID and the specific location;

wherein thereafter the processor subsystem is responsive to the user input, to provide for selective video display of the specific locations responsive to user input based on the respective bookmark information.

19. The system as in claim 18,

wherein the bookmark information is associated with a second associated bookmark ID;

wherein the system is responsive to a user input for selecting a first bookmark;

wherein the processing subsystem searches for a second bookmark having the respective first associated ID equal to the second associated ID of the respective first bookmark, responsive to the selecting of the first bookmark, to obtain the specific locations associated with the second bookmark responsive to the searching; and

wherein the system provides for visual display of the specific locations associated with the second bookmark.

20. The system as in claim 18, wherein the user input provides for selection of bookmarking, identification of specific locations and entry of bookmark information via at least one of a user touch-screen input display, at least one switch input, voice recognition and at least one button input.

21. The system as in claim 18,

wherein the system provides a bookmark selection mode for displaying the bookmark information and the respective associated ID;

wherein the user input provides a bookmark selection input;

wherein selection of the specific locations is responsive to the bookmark selection input; and

wherein the display provides a video presentation for the selected specific locations.

22. The system as in claim 21, wherein the system further provides a video presentation for a table of bookmarks representative of the bookmark information for at least some of the bookmarked locations.

23. The system as in claim 22, wherein the processing subsystem provides for structuring a layout of bookmarks in the video presentation of the table of bookmarks in a relationship to convey information content by relative placement of the bookmarks in the visual display.

24. The system as in claim 23, wherein color of bookmarks in the video presentation is utilized in the structuring to convey relative position of the bookmarks to one another.

25. The system as in claim 23, wherein the structured layout provides information content relating to relative importance of the specific location, relatively close sections, and relatively far sections via position of display of the respective bookmarks in the table in the visual display.

26. The system as in claim 24, wherein the structured layout provides information content relating to relative importance of the specific location, relatively close sections, and relatively far sections via color and position of display of the responsive bookmarks in the table in the visual display.

27. A method of displaying performance notation for performance data comprising:

defining parameters for selecting logical sections from the performance data;

defining parameters for determining logical ordering of the logical sections and for defining advancement of display of the performance data;

defining the slices and the logical ordering responsive to the parameters;

evaluating the performance data to find a largest logical section, responsive to the parameters, utilizing the largest logical section to define a scale for other ones of the logical sections to be displayed; and

,

displaying the performance data as a video display presentation responsive to the defined slices and the defined logical ordering.

28. The method as in claim 27,

wherein the performance notation is music notation, and

wherein the performance data is music data.

29. The method as in claim 27,

wherein the performance notation is script and wherein the performance data generates a video display presentation of script pages.

30. The method as in claim 27, further comprising:

advancing a display presentation of the performance data by utilizing the defined slices and the defined logical ordering.

31. The method as in claim 27, further comprising:

providing for user definition of at least some of the parameters.

32. The method as in claim 27, further comprising:

defining page-size and pagination of the display presentation of the performance data responsive to the parameters.

33. The method as in claim 32, further comprising:

defining parameters for a number of image slices per display presentation;

advancing the display presentation of the performance data responsive to the defined parameters for the number of image slices and logical ordering.

34. The method as in claim 33, further comprising:

providing for user definition of the parameters for the number of image slices.

defining a defined display width and a defined display height for the display to be used for display of the music data;

providing for the selective variation of size and orientation for the display presentation of the performance data responsive to the defined display width and

selecting from the logical sections to determine a best fit to the defined display width and the defined display height responsive to the parameters and the performance data; and

displaying the selected ones of the logical sections on a video display to provide a best fit responsive to the selecting.

35. The method as in claim 28, further comprising:

initially defining page-size and pagination for the display presentation of the performance data responsive to a default ordering of the sections of performance data.

36. The method as in claim 35, wherein the music data is coupled from a source, the method further comprising:

initially defining the page-size and pagination for the default ordering of the logical sections of performance data responsive to parameters defined by the source.

37. The method as in claim 36, further comprising:

logically ordering and displaying the logical sections responsive to the user-defined parameters in that order, rather than in the default ordering.

38. The method as in claim 27, further comprising:

advancing a display presentation of the performance data by utilizing the defined slices and the defined logical ordering.

39. The method as in claim 33, further comprising:

providing for user definition of the parameters for the number of image slices.

defining a defined display width and a defined display height for the display to be used for display of the music data;

providing for the selective variation of size and orientation for the display presentation of the performance data responsive to the defined display width and

selecting from the logical sections to determine a best fit to the defined display width and the defined display height responsive to the parameters and the performance data; and

displaying the selected ones of the logical sections on a video display to provide a best fit responsive to the selecting.

40. A method for processing and structuring image data to provide for video display presentation thereof, the method comprising:

analyzing the image data;

setting parameters defining the image data into defined pages having a given display resolution and size;

defining first slices of the image data for a first orientation;

defining second slices of each of the first slices to define logical sections;

ordering the slices from beginning to end;

ordering the first slices from beginning to end, and

ordering the second slices from beginning to end.

41. The method as in claim 40, further comprising:

mapping of the first slices and the second slices, respectively, to the ordering of the first slices and the second slices, respectively.

42. The method as in claim 41, further comprising:

displaying the music image data responsive to the mapping.

defining second slices of each of the first slices to define logical sections;

ordering the slices from beginning to end;

ordering the first slices from beginning to end, and

ordering the second slices from beginning to end.

43. The method as in claim 40, further comprising:

defining display width and height;

selecting from the logical sections to determine a best fit to the display width and the display height; and

processing to determine the best fit responsive to the selecting from the selected ones of the logical sections; and

,

providing a display presentation of selected ones of the logical section responsive to the processing to provide a display presentation on a video display.

44. The method as in claim 40,

wherein the image data is music image data, and wherein the video presentation is of pages of music notation.

45. The method as in claim 40, wherein:

the first orientation equals vertical, and the second orientation equals horizontal, where the beginning equals top for vertical, where the end equals bottom for vertical, where the beginning equals left side for horizontal, and where the end equals the right side for horizontal.

46. The method as in claim 40, wherein:

the first orientation equals horizontal, and the second orientation equals vertical, where the beginning equals top for vertical, where the end equals bottom for vertical, where the beginning equals right side for horizontal, and where the end equals the left side for horizontal.

47. The method as in claim 40, further comprising:

ordering the first slices from beginning to end;

ordering the second slices from beginning to end;

mapping and storing the first slices, the second slices, the logical sections, and the ordering of the first slices and of the second slices; and

providing for the display presentation of the music data responsive to the mapping and the storing.

48. A method for providing an display of music images responsive to music data from a music database, comprised of:

first defining logical pages of music image data from the music database;

ordering the logical pages of music image data so as to be in a logical page order in correspondence to a defined page ordering parameter;

obtaining a first page;

defining first slices;

obtaining a first slice;

defining second slice for the first slice;

repeatedly obtaining a next first slice, and if found, defining second slices, until there are no remaining frames of the first slices and a completely sliced page is then completed; and

providing the completely sliced page for use in generation of a visual display.

49. The method as in claim 48, wherein defining the first slices by at least one of:

obtaining user input to describe break points between the first slices;

obtaining previously stored information associated with a current display page and automatically finding horizontal lines which cross blank portions of the current display page.

50. The method as in claim 49, further comprising:

obtaining user input to describe break points between the second slices to define the page ordering parameter.

51. The method as in claim 49, further comprising:

obtaining previously stored information associated with a current page to define the page ordering parameter.

52. The method as in claim 49, further comprising:

automatically finding measures in the music to define the page ordering parameter.

53. The method as in claim 48, further comprising:

continuing processing when no more first slices are found to define the page as a completely sliced page, and

proceeding to obtain a next page and repeat the method until no further pages are available.

54. The method as in claim 48, further comprising:

ordering the second slices responsive to the page ordering parameter;

ordering all the second slices within a page by the first orientation;

ordering all the second slices within a page and a first slice grouping by the first orientation;

creating logical groups of second slices;

first creating an empty logical group;

getting the next ordered second slice, if available;

processing to determine whether this second slice will fit on the display along with other second slices in the respective logical group;

adding the respective second slice if it is determined that it will fit, and adding the slice to the respective logical group;

retrieving the next second slice;

determining when the respective second slice cannot be added to the respective logical group and storing in a defined order the respective logical group in a local storage;

determining when there are no more second slices to process, and storing in a defined order the respective logical group in the local storage; and

;

providing for the visual display of the logical groups of second slices in the order stored in the local storage.

55. The method as in claim 54, further comprising:

associating bookmarks with various locations on the pages;

selecting the bookmarks for display;

ordering the bookmarks in a same order as the logical groups are stored in local storage;

associating for every bookmark, a location on a respective page so that a respective bookmark is associated with a respective one of the logical groups when the respective bookmark falls within a displayable area covered by the respective logical group.

56. The method as in claim 55 further comprising:

selecting the respective bookmark;

checking the respective bookmark to determine its type and whether it is at least one of a composition bookmark indicating the beginning of a composition bookmark, a section bookmark and a simple bookmark;

treating all the following logical blocks as a part of a same composition responsive to the composition bookmarks until another composition bookmark is found;

treating all the following logical blocks as a part of that section of the composition responsive to the section bookmark until another section bookmark or a composition bookmark is found; and

treating only a single one of the logical blocks as associated with a simple bookmark responsive to the simple bookmark.

57. The method as in claim 56, further comprising:

creating a display list of the composition bookmarks, the section bookmarks, and the simple bookmarks;

associating a common display color with each of the types of bookmarks.

58. The method as in claim 57, further comprising:

determining whether a bookmark is associated with a logical block within a current displayed section;

displaying the bookmark as black rectangular-shaped button in a list of bookmarks.

59. The method as in claim 55, further comprising:

associating an object with one of the respective bookmarks;

associating the location of the respective bookmark with the respective objects;

associating the respective logical group with the respective object.

60. The method as in claim 59, further comprising:

providing a presentation responsive to the respective object concurrently with the display of the related logical groups.

61. The method as in claim 60, wherein the object is comprised of at least one of:

control data, a video image, a drawing component, a sound image, a movie.

62. The method as in claim 59, further comprising:

initiating a defined action responsive to the object.

63. The method as in claim 62, wherein the defined action is responsive to an event, wherein the event is comprised of:

providing an initial presentation;

selecting one of a logical group and an object; and

one of creation of and destruction of one of the logical groups or objects from the stored information.

64. The method as in claim 62, further comprising:

causing a specific logical block to be displayed responsive to the object, and sending information to another system causing the changing of state of an object of another system.