User interface image partitioning

• US 20090125799A1
• Filed: 11/14/2007
• Published: 05/14/2009
• Est. Priority Date: 11/14/2007
• Status: Abandoned Application

• Current Assignee: Nathaniel B. Kirby
• Original Assignee: Nathaniel B. Kirby
• Inventors: Kirby, Nathaniel B.
• Application Number:
  US11/985,133
• Publication Number:
  US 20090125799A1
• Time in Patent Office: Days
• US Class Current: 715/234
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: H04N 1/00464 using browsers, i.e. interfaces based on mark-up languages
• CPC Class Codes: H04N 1/00503 Customising to a particular machine or model, machine function or application

Abstract

A user interface image for an application is partitioned into a plurality of sub-images that correspond to a plurality of tiles of a local display grid. At least one sub-image of the plurality of sub-images is sent to a client component as at least one web page element with an absolute position for a remote display of the user interface image by a web browser of the client component, wherein the at least one web page element corresponds to at least one tile of the plurality of tiles of the local display grid.

Claims

1. A method, comprising the steps of:

partitioning a user interface image for an application into a plurality of sub-images that correspond to a plurality of tiles of a local display grid; and

sending at least one sub-image of the plurality of sub-images to a client component as at least one web page element with an absolute position for a remote display of the user interface image by a web browser of the client component, wherein the at least one web page element corresponds to at least one tile of the plurality of tiles of the local display grid.

2. The method of claim 1, further comprising the steps of:

modifying the user interface image within the local display grid;

identifying at least one modified tile of the local display grid; and

sending to the client component at least one modified sub-image that corresponds to the at least one modified tile to cause an update of the web page element that corresponds to the at least one modified tile by the web browser.

3. The method of claim 2, wherein the step of sending to the client component the at least one modified sub-image that corresponds to the at least one modified tile to cause the update of the web page element that corresponds to the at least one modified tile by the web browser comprises the step of:

dynamically sending the at least one modified sub-image as the at least one web page element through employment of an asynchronous JavaScript and XML (AJAX) framework.

4. The method of claim 2, wherein the step of identifying the at least one modified tile of the local display grid comprises the step of:

identifying the at least one modified tile through employment of a hash table that translates coordinates of changes to the user interface image to an index of the at least one modified tile.

5. The method of claim 2, wherein the step of modifying the user interface image within the local display grid comprises the step of:

modifying the user interface image based on a user interface change in the application.

6. The method of claim 5, wherein the step of modifying the user interface image based on the user interface change in the application comprises the steps of:

receiving a user input from the web browser of the client component that is based on a user interaction with the web browser of the client component; and

modifying the user interface image based on the user input.

7. The method of claim 5, wherein the application comprises a first application, wherein the step of modifying the user interface image based on the user interface change in the application comprises the step of:

receiving an input from a second application that causes the change in the user interface image.

8. The method of claim 1, further comprising the steps of:

adjusting at least one dimension of the local display grid from a first size to a second size;

adjusting the at least one web page element of the remote display to correspond with the second size of the local display grid.

9. The method of claim 8, wherein the step of adjusting the at least one web page element of the remote display to correspond with the second size of the local display grid comprises at least one of:

sending a new sub-image as a new web page element with an absolute position for the remote display to adjust the remote display based on the second size of the local display grid if the second size of the at least one dimension is larger than the first size of the at least one dimension.

10. The method of claim 1, wherein the step of sending the at least one sub-image of the plurality of sub-images to the client component as the at least one web page element with the absolute position comprises the step of:

sending the at least one sub-image to the client component as at least one division hypertext markup language (HTML) tag.

11. The method of claim 1, further comprising the steps of:

receiving a request for the application from the web browser of the client component;

generating the local display grid, wherein the local display grid comprises the plurality of tiles;

executing the application;

generating the user interface image for the application.

12. A method, comprising the steps of:

generating a user interface image for a music composition application requested by a user of a web client;

sending the user interface image to the web client;

establishing an asynchronous hypertext transfer protocol (HTTP) connection with the web client;

receiving a user input from the web client through the asynchronous HTTP connection;

updating the user interface image based on the user input; and

sending an updated portion of the user interface image to the web client through the asynchronous HTTP connection.

13. The method of claim 12, wherein the step of sending the updated portion of the user interface image to the web client through the asynchronous HTTP connection comprises the step of:

sending the updated portion of the user interface image as a tiled image portion within a web page element with absolute positioning.

14. The method of claim 12, wherein the step of receiving the user input from the web client through the asynchronous HTTP connection comprises the steps of:

receiving musical note information from the web client;

generating an audio output based on the musical note information;

sending the audio output to the web client.

15. The method of claim 14, wherein the musical note information comprises an X location, a Y location, and a note type for at least one musical note, wherein the step of generating the audio output based on the musical note information comprises the steps of:

ordering the at least one musical note based on the X position of the at least one musical note;

determining a frequency of the at least one musical note based on the Y position of the at least one musical note;

determining a duration of the at least one musical note based on the note type.

16. The method of claim 15, wherein the at least one musical note comprises a plurality of musical notes, wherein the step of ordering the at least one musical note based on the X position of the at least one musical note comprises the step of:

combining two or more musical notes of the plurality of musical notes if the X positions of the two or more musical notes are within a predetermined distance.

17. An apparatus, comprising:

a server component that comprises an audio processor;

wherein the server component is configured to provide a web page to a client component and to receive audio note placement information from the client component;

wherein the server component is configured to employ the audio processor to convert the audio note placement information into an audio track.

18. The apparatus of claim 17, wherein the server component is configured to provide the audio track to the client component through the web page;

wherein the server component is configured to provide the web page and the audio track through a same user interface to the client component.

19. The apparatus of claim 17, wherein the server component is configured to compare the audio note placement information with a benchmark to check for accuracy.

20. The apparatus of claim 17, wherein the audio note placement information comprises an X position, a Y position, and a note type for a plurality of musical symbols.