System for reducing user-perceived lag in text data input and exchange with a server

• US 10,303,496 B2
• Filed: 12/01/2016
• Issued: 05/28/2019
• Est. Priority Date: 12/01/2016
• Status: Active Grant

• Current Assignee: Raja Singh Tuli
• Original Assignee: Raja Singh Tuli
• Inventors: Tuli, Raja Singh
• Primary Examiner(s): Olson, Jason C
• Application Number:
  US15/366,631
• Publication Number:
  US 20180157501A1
• Time in Patent Office: 908 Days
• Field of Search: 715744
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G06F 40/154 Tree transformation for tree-structured or markup documents, e.g. XSLT, XSL-FO or stylesheets
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data

Abstract

The invention discloses a system for accessing and viewing Internet content on a portable device by means of a proxy server. The server requests web content, renders it and sends compressed image parts to the device. In order for the device to be cost-competitive, its processing operations are generally limited to decompressing image parts and displaying them. The server sends information to the device that allows it to locally create, display and manage text boxes, in which the user can type immediately. As a user types into a local text box, text input data is communicated to the server and processed therein before further requests for web content. By simultaneously managing multiple text boxes locally, the present invention reduces instances of data transfer from the server to the device, which decreases the likelihood of lag and improves the performance of the device.

Claims

1. A system comprising:

a host computer receiving information from an outside source, rendering onto a virtual display an image of the information, and selectively transmitting in a compressed format a portion of the image to a portable device capable of receiving it, decompressing it, storing it into memory and displaying a part of said portion of the image onto a display screen of the device, which device is coupled to the host computer through a communication link;

wherein, the host computer sends information to the device identifying at least one text box element in said image, which identifying information comprises the graphic display coordinates and the size of said text box elements;

wherein, each time the device receives from the host computer information identifying a text box element in the image rendered onto a virtual display of the host computer, a software program running on the device thereupon creates a text box locally managed by said software program;

wherein locally-managed text boxes are displayed on a screen of the device when their graphic display coordinates are positioned in said part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device;

wherein, if a locally-managed text box is selected to receive text input entry or editing, any text input by a user is immediately rendered in said selected text box locally managed by a software program of the device; and

wherein, as a user inputs text into a locally-managed text box, the device transmits data associated with this text input to the host computer, which thereafter relies on the data just received to update the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer.

2. The system as claimed in claim 1 wherein locally-managed text boxes are selected to receive text input entry or editing either by a user input or by default configuration from the outside source.

3. The system as claimed in claim 1 wherein information identifying at least one text box element in the image rendered onto a virtual display of the host computer is sent by the host computer to the device immediately or shortly upon its reception by the host computer from an outside source.

4. The system as claimed in claim 3 wherein information identifying at least one text box element in the image rendered onto a virtual display of the host computer is sent by the host computer to the device in priority over the portion of said image that is transmitted to the device.

5. The system as claimed in claim 1 wherein if configuration from the outside source would cause a locally-managed text box to be selected by default to receive text input entry or editing, information identifying the corresponding text box element in the image rendered onto a virtual display of the host computer is sent by the host computer to the device immediately or shortly upon its reception by the host computer from an outside source, and this identifying information is sent to the device in priority over information identifying any other text box element in said image rendered onto a virtual display of the host computer.

6. The system as claimed in claim 5 wherein if configuration from the outside source would cause a locally-managed text box to be selected by default to receive text input entry or editing, information identifying the corresponding text box element in the image rendered onto a virtual display of the host computer is sent by the host computer to the device in priority over information identifying any other text box element in said image rendered onto a virtual display of the host computer and over the portion of said image that is transmitted to the device.

7. The system as claimed in claim 1 wherein the host computer sends information to the device identifying every text box element in the image rendered onto a virtual display of the host computer, which information comprises the graphic display coordinates and the size of said text box elements.

8. The system as claimed in claim 1 wherein information identifying text box elements in the image rendered onto a virtual display of the host computer comprises the preliminary content and the preliminary cursor position of said text box elements, as well as the features of their scrollbar or scrollbars and drop-down menu, if any.

9. The system as claimed in claim 1 wherein locally-managed text boxes that are displayed on a screen of the device overlay the part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device.

10. The system as claimed in claim 1 wherein so long as the image rendered onto a virtual display of the host computer remains virtually displayed thereon, locally-managed text boxes that correspond to text box elements in said image rendered onto a virtual display of the host computer are displayed on a screen of the device when their graphic display coordinates are positioned in the part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device.

11. The system as claimed in claim 1 wherein upon the selection of any locally-managed text box to receive text input entry or editing, a visual signal that is displayed on a screen of the device is triggered, which visual signal remains until said locally-managed text box stops being selected to receive text input entry or editing.

12. The system as claimed in claim 1 wherein upon the selection of any locally-managed text box to receive text input entry or editing, the perimeter of said locally-managed text box is highlighted, which highlighting remains until said locally-managed text box stops being selected to receive text input entry or editing.

13. The system as claimed in claim 1 wherein upon the selection of any locally-managed text box to receive text input entry or editing, a blinking cursor is triggered inside said locally-managed text box, which blinking cursor remains until said locally-managed text box stops being selected to receive text input entry or editing.

14. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user pressing on a command key at the device causes said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the host computer updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer.

15. The system as claimed in claim 14 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

16. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on a command button on a display of the device causes said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the host computer updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer.

17. The system as claimed in claim 16 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

18. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on a display of the device on neither a command button, a drop-down menu or a locally-managed text box causes said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the host computer updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer.

19. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user pressing on the TAB command key at the device causes said locally-managed text box to immediately stop being selected to receive text input entry or editing, and another locally-managed text box is selected to immediately receive text input entry or editing;

and

the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer that corresponds with the previously-selected locally-managed text box.

20. The system as claimed in claim 19 wherein the determination of the locally-managed text box that is newly selected is based on the information previously received by the host computer from an outside source for the image rendered onto a virtual display of the host computer.

21. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on another locally-managed text box on a display of the device causes the initially-selected locally-managed text box to immediately stop being selected to receive text input entry or editing, and said locally-managed text box just clicked on is selected to immediately receive text input entry or editing;

and

the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer that corresponds with the previously-selected locally-managed text box.

22. The system as claimed in claim 1 wherein

the device signals the host computer when a locally-managed text box is selected to receive text input entry or editing or stops being selected to receive text input entry or editing;

upon receiving said signal, the host computer respectively activates or deactivates the corresponding text box element in the image rendered onto a virtual display of the host computer; and

so long as a text box element remains active in the image rendered onto a virtual display of the host computer, the text data content that is received at the host computer from the device is processed in said active text box element, and the virtual display of the host computer is updated accordingly.

23. The system as claimed in claim 22 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user pressing on a command key at the device sends a signal to the device to cause said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of said locally-managed text box to the host computer, which thereafter updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer and deactivates said corresponding text box element.

24. The system as claimed in claim 23 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

25. The system as claimed in claim 22 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on a command button on a display of the device sends a signal to the device to cause said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of said locally-managed text box to the host computer, which thereafter updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer and deactivates said corresponding text box element.

26. The system as claimed in claim 25 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

27. The system as claimed in claim 22 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on a display of the device on neither a command button, a drop-down menu or a locally-managed text box sends a signal to the device to cause said locally-managed text box to immediately stop being selected to receive text input entry or editing;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of said locally-managed text box to the host computer, which thereafter updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer and deactivates said corresponding text box element.

28. The system as claimed in claim 22 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user pressing on the TAB command key at the device sends a signal to the device to cause said locally-managed text box to immediately stop being selected to receive text input entry or editing, and to select another locally-managed text box to immediately receive text input entry or editing;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of the previously-selected locally-managed text box to the host computer, which thereafter updates the text data content of the text box element in the image rendered onto a virtual display of the host computer that corresponds with the previously-selected locally-managed text box, deactivates said corresponding text box element and activates the text box element in the image rendered onto a virtual display of the host computer that corresponds with the newly-selected locally-managed text box.

29. The system as claimed in claim 28 wherein the determination of the locally-managed text box that is newly selected is based on the information previously received by the host computer from an outside source for the image rendered onto a virtual display of the host computer.

30. The system as claimed in claim 22 wherein

if a locally-managed text box is currently selected to receive text input entry or editing, a user clicking on another locally-managed text box on a display of the device sends a signal to the device to cause the initially-selected locally-managed text box to immediately stop being selected to receive text input entry or editing, and to select said locally-managed text box just clicked on to immediately receive text input entry or editing;

and

the device signals the host computer about the user'"'"'s action and transmits data associated with the current text input of the previously-selected locally-managed text box to the host computer, which thereafter updates the text data content of the text box element in the image rendered onto a virtual display of the host computer that corresponds with the previously-selected locally-managed text box, deactivates said corresponding text box element and activates the text box element in the image rendered onto a virtual display of the host computer that corresponds with the locally-managed text box just clicked on.

31. The system as claimed in claim 22 wherein

the host computer has sent or sends information to the device identifying at least a second text box element in the image rendered onto a virtual display of the host computer;

and

when a user input causes another locally-managed text box to be selected to receive text input entry or editing, the user can thereupon enter text input or editing into said other locally-managed text box, which text input entry or edit is immediately processed by the device and immediately displayed on a screen of the device without any intervention from the host computer and even though the host computer may not have yet received the communication from the device signalling that the text box element that is rendered onto a virtual display of the host computer and which corresponds to said other locally-managed text box should be activated.

32. The system as claimed in claim 1 wherein

if a locally-managed text box is currently selected to receive text input entry or editing and the text box element in the image rendered onto a virtual display of the host computer that corresponds with said locally-managed text box features a drop-down menu, a user entering or editing text input causes a software program running on the device to thereupon create a drop-down menu that is locally managed by said software program;

and

said locally-managed drop-down menu is displayed on a screen of the device when its graphic display coordinates are positioned in the part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device.

33. The system as claimed in claim 31 wherein a locally-managed drop-down menu is managed by a software program running on the device in accordance with user text data input and with the information previously received from the host computer identifying the text box element in the image rendered onto a virtual display of the host computer that corresponds with the locally-managed text box that features said drop-down menu.

34. The system as claimed in claim 31 wherein a locally-managed drop-down menu that is displayed on a screen of the device overlays the part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device.

35. The system as claimed in claim 31 wherein

if a locally-managed text box is currently selected to receive text input entry or editing and said locally-managed text box features a drop-down menu that is currently displayed on a screen of the device, a user clicking on an item of said drop-down menu causes said locally-managed text box to immediately stop being selected to receive text input entry or editing, while the text data input of said locally-managed text box is immediately replaced with the text data input of said item of the drop-down menu just clicked on, and said drop-down menu immediately stops being displayed;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of said locally-managed text box to the host computer, which thereafter updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer and stops rendering its corresponding drop-down menu.

36. The system as claimed in claim 35 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

37. The system as claimed in claim 31 wherein as the text data content of a text box element in the image rendered onto a virtual display of the host computer is updated, if its corresponding locally-managed text box is selected and features a drop-down menu locally managed at the device, the host computer creates and virtually displays a drop-down menu in the image rendered onto a virtual display of the host computer.

38. The system as claimed in claim 37 wherein a drop-down menu rendered onto a virtual display of the host computer is managed in accordance with user text data input received from the device and with the features of said drop-down menu as configured in the information received from the outside source.

39. The system as claimed in claim 37 wherein

if a locally-managed text box is currently selected to receive text input entry or editing and said locally-managed text box features a drop-down menu that is currently displayed on a screen of the device, a user clicking on an item of said drop-down menu causes said locally-managed text box to immediately stop being selected to receive text input entry or editing, while the text data input of said locally-managed text box is immediately replaced with the text data input of said item of the drop-down menu just clicked on, and said drop-down menu immediately stops being displayed;

and

the device informs the host computer about the user'"'"'s action and transmits data associated with the current text input of said locally-managed text box to the host computer, which thereafter updates the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer and stops rendering its corresponding drop-down menu.

40. The system as claimed in claim 39 wherein after the host computer updates the text data content of the text box element in the image rendered onto a virtual display of the host computer, the host computer sends a request for information to an outside source.

41. The system as claimed in claim 1 wherein

as the text data content of a text box element in the image rendered onto a virtual display of the host computer is updated, if said text box element features a drop-down menu and if its corresponding locally-managed text box is currently selected to receive text input entry or editing, the host computer creates and displays a drop-down menu in said image rendered onto a virtual display of the host computer;

said drop-down menu rendered onto a virtual display of the host computer is managed in accordance with user text data input received from the device and with the features of said drop-down menu as configured in the information received from the outside source; and

after each instance by which the content of said drop-down menu rendered onto a virtual display of the host computer is initially rendered or updated, the host computer transmits in a compressed format an image of said drop-down menu to the device, which decompresses it and displays it on a screen of the device when the graphic display coordinates of said image of the drop-down menu are positioned in the part of the portion of the image that was transmitted from the host computer to the device and that is displayed on a screen of the device.

42. The system as claimed in claim 41 wherein

if a locally-managed text box is currently selected to receive text input entry or editing and a user clicks on an image of a drop-down menu, which image has been received from the host computer and is currently displayed on a screen of the device, said click causes said locally-managed text box to immediately stop being selected to receive text input entry or editing, and said image of a drop-down menu immediately stops being displayed on a screen of the device;

the device communicates the graphic display coordinates of the user'"'"'s click to the host computer, which thereafter associates the graphic display coordinates of this click with an item of the drop-down menu rendered onto a virtual display of the host computer, replaces the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer with the text data content of said item of the drop-down menu that is associated with a user'"'"'s click, and the host computer stops rendering said drop-down menu onto a virtual display; and

the host computer thereafter sends the text data content of said text box element rendered onto a virtual display of the host computer to the device, which thereafter replaces the current text data content of the corresponding locally-managed text box with the text data content just received from the host computer.

43. A system comprising:

a host computer receiving information from an outside source, rendering onto a virtual display an image of the information, and selectively transmitting in a compressed format a portion of the image to a portable device capable of receiving it, decompressing it, storing it into memory and displaying a part of said portion of the image onto a display screen of the device, which device is coupled to the host computer through a communication link;

wherein, after transmitting to the device said portion of the image rendered onto a virtual display of the host computer, the host computer sends information to the device identifying at least one text box element in said image, which identifying information comprises the graphic display coordinates and the size of the text box elements;

wherein, each time the device receives from the host computer information identifying a text box element in the image rendered onto a virtual display of the host computer, a software program running on the device thereupon creates a text box locally managed by said software program;

wherein locally-managed text boxes are displayed on a screen of the device when their graphic display coordinates are positioned in said part of the portion of the image that was or will be transmitted from the host computer to the device and that is or will be displayed on a screen of the device;

wherein, if a locally-managed text box is selected to receive text input entry or editing, any text input by a user is immediately rendered in said selected text box locally managed by a software program of the device; and

wherein, as a user inputs text into a locally-managed text box, the device transmits data associated with this text input to the host computer, which thereafter relies on the data just received to update the text data content of the corresponding text box element in the image rendered onto a virtual display of the host computer.

44. The system as claimed in claim 43 wherein if configuration from the outside source would cause a locally-managed text box to be selected by default to receive text input entry or editing, information identifying the corresponding text box element in the image rendered onto a virtual display of the host computer is sent by the host computer to the device in priority over information identifying any other text box element in said image rendered onto a virtual display of the host computer.