Custom widgets based on graphical user interfaces of applications
First Claim
Patent Images
1. A method, comprising:
- receiving input specifying a first portion of a graphical user interface (GUI) of a first application executing on a first computing device, wherein the GUI is outputted on a first display device and wherein the specified first portion excludes at least one component of the GUI;
rendering the GUI of the first application on a first virtual display of the first computing device;
removing, based on the rendering, the GUI of the first application from the first display device;
generating a first widget which displays the first portion of the GUI of the first application on the first display device;
associating a unique identifier of the first widget with a unique identifier of the first virtual display;
upon receiving user input on the first widget displayed on the first display device;
determining coordinates on the first widget where the user input was received;
transmitting, to the first virtual display, an indication of;
(i) the coordinates on the first widget where the user input was received, (ii) a type of the user input, and (iii) the unique identifier of the first widget, wherein the first virtual display is identified based on the association between the unique identifier of the first virtual display and the unique identifier of the first widget;
mapping the coordinates on the first widget to corresponding coordinates on the GUI rendered on the first virtual display; and
generating an input at the corresponding coordinates on the GUI rendered on the first virtual display, based on the user input;
generating, by the first application, an output responsive to the received user input;
transmitting, by the first virtual display to the first widget, the output; and
determining that a portion of the output is not visible on the first display device due to a size of the first widget;
increasing the size of the first widget to display, on the first display device, the output including the portion of the output that was not visible; and
refreshing the first widget to display the output on the first display device.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems, methods, and computer program products to perform an operation comprising receiving input specifying a first portion of a graphical user interface (GUI) of a first application executing on a first computing device, wherein the GUI is outputted on a display device, rendering the GUI of the first application on a first virtual display of the first computing device, and not on the first display device, and generating a first widget which displays the first portion of the GUI of the first application on the display device, wherein a unique identifier of the first widget is associated with a unique identifier of the first virtual display.
-
Citations
11 Claims
-
1. A method, comprising:
-
receiving input specifying a first portion of a graphical user interface (GUI) of a first application executing on a first computing device, wherein the GUI is outputted on a first display device and wherein the specified first portion excludes at least one component of the GUI; rendering the GUI of the first application on a first virtual display of the first computing device; removing, based on the rendering, the GUI of the first application from the first display device; generating a first widget which displays the first portion of the GUI of the first application on the first display device; associating a unique identifier of the first widget with a unique identifier of the first virtual display; upon receiving user input on the first widget displayed on the first display device; determining coordinates on the first widget where the user input was received; transmitting, to the first virtual display, an indication of;
(i) the coordinates on the first widget where the user input was received, (ii) a type of the user input, and (iii) the unique identifier of the first widget, wherein the first virtual display is identified based on the association between the unique identifier of the first virtual display and the unique identifier of the first widget;mapping the coordinates on the first widget to corresponding coordinates on the GUI rendered on the first virtual display; and generating an input at the corresponding coordinates on the GUI rendered on the first virtual display, based on the user input; generating, by the first application, an output responsive to the received user input; transmitting, by the first virtual display to the first widget, the output; and determining that a portion of the output is not visible on the first display device due to a size of the first widget; increasing the size of the first widget to display, on the first display device, the output including the portion of the output that was not visible; and refreshing the first widget to display the output on the first display device. - View Dependent Claims (2, 3, 4)
-
-
5. A system, comprising:
-
one or more computer processors; a memory containing a program which when executed by the processors performs an operation comprising; receiving input specifying a first portion of a graphical user interface (GUI) of a first application executing on a first computing device, wherein the GUI is outputted on a first display device of the system and wherein the specified first portion excludes at least one component of the GUI; rendering the GUI of the first application on a first virtual display of the first computing device; removing, based on the rendering, the GUI of the first application from the first display device; generating a first widget displays the first portion of the GUI of the first application on the first display device; associating a unique identifier of the first widget with a unique identifier of the first virtual display; upon receiving user input on the first widget displayed on the first display device; determining coordinates on the first widget where the user input was received; transmitting, to the first virtual display, an indication of;
(i) the coordinates on the first widget where the user input was received, (ii) a type of the user input, and (iii) the unique identifier of the first widget, wherein the first virtual display is identified based on the association between the unique identifier of the first virtual display and the unique identifier of the first widget;mapping the coordinates on the first widget to corresponding coordinates on the GUI rendered on the first virtual display; and generating an input at the corresponding coordinates on the GUI rendered on the first virtual display, based on the user input; generating, by the first application, an output responsive to the received user input; transmitting, by the first virtual display to the first widget, the output; and determining that a portion of the output is not visible on the first display device due to a size of the first widget; increasing the size of the first widget to display, on the first display device, the output including the portion of the output that was not visible; and refreshing the first widget to display the output on the first display device. - View Dependent Claims (6, 7, 8)
-
-
9. A computer program product, comprising:
-
a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation comprising; receiving input specifying a first portion of a graphical user interface (GUI) of a first application executing on a first computing device, wherein the GUI is outputted on a first display device and wherein the specified first portion excludes at least one component of the GUI; rendering the GUI of the first application on a first virtual display of the first computing device; removing, based on the rendering, the GUI of the first application from the first display device; and generating a first widget which displays the first portion of the GUI of the first application on the first display device; associating a unique identifier of the first widget with a unique identifier of the first virtual display; upon receiving user input on the first widget displayed on the first display device; determining coordinates on the first widget where the user input was received; transmitting, to the first virtual display, an indication of;
(i) the coordinates on the first widget where the user input was received, (ii) a type of the user input, and (iii) the unique identifier of the first widget, wherein the first virtual display is identified based on the association between the unique identifier of the first virtual display and the unique identifier of the first widget;mapping the coordinates on the first widget to corresponding coordinates on the GUI rendered on the first virtual display; and generating an input at the corresponding coordinates on the GUI rendered on the first virtual display, based on the user input; generating, by the first application, an output responsive to the received user input; transmitting, by the first virtual display to the first widget, the output; and determining that a portion of the output is not visible on the first display device due to a size of the first widget; increasing the size of the first widget to display, on the first display device, the output including the portion of the output that was not visible; and refreshing the first widget to display the output on the first display device. - View Dependent Claims (10, 11)
-
Specification