INTERACTIVE VIRTUAL DISPLAY SYSTEM
First Claim
1. A method for providing virtual displays of a plurality of remote heterogeneous computing devices on a local display surface, comprising steps for:
- providing a composite display comprising a separate virtual display corresponding to each of a plurality of remote computing devices on a local display surface, each virtual display being generated from screen images that are periodically transmitted by each corresponding remote computing device;
providing a local user input mechanism for interacting with any of the virtual displays corresponding to any of the remote computing devices;
monitoring interaction with any of the virtual displays and sending corresponding control events to the corresponding remote computing device; and
interpreting the control events to provide input to the corresponding remote computing device in order to control the actions of the corresponding remote computing device.
1 Assignment
0 Petitions
Accused Products
Abstract
An “Interactive Virtual Display,” as described herein, provides various systems and techniques that facilitate ubiquitous user interaction with both local and remote heterogeneous computing devices. More specifically, the Interactive Virtual Display uses various combinations of small-size programmable hardware and portable or wearable sensors to enable any display surface (e.g., computer display devices, televisions, projected images/video from projection devices, etc.) to act as a thin client for users to interact with a plurality heterogeneous computing devices regardless of where those devices are located relative to the user. The Interactive Virtual Display provides a flexible system architecture that enables communication and collaboration between a plurality of both local and remote heterogeneous computing devices. This communication and collaboration enables a variety of techniques, such as adaptive screen compression, user interface virtualization, real-time gesture detection to improve system performance and overall user experience, etc.
32 Citations
20 Claims
-
1. A method for providing virtual displays of a plurality of remote heterogeneous computing devices on a local display surface, comprising steps for:
-
providing a composite display comprising a separate virtual display corresponding to each of a plurality of remote computing devices on a local display surface, each virtual display being generated from screen images that are periodically transmitted by each corresponding remote computing device; providing a local user input mechanism for interacting with any of the virtual displays corresponding to any of the remote computing devices; monitoring interaction with any of the virtual displays and sending corresponding control events to the corresponding remote computing device; and interpreting the control events to provide input to the corresponding remote computing device in order to control the actions of the corresponding remote computing device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented process for adapting an arbitrary display surface into a thin client having a plurality of virtual interactive displays, comprising using one or more computing devices to perform process actions for:
-
periodically receiving transmissions of separate screen images corresponding to each of a plurality of applications running on a plurality of remote heterogeneous computing devices; generating separate virtual interactive displays from the received screen images of each corresponding application; constructing a composite interactive display from two or more of the separate virtual interactive displays and rendering the composite interactive display on a local display surface; providing a local user interface for interacting with any of the virtual interactive displays comprising the composite interactive display; monitoring inputs received via the local user interface and converting one or more of those inputs to corresponding control events; and providing the control events as inputs to the corresponding applications running on the corresponding remote heterogeneous computing devices. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A computer-readable storage device having computer executable instructions stored therein for providing virtual displays of a plurality of remote heterogeneous computing devices on a local display surface, said instructions causing a processor to execute operations comprising:
-
running one or more applications on each of a plurality of remote heterogeneous computing devices; locally generating a composite display comprising a separate virtual display corresponding to each of the applications running on the remote heterogeneous computing devices, each virtual display being locally generated from compressed screen images that are periodically received via transmission from each corresponding host; rendering the composite display on a local display surface; receiving user inputs for interacting with any of the virtual displays comprising the composite display; and converting the user inputs to corresponding control events and transmitting those control events as inputs to the corresponding applications running on corresponding remote heterogeneous computing devices. - View Dependent Claims (17, 18, 19, 20)
-
Specification