Presentation of computing environment on multiple devices

• US 10,277,649 B2
• Filed: 09/18/2017
• Issued: 04/30/2019
• Est. Priority Date: 09/24/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Threlkeld, Elizabeth Fay, Stauber, William Scott, Mikkola, Petteri, Moran, Keri Kruse, Khoury, Issa Y., Sega, Giorgio Francesco, Rahman, Mohammed Kaleemur, Shipley, Kenton Allen, Balasubramanian, Ramrajprabu, Derks, Patrick, Pendlay, Ryan Chandler, Davis, Darren Ray
• Primary Examiner(s): Gillis, Brian J.
• Assistant Examiner(s): Ling, Chhian (Amy)
• Application Number:
  US15/707,057
• Publication Number:
  US 20180007104A1
• Time in Patent Office: 589 Days
• CPC Class Codes: G06F 2209/549 Remote execution
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation

Abstract

A user may interact with a collection of devices that each exhibit particular device properties. Where each device executes and presents an isolated computing environment, inconsistencies may arise in the user interaction by the user with different devices. Alternatively, a terminal server may present a computing environment to various auxiliary devices, but such presentation may fail to utilize some device properties of some devices, and/or may present a computing environment that is not suitable for some devices. Instead, a primary device of the device collection may adapt a primary computing environment to an auxiliary computing environment for each auxiliary device, based upon its device properties. Upon receiving a request to execute an application, the primary device may execute the application within the auxiliary computing environment, and may adapt the application based upon the device properties. The primary device may stream each auxiliary computing environment to the respective auxiliary device.

Claims

1. A method of configuring a primary device comprising a processor to present a primary computing environment to a user through a device collection, the method comprising:

executing, on the processor, instructions that cause the primary device to;

execute a set of applications on behalf of the device collection, wherein the set of applications executed by the primary device includes an instance of a first application that is executed on behalf of a first auxiliary device;

fulfill a request to execute a second application for a second auxiliary device by inserting an instance of the second application into a running applications list; and

stream, to the second auxiliary device, a presentation of an auxiliary computing environment that is adapted to a set of properties of the second auxiliary device, and that includes the instance of the second application while excluding the instance of the first application that is executed by the primary device on behalf of the first auxiliary device.

2. The method of claim 1, wherein the device collection further comprises:

a first auxiliary device comprising a first auxiliary computing environment; and

a second auxiliary device comprising a second auxiliary computing environment.

3. The method of claim 2, wherein executing the instructions further causes the primary device to, responsive to receiving a request to substitute the second auxiliary computing environment for the first auxiliary computing environment of the first auxiliary device, presenting the second auxiliary computing environment on the first auxiliary device instead of the first auxiliary computing environment.

4. The method of claim 2, wherein adapting a selected application within the first auxiliary computing environment of the first auxiliary device further comprises:

according to the device properties of the first auxiliary device and the second auxiliary device, partition the selected application into a first application portion to be presented within the first auxiliary computing environment of the first auxiliary device and a second application portion to be presented within the second auxiliary computing environment of the second auxiliary device; and

streaming the presentation of the first auxiliary computing environment to the first auxiliary device including only the first application portion and excluding the second application portion.

5. The method of claim 4, wherein executing the instructions on the processor further causes the primary device to, responsive to detecting an addition of a third auxiliary device to the device collection, repartition at least one application executing within the auxiliary computing environment of at least one auxiliary device to include the third auxiliary device.

6. The method of claim 2, wherein executing the instructions on the processor further causes the primary device to, responsive to detecting a removal of the first auxiliary device from the device collection, move at least a portion of an application presented within the first auxiliary computing environment of the first auxiliary device to the second auxiliary computing environment of the second auxiliary device.

7. The method of claim 2, wherein:

receiving the request to instantiate a selected application further comprises;

responsive to receiving, from the user through the second auxiliary device, a request specifying the first auxiliary device for which to execute the selected application, execute the selected application within the first auxiliary computing environment of the first auxiliary device.

8. The method of claim 2, wherein:

the first auxiliary computing environment further comprises an instance of a first application;

the second auxiliary computing environment further comprises an instance of a second application; and

executing the instructions on the processor further causes the primary device to enable communication between the first application executing within the first auxiliary computing environment and the second application executing within the first auxiliary computing environment.

9. The method of claim 1, wherein:

the first auxiliary device further comprises an input component;

the second auxiliary computing environment further comprises an instance of a second application; and

executing the instructions on the processor further causes the primary device to, responsive to receiving a request from the user to bind the input component of the first auxiliary device to an application executing within the second auxiliary computing environment of the second auxiliary device, bind the input component of the first auxiliary device to the application.

10. The method of claim 9, wherein:

the first auxiliary device further comprises a first auxiliary computing environment sharing a layout boundary with the second auxiliary computing environment of the second auxiliary device; and

the request received from the user further comprises a transition of the user input of the input component across the layout boundary between the first auxiliary computing environment and the second auxiliary computing environment.

11. The method of claim 1, wherein:

generating the auxiliary computing environment for the respective auxiliary devices further comprises;

selecting, from an application set of the primary computing environment, an application subset for the auxiliary device;

streaming the presentation of the auxiliary computing environment to the auxiliary device further comprises;

presenting the application subset within the auxiliary computing environment to the auxiliary device; and

receiving the request to instantiate a selected application further comprises;

receiving a selection of the selected application from the application subset presented within the auxiliary computing environment.

12. The method of claim 11, wherein receiving the request to instantiate a selected application further comprises:

initially presenting the device collection to the user;

responsive to receiving, from the user, a selection of a selected auxiliary device from the device collection, present the application subset for the auxiliary computing environment of the selected auxiliary device to the user; and

receiving, from the user, a selection of the selected application from the application subset for the selected auxiliary device.

13. The method of claim 11, wherein executing the instructions further causes the primary device to, responsive to receiving a request to present the application set within the auxiliary computing environment of the auxiliary device instead of the application subset, presenting the application set within the auxiliary computing environment of the auxiliary device instead of the application subset.

14. The method of claim 1, wherein receiving the request to instantiate a selected application further comprises:

responsive to receiving, from the user, a request to instantiate the selected application, where the request does not indicate a selected auxiliary device of the device collection;

identifying, among the device collection, at least one candidate auxiliary device for which the device properties are compatible with the selected application; and

selecting, from among the at least one candidate auxiliary device, a selected auxiliary device.

15. An auxiliary device of a device collection that collectively presents to a user a primary computing environment hosted by a primary device, the auxiliary device comprising:

a processor;

an output component; and

a memory storing instructions that, when executed by the processor, provide;

a primary device communicator that;

transmits, to the primary device, a request to execute a second application for the auxiliary device while the primary device concurrently executes a first application on behalf of another device of the device collection; and

an auxiliary computing environment presenter that;

receives, from the primary device, a stream of a presentation of the auxiliary computing environment that is adapted to a set of properties of the auxiliary device, and that includes the instance of the second application while excluding the instance of the first application that is executed by the primary device on behalf of the first auxiliary device; and

presents the auxiliary computing environment to the user through the output component.

16. A primary device that presents a primary computing environment to a user through a device collection, the primary device comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the primary device to;

execute a set of applications on behalf of the device collection, wherein the set of applications executed by the primary device includes an instance of a first application that is executed on behalf of a first auxiliary device;

fulfill a request to execute a second application for a second auxiliary device by inserting an instance of the second application into a running applications list; and

stream, to the second auxiliary device, a presentation of an auxiliary computing environment that is adapted to a set of properties of the second auxiliary device, and that includes the instance of the second application while excluding the instance of the first application that is executed by the primary device on behalf of the first auxiliary device.

17. The primary device of claim 16, wherein executing the instructions on the processor further causes the primary device to, responsive to receiving a request from an application requesting user input from the user:

identify, among the auxiliary devices of the device collection, a selected auxiliary device exhibiting device properties that are compatible with the request; and

binding the user input of the selected auxiliary device to the application.

18. The primary device of claim 16, wherein executing the instructions on the processor further causes the primary device to, responsive to detecting an updated set of device properties of the auxiliary device, adjust the auxiliary computing environment to adapt to the updated set of device properties of the auxiliary device.

19. The primary device of claim 16, wherein executing the instructions on the processor further causes the primary device to:

estimate a maximum auxiliary device count of auxiliary devices that the primary device is capable of driving; and

constraining the device collection to an auxiliary device count of auxiliary devices that is within the maximum auxiliary device count.

20. The primary device of claim 19, wherein estimating the maximum auxiliary device count further comprises:

estimating the maximum auxiliary device count of the auxiliary devices that the primary device is capable of driving with a minimum user experience quality of the auxiliary computing environment for the respective auxiliary devices.