Application control translation

• US 9,497,238 B1
• Filed: 07/01/2013
• Issued: 11/15/2016
• Est. Priority Date: 06/29/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Evans, Ethan Zane
• Primary Examiner(s): Bui, Jonathan
• Application Number:
  US13/932,118
• Time in Patent Office: 1,233 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/541 via adapters, e.g. between incompatible applications
• CPC Class Codes: H04L 65/60 Network streaming of media packets

Abstract

Disclosed are various embodiments that facilitate translation of application controls. An application is executed in a hosted environment that virtualizes a first input device for the application. A video signal generated by the application is encoded into a media stream, which is sent to another computing device. Input data that is generated in a second input device of the other computing device is obtained from the other computing device. A translated form of the input data is provided to the application through the first input device.

Claims

1. A non-transitory computer-readable medium embodying a program executable in a first computing device comprising at least a memory, wherein when executed the program causes the first computing device to at least:

execute an application in a virtualized computing device in a hosted environment, the virtualized computing device including a first input device and a first output device that are virtualized for the application;

receive input data from a second computing device through a data communications network, the input data being generated in a second input device of the second computing device;

determine an input device configuration of the second input device of the second computing device;

provide a translated form of the input data to the application, the input data being translated from a control set associated with the second input device into a translated control set that is associated with the first input device based at least in part on the input device configuration;

receive output data from the application through the first output device;

determine an output device configuration of a second output device of the second computing device;

send a translated form of the output data to the second computing device through the data communications network, the translated form of the output data being encoded for presentation in the second computing device through the second output device of the second computing device based at least in part on the output device configuration of the second output device; and

wherein the first input device and the second input device correspond to different types of input devices, and the first output device and the second output device correspond to different types of output devices.

19. The non-transitory computer-readable medium of claim 1, wherein the second output device is a haptic device.

2. A system, comprising:

at least one computing device comprising at least one memory; and

a first application stored in the at least one memory and executable in the at least one computing device, wherein when executed the first application causes the at least one computing device to at least;

execute a second application in a hosted environment that virtualizes a first input device for the second application;

receive input data from another computing device, the input data being generated in a second input device of the other computing device;

determine an input device configuration for the second input device;

provide a translated form of the input data to the second application, the input data being translated, based at least in part on the input device configuration, from a form associated with the second input device into the translated form which is associated with the first input device;

receive output data from the second application through a first output device that is virtualized by the hosted environment for the second application;

determine an output device configuration of a second output device of the other computing device; and

provide a translated form of the output data to the other computing device, the translated form of the output data being encoded based at least in part on the output device configuration of the second output device.

3. The system of claim 2, wherein the second application is executed in an emulated computing device that is virtualized by the hosted environment.

4. The system of claim 3, wherein when executed the first application further causes the at least one computing device to at least encode a user interface for rendering in the other computing device, the user interface including a graphical representation of the emulated computing device, wherein a screen of the graphical representation of the emulated computing device is configured to render at least a portion of a video signal generated by the second application.

5. The system of claim 2, wherein when executed the first application further causes the at least one computing device to at least send an interface for generating the input data with the second input device to the other computing device.

6. The system of claim 5, wherein the interface is configured to generate the input data in the translated form, and the input data is received from the other computing device in the translated form.

7. The system of claim 2, wherein the translated form is required by the second application.

8. The system of claim 2, wherein the first input device and the second input device correspond to different types of input devices.

9. The system of claim 2, wherein the first input device and the second input device correspond to one type of input device.

10. The system of claim 2, wherein the output data is translated from a form associated with the first output device into a translated form which is associated with the second output device.

11. The system of claim 2, wherein the first output device and the second output device correspond to different types of output devices.

12. The system of claim 2, wherein the input data is translated according to a hierarchy of control input mappings.

13. The system of claim 2, wherein the output data corresponds to feedback data, and the first input device and the first output device correspond to a haptic control device virtualized by the hosted environment.

20. The system of claim 2, wherein the second output device is a haptic device.

14. A method, comprising:

providing, in a computing device comprising at least a memory, an interface for receiving user input by way of a first input device of the computing device, the interface being configured to facilitate translating the user input to a control set of a second input device virtualized in a hosted environment of another computing device;

receiving, in the computing device, the user input through the first input device of the computing device;

sending, in the computing device, the user input to the other computing device; and

wherein the other computing device is configured to provide a translated form of the user input to an application executed in the hosted environment through the second input device, and the user input is translated according to a hierarchy of control input mappings.

15. The method of claim 14, further comprising:

receiving, in the computing device, application output from the other computing device, the application output being generated by the application for rendering by a first output device virtualized by the hosted environment for the application; and

rendering, in the computing device, the application output through a second output device of the computing device, the application output being translated from a form associated with the first output device into a translated form associated with the second output device.

16. The method of claim 15, wherein the application output corresponds to feedback data, and the second input device and the first output device correspond to a haptic control device virtualized by the hosted environment.

17. The method of claim 14, wherein the first input device and the second input device employ different control sets.

18. The method of claim 14, further comprising:

receiving, in the computing device, output data from the other computing device, the output data being generated by the application for a first output device virtualized by the hosted environment for the application;

determining an output device configuration for the computing device; and

translating the output data from a form associated with the first output device into a translated form associated with a second output device of the computing device based at least in part on the output device configuration.