METHOD AND APPARATUS FOR TRANSITIONING IN-PROCESS APPLICATIONS TO REMOTE DEVICES

• US 20160231978A1
• Filed: 04/18/2016
• Published: 08/11/2016
• Est. Priority Date: 02/06/2012
• Status: Active Grant

• Current Assignee: Steelseries Aps
• Original Assignee: Steelseries Aps
• Inventors: HAWVER, BRUCE, WOLFF-PETERSEN, JACOB
• Granted Patent: US 10,048,923 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/50 Controlling the output signals based on the game progress
• CPC Class Codes: A63F 2300/204 the platform being a handheld device
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/636 involving process of starting or resuming a game
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 9/485 Task life-cycle, e.g. stopping, restarting, resuming execution G06F9/4881 takes precedence
• CPC Class Codes: G09G 2340/145 : related to small screens
• CPC Class Codes: G09G 2370/02 : Networking aspects
• CPC Class Codes: G09G 5/005 : Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: G09G 5/12 : Synchronisation between the display unit and other units, e.g. other display units, video-disc players

Abstract

A method and apparatus that incorporate teachings of the present disclosure may include, for example, receiving at a mobile communication device a video stream from a computing device. The video stream is associated with images generated by a software application and is transmitted by the computing device responsive to a request to redirect control of the software application to the mobile communication device. The method may also include presenting the streamed video at the mobile communication device and transmitting to the computing device a stimulation of a remote user input function associated with the mobile communication device, where the transmitted stimulation corresponds to at least one action of a plurality of associable actions that can be executed by the software application. Additional embodiments are disclosed.

Claims

1. A non-transitory computer-readable storage medium, comprising computer instructions, which when executed by a processor, cause the processor to perform operations comprising:

transmitting a graphical user interface associated with a halted software application at a computer device to a client device;

receiving from the client device a request to resume the software application;

responsive to the request to resume the software application, restarting execution of the software application at the computer device;

transmitting a graphical representation of the software application to the client device, wherein the graphical representation is presented at a display of the client device;

receiving an indication from the client device of a stimulation of a remote user input function at the client device, wherein the stimulation is caused by a gaming control that is communicatively coupled to the client device for controlling the software application;

responsive to the stimulation that is detected, retrieving an action of a plurality of associable actions, wherein the action corresponds to the stimulation; and

providing the action that is retrieved to an operating system of the computer device for use in the software application.

2. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

responsive to a request to pause, initiating a communication link between the computer device and the client device; and

transmitting the graphical user interface associated with the software application to the client device by way of the communication link.

3. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

transmitting a second graphical user interface to the client device, wherein the second graphical user interface comprises the plurality of associable actions and a plurality of remote accessories operable for communicative coupling to the client device and wherein the plurality of remote accessories are operable for remote navigation and control of the software application of the computer device;

receiving from the client device a selection associating the action of the plurality of associable actions with the remote user input function for one accessory of the plurality of remote accessories; and

recording the association of the action and the remote user input function.

4. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

transcoding the graphical user interface to conform a capability of the client device to generate a transcoded graphical user interface; and

streaming the transcoded graphical user interface to the client device.

5. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

adapting audio data associated with the software application to a capability of the client device to generate adapted audio data; and

transmitting the adapted audio data to the client device.

6. The non-transitory computer-readable storage medium of claim 1, wherein the software application is a gaming application which invokes a gaming feature according to the action or an aspect of the action provided to the operating system.

7. The non-transitory computer-readable storage medium of claim 1, wherein the operations further comprise:

recording a sequence of remote user input function stimuli from the client device; and

associating the sequence of remote input function stimuli to a macro.

8. The non-transitory computer-readable storage medium of claim 7, wherein the macro corresponds to one of the plurality of associable actions.

9. A computing device, comprising a memory coupled to a processor, wherein the memory comprises computer instructions, which when executed by the processor, facilitate performance of operations comprising:

detecting a request to transfer navigation and control of a software application to a client device;

receiving an first indication from a client device of a first stimulation of a remote user input function associated with the client device by way of a communication link to control a software application;

providing, to the software application, first stimulation data that is associated with the first stimulation that is detected; and

transmitting a graphical representation of the software application to the client device, wherein the graphical representation is presented at a display of the client device.

10. The computing device of claim 9, wherein the operations further comprise transmitting a first video stream associated with the software application to the client device by way of the communication link.

11. The computing device of claim 9, wherein the operations further comprise generating first stimulation data provided to the software application from a substitute stimulation that is associated with the first stimulation.

12. The computing device of claim 9, wherein the operations further comprise:

transmitting, to the client device, a graphical user interface representative of a control accessory for remote navigation and control of the software application; and

receiving, from the client device, the remote user input function that is generated from manipulations of the control accessory.

13. The computing device of claim 9, wherein the software application is executed by one of the processor or another computing device.

14. The computing device of claim 9, wherein the operations further comprise:

adapting audio data associated with the software application to a capability of the client device to generate adapted audio data; and

transmitting the adapted audio data to the client device.

15. The computing device of claim 9, wherein the software application is a gaming application which invokes a gaming feature according to the stimulation data.

16. The computing device of claim 9, wherein the operations further comprise:

recording a sequence of remote user input function stimuli from the client device; and

associating the sequence of remote input function stimuli to a macro.

17. The computing device of claim 16, wherein the macro corresponds to one of a plurality of associable actions, and wherein the first stimulation data comprises the action.

18. A method comprising:

restarting, by a system comprising a processor, executing of a software application responsive to a request from a client device to assume control of the software application following a pause in the execution of the software application;

receiving, by the system, an indication from the client device of a stimulation of a remote user input function at the client device, wherein the stimulation is caused by a gaming control that is communicatively coupled to the client device for controlling the software application;

retrieving, by the system, an action of a plurality of associable actions, wherein the action corresponds to the stimulation responsive to the stimulation that is detected; and

providing, by the system, the action that is retrieved to an operating system for use in the software application.

19. The method of claim 18, further comprising streaming, by the system, a graphical representation of the software application to the client device, wherein the graphical representation is presented at a display of the client device, wherein the pause in the execution of the software application is responsive to a request that is received from the client device.

20. The method of claim 18, further comprising:

transmitting, by the system, a graphical user interface to the client device, wherein the graphical user interface represents a virtual accessory for navigation and control of the software application.