DYNAMIC ADJUSTMENT OF CLOUD GAME DATA STREAMS TO OUTPUT DEVICE AND NETWORK QUALITY

• US 20160259453A1
• Filed: 03/06/2015
• Published: 09/08/2016
• Est. Priority Date: 03/06/2015
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Colenbrander, Roelof Roderick, Perry, David
• Application Number:
  US14/641,121
• Publication Number:
  US 20160259453A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/323 between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory

Abstract

Aspects of the present disclosure relate to systems and methods for the dynamic adjustment of data streamed over a network which is then displayed on an output device. In particular, aspects of the present disclosure relate to systems and methods for determining the display capabilities of an output device and then formatting two or more streams of data configured for display on the output device, wherein the user interface and video data are contained in separate streams, such that the content is displayed in a manner consistent with the display capabilities of the output device. The output can then be adjusted or prioritized based on device orientation and network quality.

Claims

1. A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:

a) determining the display capabilities of an output device;

b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and

c) delivering the two or more streams of content data to the output device.

2. The non-transitory computer readable medium of claim 1, wherein the two or more data streams include a data stream containing compressed data.

3. The non-transitory computer readable medium of claim 1, wherein the two or more streams of content include a data stream containing data to be displayed as text.

4. The non-transitory computer readable medium of claim 1, wherein the two or more streams of content include a data stream containing data to be displayed as a heads-up-display (HUD).

5. The non-transitory computer readable medium of claim 1, wherein the two or more data streams include a data stream containing data to be displayed as inventory information.

6. The non-transitory computer readable medium of claim 1, wherein the two or more data include a data stream containing data to be displayed map information.

7. The non-transitory computer readable medium of claim 1, wherein the display of one data stream is prioritized over the display of another.

8. The non-transitory computer readable medium of claim 7, wherein the prioritization of display is determined by the quality of the network connection.

9. The non-transitory computer readable medium of claim 1, wherein the display instructions are delivered by a server to a client device platform used in combination with the output device.

10. The non-transitory computer readable medium of claim 9, wherein the client device platform is a gaming console.

11. The non-transitory computer readable medium of claim 9, wherein the client device platform is a computer.

12. The non-transitory computer readable medium of claim 9, wherein the client device platform is a cellular phone.

13. The non-transitory computer readable medium of claim 9, wherein the client device platform is a tablet.

14. The non-transitory computer readable medium of claim 9, wherein the client device platform is a hand-held computing device.

15. The non-transitory computer readable medium of claim 9, wherein the client device platform is a set top box.

16. The non-transitory computer readable medium of claim 9, wherein the client device platform is a telephonic system.

17. The non-transitory computer readable medium of claim 9, wherein the client device platform is a dongle device.

18. The non-transitory computer readable medium of claim 9, wherein the client device is configured to query the output device to determine the display capabilities of the output device and deliver this information to the server.

19. The non-transitory computer readable medium of claim 1, wherein the display capability information also includes a picture orientation of the output device.

20. The non-transitory computer readable medium of claim 1, wherein the content data includes a video portion of a video game.

21. The non-transitory computer readable medium of claim 1, wherein the content data is a stream of a computer program session running on a remote machine.

22. The non-transitory computer readable medium of claim 1, wherein the output device is a television.

23. The non-transitory computer readable medium of claim 1, wherein the output device is a projector.

24. The non-transitory computer readable medium of claim 1, wherein the output device and the client device platform are the same device.

25. The non-transitory computer readable medium of claim 1, wherein b) includes formatting the video data with an application used to generate video frames for the data stream for video data.

26. The non-transitory computer readable medium of claim 1, wherein the two or more streams include a game stream and a user interface stream.

27. The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and one or more additional streams.

28. The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device.

29. The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device, wherein the method further comprises coordinating a peer-to-peer session between the first and second client devices to let the first and second client devices combine the video chat stream with the game stream and the user interface stream.

30. On a server configured to operate on a network, a method, comprising:

a) determining the display capabilities of an output device;

b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data.

31. A system comprising:

a processor, and

a memory coupled to the processor;

wherein the processor is configured to perform a method, the method comprising;

a) determining the display capabilities of an output device;

b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and

c) delivering the two or more streams of content data to the output device.