Porting locally processed media data with low latency to a remote client device via various wireless links

• US 10,075,750 B2
• Filed: 06/17/2014
• Issued: 09/11/2018
• Est. Priority Date: 12/10/2002
• Status: Active Grant

• Current Assignee: OnLive Incorporated, Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Gordon, Donald, Paquin, Thomas, Toy, Michael, Roper, Mike, van der Laan, Roger
• Primary Examiner(s): Chan, Allen
• Application Number:
  US14/306,910
• Publication Number:
  US 20140297799A1
• Time in Patent Office: 1,547 Days
• Field of Search: 463 42
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/338 using television networks
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/358 Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/513 server hierarchy, e.g. local, regional, national or dedicated for different tasks, e.g. authenticating, billing
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 21/21 Server components or server architectures
• CPC Class Codes: H04N 21/2143 located in a single building, e.g. hotel, hospital or museum arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106
• CPC Class Codes: H04N 21/23 Processing of content or additional data; Elementary server operations; Server middleware
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2381 Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4384 : involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 7/106 : for domestic distribution
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/14 : Backbone network devices

Abstract

Systems, methods, and computer-readable media for porting locally processed media data with low latency to a remote client device via various wireless links are provided. In one example embodiment, a transceiver module may include a local network interface and a controller that may receive a client control signal from a client device over a wireless local area network via the local network interface, transmit a media control signal based on the client control signal to a media device, receive media data based on the media control signal from the media device, and transmit to the client device over the wireless local area network via the local network interface client data based on the media data and a low-latency compression technique. The receipt of the media data and transmission of the client data may be accomplished with substantially no detectable latency. Additional embodiments are also provided.

Claims

1. A transceiver module comprising:

a local network interface; and

a controller that;

receives a client control signal from a client device over a wireless local area network via the local network interface;

transmits a media control signal based on the client control signal to a media device, the media device is configured to execute media content to produce media data, wherein the client control signal is mapped to the media control signal from a mapping that is based on identification information of the media device and on identification information of the client device such that the transceiver can be used with specific ones of different media devices and specific ones of different client devices which have a corresponding mapping;

receives said media data based on the media control signal directly from the media device over a wired or wireless connection;

compresses the media data received from the media device; and

transmits to the client device over the wireless local area network via the local network interface said compressed media data in a streaming format as client data, said client device is configured to decompress the compressed media data for presentation on a display screen associated with the client device.

2. The transceiver module of claim 1, wherein the controller generates the media control signal based on the client control signal using the identification information from at least one of the client device and the media device.

3. The transceiver module of claim 1, wherein the controller generates the client data based on the media data using the identification information from at least one of the client device and the media device.

4. The transceiver module of claim 1, further comprising an internet interface, wherein the controller switches from using the local network interface to using the internet interface to at least one of receive the client control signal over the internet via the internet interface and transmit the client data over the internet via the internet interface.

5. The transceiver module of claim 1, wherein the controller transmits the media control signal over a bi-directional wired path and receives the media data over a uni-directional wired path.

6. The transceiver module of claim 1, wherein the compressing uses a compressor that encodes the received media data based on a low-latency compression technique before transmission of the client data.

7. The transceiver module of claim 1, wherein the transceiver module is independent from the media device.

8. The transceiver module of claim 1, wherein all information communicated between the client device and the media device passes through the transceiver module.

9. The transceiver module of claim 1, wherein the local network interface communicates directly with the client device via a hardcoded handshake path.

10. The transceiver module of claim 1, wherein the transceiver module is within a housing that is separate from the media device.

11. A transceiver module, comprising:

a local network interface; and

a controller, the transceiver module is connected to a media device system that is configured to execute a game and produce audio and video data, the controller is configured to receive client control signals from a client device over a wireless local area network via the local network interface and transmit a media control signals to the media device system based on the client control signals, wherein the controller is configured to map the client control signals to the media control signals from a mapping that is based on identification information of the media device and identification information of the client device such that the transceiver can be used with specific ones of different media devices and specific ones of different client devices which have a corresponding mapping, the transceiver module is configured to receive audio and video data produced by the media device system based on the media control directly from the media device over a wired or wireless connection and compress said audio and video data, wherein said transceiver transmits to the client device over the wireless local area network via the local network interface said compressed audio and video frames in a streaming format to said client, such that said client device is configured to decompress the compressed audio and video data for presentation on a display screen associated with the client device.

12. The transceiver module of claim 11, wherein the controller transmits the media control signal over a bi-directional wireless or wired path and receives the audio and video data over a uni-directional wireless or wired path.

13. The transceiver module of claim 11, wherein the transceiver module is independent from the media device system.

14. The transceiver module of claim 11, wherein all information communicated between the client device and the media device system passes through the transceiver module.

15. The transceiver module of claim 11, wherein the local network interface communicates directly with the client device via a hardcoded handshake path.

16. The transceiver module of claim 11, wherein the controller generates the media control signal based on the client control signal using the identification information from at least one of the client device and the media device system.

17. The transceiver module of claim 11, wherein the transceiver module is a device that sits between the media device system that produces the audio and video data, wherein instead of outputting said audio and video data to a display and speakers local to the media device system, the transceiver compresses the audio and video data for transmission to at least said client device for remote play of the game on the client device, while said client device uses the display screen and speakers local to the client device for outputting the audio and video data upon decompression locally by said client device.

18. The transceiver module of claim 11, wherein the transceiver module is within a housing that is separate from the media device.