System and method for capturing text for an online application

• US 10,071,308 B2
• Filed: 06/05/2017
• Issued: 09/11/2018
• Est. Priority Date: 12/10/2002
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Perlman, Stephen G.
• Primary Examiner(s): Suhol, Dmitry
• Assistant Examiner(s): Doshi, Ankit
• Application Number:
  US15/614,206
• Publication Number:
  US 20170266548A1
• Time in Patent Office: 463 Days
• Field of Search: None
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/32 using local area network [LAN] connections
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/35 Details of game servers
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 2300/209 characterized by low level software layer, relating to hardware management, e.g. Operating System, Application Programming Interface
• CPC Class Codes: A63F 2300/402 Communication between platforms, i.e. physical link to protocol
• CPC Class Codes: A63F 2300/407 Data transfer via internet
• CPC Class Codes: A63F 2300/534 for network load management, e.g. bandwidth optimization, latency reduction
• CPC Class Codes: A63F 2300/552 for downloading to client devices, e.g. using OS version, hardware or software profile of the client device
• CPC Class Codes: A63F 2300/554 by saving game or status data
• CPC Class Codes: A63F 2300/556 Player lists, e.g. online players, buddy list, black list
• CPC Class Codes: A63F 2300/572 Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video
• CPC Class Codes: A63F 2300/577 for watching a game played by other players
• CPC Class Codes: A63F 2300/636 involving process of starting or resuming a game
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04L 65/1069 : Session establishment or de-establishment
• CPC Class Codes: H04L 65/401 : wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
• CPC Class Codes: H04L 65/4015 : where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 : Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/611 : for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/752 : adapting media to network capabilities
• CPC Class Codes: H04L 65/756 : adapting media to device capabilities
• CPC Class Codes: H04L 65/765 : intermediate
• CPC Class Codes: H04L 67/01 : Protocols
• CPC Class Codes: H04L 67/025 : for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/131 : Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04N 19/107 : between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/132 : Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/146 : Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/166 : concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/172 : the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 : the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/188 : the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
• CPC Class Codes: H04N 19/436 : using parallelised computational arrangements
• CPC Class Codes: H04N 19/61 : in combination with predictive coding
• CPC Class Codes: H04N 21/233 : Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/2343 : involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2381 : Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network transmission of MPEG streams over ATM H04L12/5601
• CPC Class Codes: H04N 21/4781 : Games
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6377 : directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6405 : Multicasting data broadcast and multicast in packet switching networks H04L12/18
• CPC Class Codes: H04N 21/658 : Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6587 : Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/106 : for domestic distribution

Abstract

A system and method for entering text within a video game application are described. For example, a system according to one embodiment of the invention comprises: a video game hosting service to execute a video game in response to user input; a client device to communicate with the video game hosting service over a first communication channel, wherein the client device has a first user input device communicatively coupled thereto, and wherein control signals for the video game are generated in response to input from the first user input device and transmitted from the client device to the video game hosting service over the first communication channel, the video game hosting service controlling a video game in response to receipt of the control signals; a display device communicatively coupled to the client device, the display device to display video of the video game; wherein the video game hosting service further includes program code to open a second communication channel to receive text input, the second communication channel being separate and independent from the first communication channel and usable by a data processing device capable of generating text input, wherein in response to receipt of text input over the second communication channel, the video game hosting service causes the text input to be displayed on the display device communicatively coupled to the client device.

Claims

1. A video game hosting service, comprising:

a server that is configured to execute an instance of a video game application and exchange game play data of the video game application with a first client device over a network using a first communication channel established between the server and the first client device by the video game hosting service;

a webserver configured to communicate with the video game hosting service, a text capture program code on the webserver is configured to provide a data entry field for receiving text input from a second client device over the network, the text capture program code configured to communicate the text input received from the second client device to the video game hosting service;

a communication interface disposed between the server and the webserver is configured to receive the text input communicated by the webserver, process the text input to generate textual data, and transmit the textual data to the video game hosting service;

a text entry program code within the video game hosting service is configured to automatically establish a second communication channel between the server executing the video game application and the second client device that is used to provide the text input through the webserver, in response to a text entry event detected during execution of the video game application, the second communication channel established over the network,

wherein encoders and scalers within the video game hosting service are configured to encode and package the textual data along with frames of game play data, and forward the frames to the first client device for decoding and rendering, the textual data is configured to be rendered in a separate display region from a display region in which the game play data is rendered at the first client device,

wherein the second communication channel is separate and independent from the first communication channel.

2. The video game hosting service of claim 1, wherein the scalers are configured to scale the display region rendering the textual data so as to accommodate content rendered thereon.

3. The video game hosting service of claim 1, wherein the video game hosting service is configured to process the textual data provided by the second client device to include an image of a user providing the textual data, the separate display region rendering the textual data includes the image of the user providing the textual data.

4. The video game hosting service of claim 1, wherein the communication interface is a text capturing application programming interface (API) hosted by a second server, the text capturing API is communicatively connected via the second communication channel to, (a) the webserver to receive the text input, and (b) to the server to communicate the textual data generated by the text capturing API.

5. The video game hosting service of claim 4, wherein the second server is external to the video game hosting service and is communicatively connected to the server of the video game hosting service via the second communication channel.

6. The video game hosting service of claim 1, wherein the second communication channel is established between the second client device and the server on the video game hosting service through the webserver hosting the website, without having to connect through the first client device.

7. The video game hosting service of claim 1, wherein the text entry program code is configured to query a user account associated with a user operating the first client device to identify the second client device of the user.

8. The video game hosting service of claim 1, wherein the text input is received through a web browser application executing on the second client device.

9. The video game hosting service of claim 1, wherein the textual data provided using the second client device includes user authentication data, the user authentication data is used to authenticate the user in order to provide access to the video game application and is not rendered on a display screen of the first client device.

10. The video game hosting service of claim 1, wherein the separate display region rendering the textual data is a message interface rendering chat messages that are exchanged between a plurality of players, or between a player and a spectator, or between a plurality of spectators, or between a coach and a player, or any combinations thereof, the textual data being a part of the chat messages exchanged.

11. The video game hosting service of claim 1, wherein the second communication channel is established over a second network that is different from the network that connects the first client device to the server.

12. A video game hosting service, comprising:

a server that is configured to execute an instance of a video game application and exchange game play data of the video game application with a first client device over a network using a first communication channel established between the server and the first client device by the video game hosting service;

a webserver configured to communicate with the video game hosting service, a text capture program code on the webserver is configured to provide a data entry field for receiving text input from a second client device over the network, the text capture program code configured to communicate the text input received from the second client device to the video game hosting service;

a communication interface disposed between the server and the webserver is configured to receive the text input communicated by the web server, process the text input to generate textual data, and transmit the textual data to the video game hosting service;

a text entry program code within the video game hosting service is configured to automatically establish a second communication channel over the network between the server executing the video game application and the second client device that is used to provide the text input through the webserver, in response to a text entry event detected during execution of the video game application,

wherein the server is further configured to identify game play data for a first user associated with the first client device, an image of the first user interacting with the video game application, the text input provided using the second client device associated with the first user, and package the identified game play data, the text input for the first user into frames of content associated with the first user, wherein each frame of content is configured to render the game play data for the first user in a display region and the textual data for the first user in a separate display region that is different from the display region rendering the game play data, wherein the separate display region is configured to render the image of the first user alongside the textual data provided by the first user,

wherein encoders and scalers within the video game hosting service are configured to encode the frames of content for the first user, the encoded frames of content are forwarded to the first client device of the first user by the video game hosting service for decoding and rendering,

wherein the second communication channel is separate and independent from the first communication channel and wherein the video game application is a multi-player video game application.

13. The video game hosting service of claim 12, wherein the server is further configured to identify game play data for a second user playing the video game application with the first user, text input for the second user provided through the text capture program code including any text input provided by the second user, and package the identified game play data, text input identified for the second user into frames of content to be provided on a first client device of the second user,

wherein the encoders and scalers are configured to encode the frames of content for the second user, the encoded frames of content are forwarded to the first client device of the second user for decoding and rendering, the frames of content configured to render the textual data for the second user in a separate display region from a display region in which the game play data for the second user is rendered at the first client device of the second user.

14. The video game hosting service of claim 12, wherein the server is further configured to identify images of other users that are playing the video game application with the first user and forward the images of the other users with the frames of content for rendering in a second display region that is different from the display region rendering the game play data and the separate display region rendering the textual data.

15. The video game hosting service of claim 14, wherein the images of the other users are video images or avatars.

16. A method for providing text input during game play of a video game, comprising:

executing an instance of the video game application on a server of a video game hosting service, wherein the video game application is a multi-player video game application, the video game application generating frames of game play data in response to input received from one or more users of the video game application via a first communication channel established between the server and first client devices of the one or more users that is used to provide the input;

automatically establishing a second communication channel between the server and second client devices associated with the one or more users, through a webserver, when a text entry event is detected during the execution of the instance of the video game application;

receiving text input provided through corresponding second client devices associated with the one or more users via the webserver, the text input received through the second communication channel;

processing the text input received from the second client devices using a communication interface disposed between the server and the webserver, to generate textual data;

identifying an image representation and game play data for each of the one or more users of the video game application;

packaging the game play data, the image representation, and the textual data for each user into frames of content, the packaging configured to render the game play data for each user in a display region and the textual data in a separate display region that is different from the separate display region rendering the textual data, wherein the separate display region is further configured to include rendering an image representation of a user that provided the text input alongside the corresponding textual data; and

forwarding the frames of content to corresponding first client devices of the one or more users for decoding and rendering,

wherein operations of the method are performed by one or more processors of the server of the video game hosting service.

17. The method of claim 16, further including providing images of the other users that are playing the video game in a second display region, wherein the second display region is different from the region rendering the game play data and the separate display region rendering the textual data.

18. The method of claim 17, wherein the images of the other users are video images.