Systems and Methods for Using Reduced Hops to Generate an Augmented Virtual Reality Scene Within A Head Mounted System

• US 20140364209A1
• Filed: 12/30/2013
• Published: 12/11/2014
• Est. Priority Date: 06/07/2013
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Perry, David
• Granted Patent: US 10,137,361 B2
• Time in Patent Office: Days
• US Class Current: 463/31
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/33 using wide area network [WAN] connections
• CPC Class Codes: A63F 13/355 Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
• CPC Class Codes: A63F 13/40 Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
• CPC Class Codes: A63F 13/50 Controlling the output signals based on the game progress
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/71 using secure communication between game devices and game servers, e.g. by encrypting game data or authenticating players
• CPC Class Codes: A63F 13/90 Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
• CPC Class Codes: A63F 13/98 Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/30 characterized by output arrangements for receiving control signals generated by the game device
• CPC Class Codes: A63F 2300/303 for displaying additional data, e.g. simulating a Head Up Display
• CPC Class Codes: A63F 2300/401 Secure communication, e.g. using encryption or authentication
• CPC Class Codes: A63F 2300/532 using secure communication, e.g. by encryption, authentication
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 : Head tracking input arrangements
• CPC Class Codes: G06F 3/013 : Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/014 : Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 : Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

Systems and methods for using reduced hops to generate an augmented virtual reality scene in a head mounted display. The head mounted display is used for game play via a game cloud system. The head mounted display includes a communications circuit for sending real-world media associated with a game program via a network. The real-world media is processed by the game cloud system and streamed directly from the communications circuit to the game cloud system. The head mounted display further includes a game processing circuit coupled to the communications circuit. The game processing circuit is used for decoding computer-generated interactive media received from the game cloud system via the network. The game processing circuit drives a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media. The computer-generated interactive media is generated based on the real-world media.

Claims

1. A head mounted display for game play via a game cloud system, the head mounted display comprising:

a communications circuit for sending real-world media associated with a game program via a network, the real-world media being processed by the game cloud system and streamed directly from the communications circuit to the game cloud system; and

a game processing circuit coupled to the communications circuit, the game processing circuit for decoding computer-generated interactive media received from the game cloud system via the network, the game processing circuit driving a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media, the computer-generated interactive media generated based on the real-world media.

2. The head mounted display of claim 1, wherein the game processing circuit is used for rendering images of the real-world media and the computer-generated interactive media.

3. The head mounted display of claim 1, further comprising:

a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user; and

an audio circuit for generating sounds based on the decoded media or based on the input.

4. The head mounted display of claim 1, further comprising a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user, wherein the user input circuit includes an inertial sensor circuit for determining the position and motion.

5. The head mounted display of claim 4, wherein the inertial sensor circuit includes a gyroscope, a magnetometer, an accelerometer, or a combination thereof.

6. The head mounted display of claim 1, further comprising a communications circuit to facilitate peer-to-peer multichannel communication between local users via pairing.

7. The head mounted display of claim 1, wherein the communications circuit is used for remote interactive multi-user game play between users via the network.

8. The head mounted display of claim 1, further comprising a user input circuit coupled to the game processing circuit, the user input circuit for generating an input based on a head action of a user, wherein the communications circuit, the user input circuit, and the game processing circuit are integrated in one or more individual circuit chips.

9. The head mounted display of claim 1, wherein the game processing circuit includes a microprocessor for rendering the decoded interactive media, the head mounted display further comprising a buffer for buffering the stream.

10. The head mounted display of claim 1, further comprising a communications circuit for communicating with a hand-held controller.

11. The head mounted display of claim 1, further comprising a user input circuit for receiving an action from a user to generate an input, wherein the input is a voice of a user, a gaze of the user.

12. The head mounted display of claim 11, wherein the input is mapped to an input of a hand-held controller.

13. The head mounted display of claim 1, wherein the head mounted display is used with a hand-held controller that communicates directly with the game cloud system.

14. The head mounted display of claim 1, wherein the head mounted display is used with a hand-held controller, wherein a position and motion of the head mounted display and position and motion of the hand-held controller is represented in a single augmented virtual reality scene.

15. The head mounted display of claim 1, wherein the head mounted display is used with a hand-held controller that communicates with a game console.

16. The head mounted display of claim 1, wherein the head mounted display communicates with a hand-held controller and a console.

17. The head mounted display of claim 16, wherein the hand-held controller communicates with the console.

18. The head mounted display of claim 1, further comprising a user input circuit for receiving an action from a user to generate an input, the input including position and motion detected by the user input circuit, wherein the communications circuit communicates the input directly to the game cloud system.

19. The head mounted display of claim 1, wherein the computer-generated interactive media is received directly from the game cloud system via the network.

20. A method for game play via a game cloud system, the method comprising:

sending real-world media associated with a game program via a network, the real-world media being processed by the game cloud system and streamed directly to the game cloud system; and

decoding computer-generated interactive media received from the game cloud via the network;

driving a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media, the computer-generated interactive media generated based on the real-world media.

21. A non-transitory computer-readable medium for having stored thereon computer executable instructions for game play via a game cloud system, the computer executable instructions when executed by a processor of a computer perform:

sending real-world media associated with a game program via a network, the real-world media being processed by the game cloud system and streamed directly to the game cloud system; and

decoding computer-generated interactive media received from the game cloud via the network; and

driving a portion of interactivity associated with the game program by superimposing the computer-generated interactive media on the real-world media, the computer-generated interactive media generated based on the real-world media.