Method for tracking physical play objects by virtual players in online environments

• US 9,555,337 B2
• Filed: 09/16/2013
• Issued: 01/31/2017
• Est. Priority Date: 09/16/2013
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Haseltine, Eric, Garlington, Joseph O.
• Primary Examiner(s): Laneau, Ronald
• Application Number:
  US14/028,119
• Publication Number:
  US 20150080121A1
• Time in Patent Office: 1,233 Days
• Field of Search: 463 30- 33
• US Class Current: 1/1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/335 using Internet
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 2300/8023 the game being played by multiple players at a common site, e.g. in an arena, theatre, shopping mall using a large public display
• CPC Class Codes: A63H 27/00 Toy aircraft; Other flying toys toys with parachutes A63H33/20
• CPC Class Codes: A63H 30/04 using wireless transmission

Abstract

Techniques are disclosed for tracking physical play objects by virtual or non-player characters in an electronic game environment. More specifically, techniques are disclosed for enabling a game system to track a physical toy object, using tracking information to update the game state, and transmitting updated game state to the toy object and update the toy state. Additionally, a player is able to control the physical toy object, and use the physical toy object to play a game. The game system may track a remote-controlled toy, a handheld toy, or the player himself or herself. The virtual feedback to changes in the physical environment results in a more immersive game experience for the player.

Claims

1. A method for providing an immersive physical and virtual interactive game play environment, the method comprising:

receiving, by a first game console, tracking data from a physical toy object in the physical game play environment, wherein the physical toy object is controlled by a player interacting with a first controller;

updating a game state of the virtual game play environment based on the received tracking data;

transmitting game state data to the physical toy object;

updating a current physical state of the physical toy object based on the game state data; and

rendering images displayed on a first display based on the updated game state.

2. The method of claim 1, wherein the tracking data includes position and movement data for the physical toy object.

3. The method of claim 1, wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

4. The method of claim 1, further comprising, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object.

5. The method of claim 4, wherein the second game console receives tracking data from a second physical toy object.

6. The method of claim 4, wherein the rendered images include a representation of the second toy object.

7. The method of claim 5, wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

8. A non-transitory computer-readable storage medium storing instructions, which when executed on a processor, perform an operation for providing an immersive physical and virtual interactive game environment, the operation comprising:

receiving, by a first game console, tracking data from a physical toy object in the physical game play environment, wherein the physical toy object is controlled by a player interacting with a first controller;

updating a game state of the virtual game play environment based on the received tracking data;

transmitting game state data to the physical toy object;

updating a current physical state of the physical toy object based on the game state data; and

rendering images displayed on a first display based on the updated game state.

9. The computer-readable storage medium of claim 8, wherein the tracking data includes position and movement data for the physical toy object.

10. The computer-readable storage medium of claim 8, wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

11. The computer-readable storage medium of claim 8, wherein the operation further comprises, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object on a second display.

12. The computer-readable storage medium of claim 11, wherein the second game console receives tracking data from a second physical toy object.

13. The computer-readable storage medium of claim 11, wherein the rendered images on the first display include a representation of the second toy object.

14. The computer-readable storage medium of claim 13, wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

15. A first game console system, comprising:

a processor;

a first controller in communication with the game console system;

a physical toy object, wherein the toy object is controlled via the first controller;

a memory storing an application program configured to perform an operation for providing an immersive physical and virtual interactive game environment, the operation comprising;

receiving, by the first game console, tracking data from the physical toy object, as controlled by a first player interacting with the first controller,

updating a game state of the virtual game play environment based on the received tracking data,

transmitting game state data to the physical toy object,

updating a current physical state of the toy object based on the game state data, and

rendering images displayed on a first display based on the updated game state.

16. The system of claim 15, wherein the tracking data includes position and movement data for the physical toy object.

17. The system of claim 15, wherein updating the game state based on the received tracking data comprises updating a behavior of a non-player character in the electronic game to respond to actions of the physical toy object, as controlled by the player.

18. The system of claim 15, wherein the operation further comprises, transmitting, over a network, the received tracking data to a second game console, wherein the second game console renders a representation of the physical toy object on a second display.

19. The system of claim 18, wherein the second game console receives tracking data from a second physical toy object.

20. The system of claim 19, wherein the rendered images on the first display include a representation of the second physical toy object.

21. The system of claim 20, wherein the second game console transmits the tracking data received from the second physical toy object to the first game console, and wherein the first and second game consoles each update a respective game state based on the tracking data received from the second physical toy object.

22. A method for providing an immersive game environment, comprising:

capturing, by a first camera controlled by a first game console, a video stream of at least a first player at a first location engaging in game play;

rendering, at a second location, the video stream captured by the first camera on a display connected to a second game console;

capturing, by a second camera controlled by the second game console, a video stream of at least a second player at the second location engaging in game play; and

rendering the video stream captured by the second camera on a display connected to a first game console.

23. The method of claim 22, wherein one or more computer graphics (CG) effects are applied to the video stream captured by the first camera prior to being rendered on the display connected to the second game console.

24. The method of claim 22, wherein one or more computer graphics (CG) effects are applied to the video stream captured by the second camera prior to being rendered on the display connected to the first game console.