Method and system for creating a shared game space for a networked game

• US 20090221368A1
• Filed: 04/26/2009
• Published: 09/03/2009
• Est. Priority Date: 11/28/2007
• Status: Abandoned Application

• Current Assignee: Wei Yen
• Original Assignee: AiLive, Inc.
• Inventors: Reynolds, Stuart, Tu, Xiaoyuan, Funge, John, Wright, Ian, Yen, Wei, Wilkinson, Dana, Musick, JR., Charles, Powers, III, William Robert
• Application Number:
  US12/430,095
• Publication Number:
  US 20090221368A1
• Time in Patent Office: Days
• US Class Current: 463/32
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/655 by importing photos, e.g. of the player
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/5533 using program state or machine event data, e.g. server keeps track of the state of multiple players on in a multiple player game
• CPC Class Codes: A63F 2300/5553 user representation in the game field, e.g. avatar
• CPC Class Codes: A63F 2300/6009 for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6081 generating an output signal, e.g. under timing constraints, for spatialization
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

Techniques for creating a shared virtual space based on one or more real-world spaces are disclosed. Representations of the real-world spaces are combined in different ways to create a shared virtual game space within which each person'"'"'s real-world movements are interpreted to create a shared feeling of physical proximity and physical interaction with other people on the network. One or more video cameras in one real-world area are provided to generate video data capturing the users as well as the environment of the users. The shared virtual space is created in reference to the respective real-world spaces that may be combined in various ways. Depending on a particular application, the shared virtual space will be embedded with various virtual objects and representative objects. Together with various rules and scoring mechanisms, such a shared virtual space may be used in a videogame that can be played by multiple players in a game space within which player'"'"'s movements are interpreted to create a shared feeling of physical proximity and physical interaction with other players on the network.

Claims

1. A method for creating a shared game space for a networked videogame, the method comprising:

receiving one or more data streams pertaining to one or more real-world spaces that are not necessarily co-located, each of the data streams including video data pertaining to one of the real-world spaces in which at least a player plays the networked videogame, the video data being used to derive various movements of the player; and

creating the shared game space in reference to the 3D representations of the real-world spaces, wherein movements of at least some of objects in the video game are responsive to respective movements of players respectively in the real-world spaces.

2. The method as recited in claim 1, wherein each of the real-world spaces includes an effective play area in which movements of the player are captured by at least one camera and are used to control a corresponding object in the shared game space.

3. The method as recited in claim 2, wherein the effective play area is defined by one or more of:

a field of view of the camera, optical parameters of the camera and surrounding lighting conditions.

4. The method as recited in claim 3, wherein the effective play area goes beyond the field of view of the camera, the movements of the player falling into a portion of the effective play area beyond the field of view of the camera are tracked by inertial sensors in a controller being held by the player.

5. The method as recited in claim 1, wherein said creating of the shared game space in reference to the 3D representations of the real-world spaces comprises:

embedding at least portions of the 3D representations of the real-world spaces in the shared game space in accordance with predefined criteria;

creating one or more virtual objects in the shared game space according to the videogame; and

embedding one or more representative objects, each of some of the representative objects corresponding to and moving in accordance with one of the players, each of other of the representative objects corresponding to a stationary object in one of the real-world spaces.

6. The method as recited in claim 1, further comprising:

embedding the shared game space with gaming rules to enable various interactions among the virtual and representative objects, and

wherein the each of the data streams further includes sensor data that together with the video data to derive the various movements of the player.

7. The method as recited in claim 6, wherein said receiving one or more data streams pertaining to one or more real-world spaces takes place in a designated device which is one of game consoles that are participating in the networked videogame or a dedicated computing device on the Internet.

8. The method as recited in claim 7, wherein each of the game consoles, coupled to a camera and at least a controller including a plurality of inertia sensors, sends video and sensor data to the designated device.

9. The method as recited in claim 8, wherein the video and sensor data are processed to infer the movements of the player.

10. The method as recited in claim 9, wherein the controller is being held or worn by the player, or attached thereto their body.

11. The method as recited in claim 1 further comprising:

updating the game space while constantly receiving the data streams to reflect the movements of the players.

12. The method as recited in claim 11, wherein each of the data streams comes from a device disposed near the real-world space and coupled to at least one camera being set up to image one of the real-world spaces in which the player plays the videogame.

13. The method as recited in claim 12, wherein the camera produces one or more of full color images, depth image and infrared imaging data.

14. The method as recited in claim 13, wherein the camera captures the movements of the player as well as at least one controller the player is manipulating.

15. The method as recited in claim 14, wherein the sensor data is from the controller and used to derive up to six relative angular and translational motions of the controller.

16. The method as recited in claim 15, wherein the video data is used together with the sensor data to derive up to six absolute angular and translational motions of the controller in one of the real-word spaces.

17. The method as recited in claim 1, wherein said creating of the shared game space in reference to the 3D representations of the real-world spaces comprises:

deriving respectively the 3D representations of the real-world spaces;

combining the 3D representations with one or more of stitching, merging, morphing, superimposing or embedding technique;

processing the shared game space in accordance with a predefined requirement; and

embedding various rules and scoring mechanism in the game space for interactions among the objects.

18. The method as recited in claim 17, wherein there is a virtual sound source in the game space, as an object corresponding to the player moves closer to the virtual sound source, the player hears a louder sound.

19. The method as recited in claim 18, wherein the sound is modulated by motions of a controller being used by the player.

20. The method as recited in claim 1, wherein said receiving one or more data streams pertaining to one or more real-world spaces takes place in a designated device which is one of game consoles that are participating in the networked videogame or a dedicated computing device on the Internet, and the method further comprising:

feeding the updated shared game space from the designated device to the participating game consoles;

caching a copy of the updated shared game space in each of the participating game consoles; and

updating the copy of the game space with information from other participating game consoles as often as possible to maintain a reasonably close correspondence.

21. A system for creating a shared game space for a networked videogame, the system comprising:

a plurality of play areas that are not necessarily co-located and provide respective data streams, each of the play areas equipped with at least one camera and a console, the camera being set up to monitor one of the play areas in which there is at least one player holding a controller to play the shared game, and the console providing one of the data streams that includes both video and sensor data capturing various movements of the player; and

a hosting machine configured to receive the data streams from the play areas and configured to create the shared game space in reference to 3D representations of real-world spaces of the play areas, wherein movements of at least some of objects in the video game are responsive to respective movements of players respectively in the play areas.

22. The system as recited in claim 21, wherein each of the real-world spaces includes an effective play area in which movements of the player are captured by the camera and are used to control a corresponding object in the shared game space.

23. The system as recited in claim 22, wherein the effective play area is defined by one or more of:

a field of view of the camera, optical parameters of the camera and surrounding lighting conditions.

24. The system as recited in claim 23, wherein the effective play area goes beyond the field of view of the camera, the movements of the player falling into a portion of the effective play area beyond the field of view of the camera are tracked by inertial sensors in the controller being held by the player.

25. The system as recited in claim 21, wherein the hosting machine is configured to perform operations of:

embedding at least portions of the 3D representations of the real-world spaces in the shared game space in accordance with predefined criteria;

creating one or more virtual objects in the shared game space according to the videogame; and

embedding one or more representative objects, each of some of the representative objects corresponding to and moving in accordance with one of the players, each of other of the representative objects corresponding to a stationary object in one of the real-world spaces.

26. The system as recited in claim 21, wherein the hosting machine is configured to perform operations of:

embedding the shared game space with gaming rules to enable various interactions among the virtual and representative objects.

27. The system as recited in claim 26, wherein the hosting machine is a designated device which is one of game consoles that are participating in the networked videogame or a dedicated computing device on a network.

28. The system as recited in claim 27, wherein each of the game consoles, coupled to at least one camera and at least one controller including a plurality of inertia sensors, sends the video and sensor data to the designated device.

29. The system as recited in claim 28, wherein the video and sensor data is processed to infer the movements of the player.

30. The system as recited in claim 29, wherein the controller is being held or worn by the player, or attached to their body.

31. The system as recited in claim 21, wherein the camera produces one or more of full color images, depth images and/or infrared imaging data.

32. The system as recited in claim 31, wherein the camera captures the movements of the player as well as at least the controller the player is manipulating.

33. The system as recited in claim 32, wherein the sensor data is from the controller is used to derive up to six relative angular and translational motions of the controller.

34. The system as recited in claim 33, wherein the video data is used together with the sensor data to derive up to six absolute angular and translational motions of the controller in one of the real-world spaces.

35. The system as recited in claim 21, wherein the hosting machine is configured to perform operations of:

deriving respectively the 3D representations of the real-world spaces;

combining the 3D representations with one or more of stitching, merging, morphing, superimposing or embedding techniques;

processing the shared game space in accordance with a predefined requirement; and

embedding various rules and scoring mechanism in the game space for interactions among the objects.

36. The system as recited in claim 35, wherein there is a virtual sound source in the game space, and as an object corresponding to the player moves closer to the virtual sound source, the player hears a louder sound.

37. The system as recited in claim 36, wherein the sound is modulated by motions of a controller being used by the player.

38. The system as recited in claim 21, wherein the hosting machine is configured to perform operations of:

feeding the updated shared game space from the designated device to the participating game consoles;

caching a copy of the updated shared game space in each of the participating game consoles; and

updating the copy of the game space with information from other participating game consoles as often as possible to maintain a reasonably close correspondence.