Sharing games using personal audio/visual apparatus

• US 9,498,720 B2
• Filed: 04/12/2012
• Issued: 11/22/2016
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hastings, Ryan L, Geisner, Kevin A, Latta, Stephen G, Sugden, Ben J, Vaught, Benjamin I, Kipman, Alex Aben-Athar, Perez, Kathryn Stone, Scott, Jason, Bennett, Darren A, Clavin, John, McCulloch, Daniel
• Primary Examiner(s): Tryder, Gregory J
• Assistant Examiner(s): Le, Michael
• Application Number:
  US13/445,616
• Publication Number:
  US 20130084970A1
• Time in Patent Office: 1,685 Days
• Field of Search: 345/619, 345/419, 345156-159, 345/629, 345630-634, 345/8, 715/700, 359630-632, 463/7, 463/31, 463/42, 463/43, 463/59, 463/29
• US Class Current: 1/1
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/75 Enforcing rules, e.g. detecting foul play or generating lists of cheating players
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 2300/1031 using a wireless connection, e.g. Bluetooth, infrared connections
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/308 Details of the user interface

Abstract

A game can be created, shared and played using a personal audio/visual apparatus such as a head-mounted display device (HMDD). Rules of the game, and a configuration of the game space, can be standard or custom. Boundary points of the game can be defined by a gaze direction of the HMDD, by the user'"'"'s location, by a model of a physical game space such as an instrumented court or by a template. Players can be identified and notified of the availability of a game using a server push technology. For example, a user in a particular location may be notified of the availability of a game at that location. A server manages the game, including storing the rules, boundaries and a game state. The game state can identify players and their scores. Real world objects can be imaged and provided as virtual objects in the game space.

Claims

1. A method for sharing a game, comprising:

receiving a command from a first user via a first head-mounted display device to set one point of a boundary line of a game space of a game, the game space is in a physical environment;

in response to the command to set the point, displaying, via the first head-mounted display device, an augmented reality image identifying the one point to the first user in the physical environment;

sharing the augmented reality image identifying the one point in real-time, via a network, with a second head-mounted display device of a second user;

displaying an augmented reality image identifying another point of the boundary line via the first head-mounted display device in real-time in response to a command from the second user via the second head-mounted display device to set the another point of the boundary line, so that points and boundary lines of the game space are defined by multiple users including the first user and the second user in a collaborative manner while the first user and the second user see the points and boundary lines which are being defined in the physical environment using the first and second head-mounted display device, respectively; and

during playing of the game by the first user, displaying an augmented reality image comprising the boundary line.

2. The method of claim 1, further comprising:

capturing an image of the physical environment; and

using the image of the physical environment to provide a model of the game space of the game.

3. The method of claim 1, further comprising:

setting a desired size of the game space of the game;

determining a size of the physical environment; and

determining whether the size of the physical environment is suitable for the desired size of the game space.

4. The method of claim 1, further comprising:

receiving commands from the first user via the first head-mounted display device and from the second user via the second head-mounted display device to set the points of the game space, the points include the one point and the another point;

joining the points together; and

setting the boundary line in the game space of the game by fitting boundary lines in the game space in the physical environment relative to the points.

5. The method of claim 1 wherein the one point is above a ground surface in the physical environment, and the method performed further comprises:

translating the one point above the ground surface to the ground surface to define the boundary line.

6. The method of claim 1, wherein:

in the sharing, the second head-mounted display device displays the augmented reality image identifying the one point via the second head-mounted display device.

7. The method of claim 1, wherein:

the one point is defined as a point in the physical environment at which the first user is gazing according to a respective gaze direction while respective commands of the first user are made to set and then accept the point; and

the another point is defined as a point in the physical environment at which the second user is gazing according to a respective gaze direction while respective commands of the second user are made to set and then accept the point.

8. The method of claim 1, further comprising:

in response to the sharing of the augmented reality image, receiving a request via the first head-mounted display device for the first user to re-define the one point, the request is from the second user.

9. A head-mounted display device, comprising:

a communication interface;

an augmented reality projection system;

a location detection system which detects a location of the head-mounted display device; and

at least one control circuit in communication with the communication interface, the augmented reality projection system and the location detection system, the at least one control circuit is configured to;

periodically inform a server of the location of the head-mounted display device;

when the location of the head-mounted display device indicates that a user of the head-mounted display device has walked into a location of a game, receive a communication from the server over a network, via the communication interface, the communication comprises a request asking if the user desires to play the game, the communication is made based on a determination that the user is eligible to play the game based on the user subscribing to an augmented reality gaming service and having a certain skill level which is set by an owner of the game, wherein permission to play the game is restricted to users with the certain skill level who subscribe to the augmented reality gaming service;

communicate acceptance of the request;

receive a transmission of code from the server over the network, via the communication interface, the code comprising a rule of the game and a game space of the game; and

execute the code, the code controls the augmented reality projection system to provide augmented reality images which display the game space of the game to the user and allow the user to begin to participate in the game in accordance with the rule.

10. The head-mounted display device of claim 9, wherein:

the code comprises a boundary of the game space;

the rule of the game is based on a position of the user in the game space relative to the boundary; and

the at least one control circuit, in communication with the location detection system, is configured to determine a position of the user relative to the boundary, and updates a status of the game based on the position of the user relative to the boundary, the status comprises at least one of a score, points per player or player'"'"'s turn in the game.

11. The head-mounted display device of claim 9, wherein:

the at least one control circuit is configured to communicate a state of the game to a server, the state indicates a status of the user in the game, the status comprises at least one of a score, points per player or player'"'"'s turn in the game.

12. The head-mounted display device of claim 9, wherein:

the communication identifies the owner of the game;

the acceptance is subject to a condition regarding the owner of the game; and

the communication of the acceptance of the request is responsive to a determination that the condition is met regarding the owner of the game.

13. The head-mounted display device of claim 9, wherein:

the code sets a role for the user in the game.

14. The head-mounted display device of claim 9, wherein:

the code sets a position for the user in a field.

15. A method for sharing a game, comprising:

obtaining images of a physical environment comprising an instrumented court using cameras of head-mounted display devices of different users, the different users comprising a first user using a first head-mounted display device and a second user using a second head-mounted display device, and the cameras of the different users having different perspective views of the physical environment;

processing the images, the processing the images comprises detecting lines on the instrumented court;

based on the processing of the images, creating one model of the lines by converting positions of the line in 3D space to a model which can be represented as an augmented reality image, the one model corresponds to the instrumented court and provides a game space of a game;

displaying the game space provided by the one model to the first user to allow the first user to confirm whether the game space provided by the one model accurately matches the instrumented court;

if the user confirms that the game space provided by the one model accurately matches the instrumented court, sharing the game, including the one model, with at least a second user of a second head-mounted display device via a network; and

during playing of the game by the first user and the second user, displaying the augmented reality image to the first user via the first head-mounted display device.

16. The method of claim 15, wherein:

the detecting comprises detecting painted lines on a floor.

17. The method of claim 15, wherein:

the detecting comprises detecting chalk lines on a field.

18. The method of claim 15, wherein:

the instrumented court comprises at least one of a basketball court, volleyball court, baseball field or a football field.

19. The method of claim 15, wherein:

the lines are boundary lines on the instrumented court.

20. The method of claim 15, further comprising:

if the user does not confirm that the game space provided by the one model accurately matches the instrumented court, capturing and processing another image of the instrumented court to provide another model of the lines.