Interactive gaming with co-located, networked direction and location aware devices

• US 9,333,424 B2
• Filed: 08/17/2012
• Issued: 05/10/2016
• Est. Priority Date: 04/29/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Huang, Ronald Keryuan, Mayor, Rob, Mahe, Isabel, Piemonte, Patrick
• Primary Examiner(s): SUN, YU-HSI DAVID
• Application Number:
  US13/588,190
• Publication Number:
  US 20120315994A1
• Time in Patent Office: 1,362 Days
• Field of Search: 463/30, 463/31, 463/32, 463/37, 463/42
• US Class Current: 1/1
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/22 Setup operations, e.g. calibration, key configuration or button assignment
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/34 using peer-to-peer connections
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/77 involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
• CPC Class Codes: A63F 13/837 Shooting of targets
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/1006 having additional degrees of freedom
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: A63F 2300/405 being a wireless ad hoc network, e.g. Bluetooth, Wi-Fi, Pico net
• CPC Class Codes: A63F 2300/406 Transmission via wireless network, e.g. pager or GSM
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands

Abstract

An interactive game environment includes two or more co-located, networked, direction and location aware interactive game devices. The game devices share a common reference coordinate frame (e.g., a three-dimensional Cartesian coordinate frame). Each game device maintains its own device state (e.g., position, orientation, time) in the reference coordinate frame. Each interactive game device shares its device state with the other interactive game devices using communication technology (e.g., Bluetooth, Wi-Fi, cellular). Each interactive game device can use the device states of the other interactive game devices to project the relative positions and orientations of the other interactive game devices into a local, fixed coordinate frame of the interactive game device. These projections allow each interactive gaming device to know the position and orientation of the other interactive game devices in an interactive game environment defined by the reference coordinate frame.

Claims

1. A computer-implemented method of calibrating an interactive game device, comprising:

detecting a user interaction with the interactive game device;

in response to detecting the user interaction with the interactive game device;

presenting, on a display of the interactive game device, a user interface that includes a representation of a coordinate frame that indicates a first direction, and

presenting, on the user interface, a visual indication of divergence of a current direction of the interactive game device from the first direction as a displacement from an axis of the coordinate frame;

detecting a movement of the interactive game device, wherein the movement of the interactive game device includes a corresponding movement of the display that is coupled to the interactive game device;

adjusting the visual indication of divergence of the current direction of the interactive game device in the user interface based on the movement of the interactive game device;

detecting when the current direction of the interactive game device is aligned with the first direction; and

indicating on the user interface that the current direction of the interactive game device is aligned with the first direction.

2. The method of claim 1, wherein presenting the visual indication of the divergence of the current direction from the first direction comprises:

providing, on the user interface, a textual message instructing a user of the interactive game device to rotate the interactive game device in a specified direction until the visual indication of the current direction of the interactive game device is aligned with the visual indication of the first direction.

3. The method of claim 1, comprising:

recording at least one of a position or an orientation of the interactive game device; and

computing elements of a reference coordinate frame to a device frame transformation matrix using the recorded orientation of the interactive game device.

4. The method of claim 1, wherein presenting the user interface on the display of the interactive game device comprises:

presenting, on the user interface, a compass diagram indicating direction.

5. The method of claim 1, wherein detecting the movement of the interactive game device comprises:

measuring, using an orientation sensor coupled to the interactive game device, the movement or the orientation of the interactive game device.

6. The method of claim 5, wherein measuring, using the orientation sensor, the movement or the orientation of the interactive game device comprises:

measuring, using one of a magnetic compass or an accelerometer, the movement or the orientation of the interactive game device.

7. The method of claim 1, wherein detecting the user interaction with the interactive game device comprises detecting user interaction with a hardware button on the interactive game device or a virtual user interface element presented on the display of the interactive game device, and

wherein presenting the user interface in response to detecting the user interaction with the interactive game device comprises:

in response to detecting the user interaction with the hardware button on the interactive game device or the virtual user interface element presented on the display of the interactive game device, activating a calibration mode of the interactive game device; and

based on activating the calibration mode, presenting, on the display of the interactive game device, the user interface that includes the representation of the coordinate frame that indicates the first direction.

8. An interactive game device, comprising:

a processor; and

memory coupled to the processor and operable for storing instructions, which, when executed by the processor, cause the processor to perform operations comprising;

detecting a user interaction with the interactive game device;

in response to detecting the user interaction with the interactive game device;

presenting, on a display of the interactive game device, a user interface that includes a representation of a coordinate frame that indicates a first direction, and

presenting, on the user interface, a visual indication of divergence of a current direction of the interactive game device from the first direction as a displacement from an axis of the coordinate frame;

detecting a movement of the interactive game device, wherein the movement of the interactive game device includes a corresponding movement of the display that is coupled to the interactive game device;

adjusting the visual indication of divergence of the current direction of the interactive game device in the user interface based on the movement of the interactive game device;

detecting when the current direction of the interactive game device is aligned with the first direction; and

indicating on the user interface that the current direction of the interactive game device is aligned with the first direction.

9. The device of claim 8, wherein the instructions that cause the processor to perform operations comprising presenting the visual indication of the divergence of the current direction from the first direction include instructions that cause the processor to perform operations comprising:

providing, on the user interface, a textual message instructing a user of the interactive game device to rotate the interactive game device in a specified direction until the visual indication of the current direction of the interactive game device is aligned with the visual indication of the first direction.

10. The device of claim 9, wherein the user interface includes a compass diagram indicating direction.

11. The device of claim 8, comprising an orientation sensor that is used by the processor in detecting the movement or the orientation of the interactive game device.

12. The device of claim 11, wherein the orientation sensor is one of a magnetic compass or an accelerometer.

13. The device of claim 8, comprising instructions that cause the processor to perform operations comprising:

recording at least one of a position or an orientation of the interactive game device; and

computing elements of a reference coordinate frame to a device frame transformation matrix using the recorded orientation of the interactive game device.

14. The device of claim 13, comprising an integrated GPS receiver that is configured to be used by the processor in recording at least one of the position or the orientation of the interactive game device.

15. The interactive game device of claim 8, wherein detecting the user interaction with the interactive game device comprises detecting user interaction with a hardware button on the interactive game device or a virtual user interface element presented on the display of the interactive game device, and

wherein presenting the user interface in response to detecting the user interaction with the interactive game device comprises:

in response to detecting the user interaction with the hardware button on the interactive game device or the virtual user interface element presented on the display of the interactive game device, activating a calibration mode of the interactive game device; and

based on activating the calibration mode, presenting, on the display of the interactive game device, the user interface that includes the representation of the coordinate frame that indicates the first direction.

16. A computer program product, embodied in a non-transitory computer-readable medium storing instructions, which, when executed by a processor, cause the processor to perform operations comprising:

detecting a user interaction with an interactive game device;

in response to detecting the user interaction with the interactive game device, presenting, on a display of the interactive game device;

a user interface that includes a representation of a coordinate frame that indicates a first direction, and

presenting, on the user interface, a visual indication of divergence of a current direction of the interactive game device from the first direction as a displacement from an axis of the coordinate frame;

detecting a movement of the interactive game device, wherein the movement of the interactive game device includes a corresponding movement of the display that is coupled to the interactive game device;

adjusting the visual indication of divergence of the current direction of the interactive game device in the user interface based on the movement of the interactive game device;

detecting when the current direction of the interactive game device is aligned with the first direction; and

indicating on the user interface that the current direction of the interactive game device is aligned with the first direction.

17. The computer program product of claim 16, wherein the instructions that cause the processor to perform operations comprising presenting the visual indication of the divergence of the current direction from the first direction include instructions that cause the processor to perform operations comprising:

providing, on the user interface, a textual message instructing a user of the interactive game device to rotate the interactive game device in a specified direction until the visual indication of the current direction of the interactive game device is aligned with the visual indication of the first direction.

18. The computer program product of claim 17, wherein the user interface includes a compass diagram indicating direction.

19. The computer program product of claim 16, comprising instructions that cause the processor to perform operations comprising:

recording at least one of a position or an orientation of the interactive game device; and

computing elements of a reference coordinate frame to a device frame transformation matrix using the recorded orientation of the interactive game device.

20. The computer program product of claim 16, wherein the instructions that cause the processor to perform operations comprising detecting the movement of the interactive game device include instructions that cause the processor to perform operations comprising:

measuring, using an orientation sensor coupled to the interactive game device, the movement or the orientation of the interactive game device.

21. The computer program product of claim 20, wherein the instructions that cause the processor to perform operations comprising measuring, using the orientation sensor, the movement or the orientation of the interactive game device include instructions that cause the processor to perform operations comprising:

measuring, using one of a magnetic compass or an accelerometer, the movement or the orientation of the interactive game device.

22. The computer program product of claim 16, wherein detecting the user interaction with the interactive game device comprises detecting user interaction with a hardware button on the interactive game device or a virtual user interface element presented on the display of the interactive game device, and

wherein presenting the user interface in response to detecting the user interaction with the interactive game device comprises:

in response to detecting the user interaction with the hardware button on the interactive game device or the virtual user interface element presented on the display of the interactive game device, activating a calibration mode of the interactive game device; and

based on activating the calibration mode, presenting, on the display of the interactive game device, the user interface that includes the representation of the coordinate frame that indicates the first direction.