Method and system for integrated real and virtual game play for multiple remotely-controlled aircraft

• US 10,258,888 B2
• Filed: 11/16/2016
• Issued: 04/16/2019
• Est. Priority Date: 11/23/2015
• Status: Active Grant

• Current Assignee: QFO Labs, Inc.
• Original Assignee: QFO Labs, Inc.
• Inventors: Pedersen, Brad D., Condon, John P., Fairman, James E.
• Primary Examiner(s): Kim, Gene
• Assistant Examiner(s): Hylinski, Alyssa
• Application Number:
  US15/353,690
• Publication Number:
  US 20170173451A1
• Time in Patent Office: 881 Days
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/792 for payment purposes, e.g. monthly subscriptions
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 27/12 Helicopters A63H27/04 takes precedence; Flying tops
• CPC Class Codes: A63H 30/04 using wireless transmission

Abstract

Gaming systems and methods facilitate integrated real and virtual game play among multiple remote control objects, including multiple remotely-controlled aircraft, within a locally-defined, three-dimensional game space using gaming “apps” (i.e., applications) running on one or more mobile devices, such as tablets or smartphones, and/or a central game controller. The systems and methods permit game play among multiple remotely-controlled aircraft within the game space. Game play may be controlled and/or displayed by a gaming app running on one or more mobile devices and/or a central game controller that keeps track of multiple craft locations and orientations with reference to a locally-defined coordinate frame of reference associated with the game space. The gaming app running on one or more mobile devices and/or central game controller also determine game play among the various craft and objects within the game space in accordance with the rules and parameters for the game being played.

Claims

1. A gaming system integrating three-dimensional real-world game play and virtual game play, the system comprising:

at least two remotely-controlled aircraft and at least two controllers, each aircraft uniquely paired with and controlled by a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft that transmits at least craft control communications between a particular pair of a controller and a remotely-controlled aircraft based on a pair identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

a game space recognition system including;

at least two fiducial elements placed relative to one another to define a three-dimensional game space, and

a locating engine configured to utilize the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within a locally-defined coordinate frame of reference associated with the game space;

at least one mobile computing device configured to execute a gaming application wherein the relative position of each of the at least two remotely-controlled aircraft is utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game, wherein the integrated real and virtual game defines at least one zone selected from the group consisting of;

a health zone that, when a first one of the at least two remotely-controlled aircraft is located within the health zone, provides a relative advantage over a second one of the at least two remotely-controlled aircraft that is not located within the health zone, and

a hiding zone of virtual mountains that, when a first one of the at least two remotely-controlled aircraft is located within the hiding zone, protects the first aircraft from shots fired by a virtual cannon.

2. The gaming system of claim 1, wherein the integrated real and virtual game defines the hiding zone of virtual mountains.

3. The gaming system of claim 1, further comprising a plurality of physical markers, wherein the integrated real and virtual game defines a virtual element corresponding to each of the plurality of physical markers.

4. The gaming system of claim 1, further comprising:

a beacon that emits pulses that are received or returned by a selected one of the at least two remotely-controlled aircraft, and a measurement based on the emitted pulses is used by the locating engine to locate a position of the selected aircraft.

5. The gaming system of claim 1, wherein the at least one mobile computing device executing the gaming application is a smartphone device physically separate from the at least two remotely-controlled aircraft.

6. A gaming system integrating three-dimensional real-world game play and virtual game play, the system comprising:

at least two remotely-controlled aircraft and at least two controllers, each aircraft uniquely paired with and controlled by a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft that transmits at least craft control communications between a particular pair of a controller and a remotely-controlled aircraft based on a pair identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

a game space recognition system including;

at least two fiducial elements placed relative to one another to define a three-dimensional game space, and

a locating engine configured to utilize the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within a locally-defined coordinate frame of reference associated with the game space;

at least one mobile computing device configured to execute a gaming application wherein the relative position of each of the at least two remotely-controlled aircraft is utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game; and

a mapping engine,

wherein the game space recognition system further includes at least one image-acquisition device selected from the group consisting of;

a camera on at least one of the at least two remotely-controlled aircraft,

an ultrasonic range finder altimeter and a camera on at least one of the at least two remotely-controlled aircraft, and

a 180-degree field-of-view camera on each of the at least two fiducial elements,

wherein the image-acquisition device is operable to obtain at least one image of the at least two fiducial elements, and

wherein the mapping engine is configured to determine unique identifiers of the at least two fiducial elements in order to prepare a relative map of positions of the at least two fiducial elements.

7. The gaming system of claim 6

wherein the game space recognition system includes the camera on at least one of the at least two remotely-controlled aircraft.

8. The gaming system of claim 6, further comprising:

wherein the game space recognition system includes the ultrasonic range finder altimeter and a camera on at least one of the at least two remotely-controlled aircraft, and

wherein the mapping engine is further configured to determine an estimated craft height, and angles between the fiducial elements.

9. A gaming system integrating three-dimensional real-world game play and virtual game play, the system comprising:

at least two remotely-controlled aircraft and at least two controllers, each aircraft uniquely paired with and controlled by a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft that transmits at least craft control communications between a particular pair of a controller and a remotely-controlled aircraft based on a pair identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

a game space recognition system including;

at least two fiducial elements placed relative to one another to define a three-dimensional game space, and

a locating engine configured to utilize the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within a locally-defined coordinate frame of reference associated with the game space; and

at least one mobile computing device configured to execute a gaming application wherein the relative position of each of the at least two remotely-controlled aircraft is utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game, wherein the at least two fiducial elements include a plurality of encoded strings of passive fiducial elements placed to crisscross between corners of the game space.

10. A method of integrating three-dimensional real-world game play and virtual game play, the method comprising:

providing at least one mobile computing device, at least two remotely-controlled aircraft and at least two controllers;

uniquely pairing each aircraft with a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft;

transmitting at least craft-control communications between a particular pair that includes one of the at least two controllers and a corresponding one of the at least two remotely-controlled aircraft based on pair-identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

defining a three-dimensional game space using at least two fiducial elements placed relative to one another to define the game space;

associating a locally-defined coordinate frame of reference with the three-dimensional game space;

utilizing the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within the locally-defined coordinate frame of reference associated with the three-dimensional game space;

executing a gaming application on the at least one mobile computing device, wherein the relative positions and orientations of each of the at least two remotely-controlled aircraft are utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game play; and

defining at least one zone selected from the group consisting of;

a hiding zone of virtual mountains that, when a first one of the at least two remotely-controlled aircraft is located within the hiding zone, protects the first aircraft from shots fired by a virtual cannon, and

a health zone that, when a first one of the at least two remotely-controlled aircraft is located within the health zone, provides a relative advantage over a second one of the at least two remotely-controlled aircraft that is not located within the health zone.

11. The method of claim 10, further comprising:

defining a virtual element corresponding to each of a plurality of physical markers placed on the game space.

12. The method of claim 10, further comprising:

executing the gaming application on a smartphone device physically separate from the at least two remotely-controlled aircraft.

13. A method of integrating three-dimensional real-world game play and virtual game play, the method comprising:

providing at least one mobile computing device, at least two remotely-controlled aircraft and at least two controllers;

uniquely pairing each aircraft with a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft;

transmitting at least craft-control communications between a particular pair that includes one of the at least two controllers and a corresponding one of the at least two remotely-controlled aircraft based on pair-identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

defining a three-dimensional game space using at least two fiducial elements placed relative to one another to define the game space;

associating a locally-defined coordinate frame of reference with the three-dimensional game space;

utilizing the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within the locally-defined coordinate frame of reference associated with the three-dimensional game space;

executing a gaming application on the at least one mobile computing device, wherein the relative positions and orientations of each of the at least two remotely-controlled aircraft are utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game play;

obtaining images selected from the group consisting of;

images from each of the at least two remotely-controlled aircraft, and

images from each of the at least two fiducial elements; and

using the images to create a map of the game space.

14. The method of claim 13, further comprising:

obtaining the images from each of the at least two fiducial elements.

15. The method of claim 13, further comprising:

obtaining the images from each of the at least two remotely-controlled aircraft; and

obtaining estimated height data from each of the at least two remotely-controlled aircraft.

16. The method of claim 13, further comprising:

obtaining the images from each of the at least two remotely-controlled aircraft; and

using the images to locate three-dimensional location and orientation information for each of the at least two remotely-controlled aircraft.

17. The method of claim 13, further comprising:

executing the gaming application on a smartphone device physically separate from the at least two remotely-controlled aircraft.

18. A method of integrating three-dimensional real-world game play and virtual game play, the method comprising:

providing at least one mobile computing device, at least two remotely-controlled aircraft and at least two controllers;

uniquely pairing each aircraft with a corresponding one of the at least two controllers via a radio-frequency (RF) communication protocol implemented between the corresponding controller and the remote-control craft;

transmitting at least craft-control communications between a particular pair that includes one of the at least two controllers and a corresponding one of the at least two remotely-controlled aircraft based on pair-identification information contained in the RF communication protocol, the RF communication protocol further including communication of sensor and positional information;

defining a three-dimensional game space using at least two fiducial elements placed relative to one another to define the game space;

associating a locally-defined coordinate frame of reference with the three-dimensional game space;

utilizing the at least two fiducial elements and sensor and positional information received via the RF communication protocol to determine a relative position and orientation of each of the at least two remotely-controlled aircraft within the locally-defined coordinate frame of reference associated with the three-dimensional game space;

executing a gaming application on the at least one mobile computing device, wherein the relative positions and orientations of each of the at least two remotely-controlled aircraft are utilized by the gaming application to determine game play associated with an integrated real and virtual game played among at least two remotely-controlled aircraft within the three-dimensional game space in accordance with a set of rules and parameters for the integrated real and virtual game play; and

obtaining magnetic and gravitational vectors from each respective one of the at least two remotely-controlled aircraft to provide an absolute reference frame to estimate a three-dimensional orientation of the respective aircraft.