Multiple electronic control and tracking devices for mixed-reality interaction

• US 10,124,255 B2
• Filed: 06/21/2016
• Issued: 11/13/2018
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: Blue Gogi, LLC
• Original Assignee: Blue Gogi, LLC
• Inventors: Fung, Coleman
• Primary Examiner(s): Alrobaye, Idriss N
• Assistant Examiner(s): Franklin, Richard B
• Application Number:
  US15/187,787
• Publication Number:
  US 20160279514A1
• Time in Patent Office: 875 Days
• CPC Class Codes: A63B 2022/002 electronically, e.g. by using a program
• CPC Class Codes: A63B 2024/009 the load of the exercise apparatus being controlled in synchronism with visualising systems, e.g. hill slope
• CPC Class Codes: A63B 2024/0096 using performance related parameters for controlling electronic or video games or avatars
• CPC Class Codes: A63B 2071/0638 Displaying moving images of recorded environment, e.g. virtual environment
• CPC Class Codes: A63B 2071/0644 with display speed of moving landscape controlled by the user's performance
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2225/093 Height
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 24/0087 Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/31 Communication aspects specific to video games, e.g. between several handheld game devices at close range
• CPC Class Codes: A63F 13/816 Athletics, e.g. track-and-field sports

Abstract

A system for using multiple electronic control and tracking devices for mixed-reality interaction, comprising an electronic control device that communicates with a plurality of electronic devices via a network, that receives user interaction and conveys it to devices via the network, and that receives interaction from other devices via the network and conveys it to a host device, and a method for nested communication between multiple electronic control devices and electronic systems.

Claims

1. A system for using multiple electronic control and tracking devices for real-time mixed-reality interaction, comprising:

first electronic control device comprising at least a first memory, a first processor, and a first plurality of programming instructions stored in the first memory and operating on the first processor, the first programming instructions configured to;

communicate with a plurality of electronic devices each via one of a plurality of network communication protocols, the network communication protocol for each electronic device being selected from a plurality of protocols according to detected capabilities of the particular electronic device, wherein at least one of the plurality of electronic devices is a second electronic control device and further wherein at least one of the plurality of electronic devices is an electronic system comprising a computing device operating a mixed-reality software application;

transmit network communication in a two-way manner between the electronic system and at least the second electronic control device, each via the respective network communication protocol;

operate a plurality of hardware control elements, the hardware control elements configured to receive real-time manual interaction from a user;

transmit a plurality of interaction data to at least one of the plurality of electronic devices in real-time, the interaction data being based at least in part on at least a portion of the real-time manual interaction from the user;

receive real-time data from at least one of the plurality of electronic devices, wherein the real-time data comprises at least a plurality of real-time sensor readings; and

execute an action within the mixed-reality software application based on the received real-time data.

2. The system of claim 1, wherein the plurality of electronic devices comprises at least a virtual reality device.

3. The system of claim 2, wherein the plurality of electronic devices comprises at least a fitness device.

4. The system of claim 3, wherein the fitness device comprises at least a fitness tracking device.

5. The system of claim 4, wherein the fitness tracking device provides at least a plurality of fitness information to at least the virtual reality device.

6. The system of claim 1, wherein the plurality of electronic devices comprises at least a plurality of tethers each comprising a line with one end being attached to an attachment point at a fixed location distal from the body of a human user and with the other end being attached to an attachment point proximal to the body of the human user, the proximal attachment point being configured to be worn or otherwise attached to a user'"'"'s person or clothing, and at least a portion of the distal attachment points comprising a sensor configured to measure at least strain of an attached tether.