Dual Motion Sensor Bands for Real Time Gesture Tracking and Interactive Gaming

• US 20190091544A1
• Filed: 09/22/2017
• Published: 03/28/2019
• Est. Priority Date: 09/22/2017
• Status: Active Grant

• Current Assignee: Rosa Mei-Mei Huang
• Original Assignee: Rosa Mei-Mei Huang
• Inventors: Huang, Rosa Mei-Mei
• Granted Patent: US 10,661,148 B2
• Time in Patent Office: Days
• CPC Class Codes: A63B 2024/0096 using performance related parameters for controlling electronic or video games or avatars
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0655 Tactile feedback
• CPC Class Codes: A63B 21/0724 Bar-bells; Hand bars
• CPC Class Codes: A63B 21/0726 Dumb bells, i.e. with a central bar to be held by a single hand, and with weights at the ends
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0059 Exercising apparatus with reward systems
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 24/0087 Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/327 using wireless networks, e.g. Wi-Fi® or piconet
• CPC Class Codes: A63F 13/40 : Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
• CPC Class Codes: A63F 13/42 : by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: G06V 40/23 : Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G09B 19/0015 : Dancing
• CPC Class Codes: G09B 19/0038 : Sports

Abstract

A method and system for recognizing complex patterns of motion and gesturing is disclosed. In one embodiment of the invention a pair of wrist (or ankle) bands senses motion which is analyzed to determine user movements in sagittal, frontal, and transverse planes. An optional front facing camera may be used to augment the data stream collected by motion sensing bands worn by the user. Games and training applications used in conjunction with the motion sensing system provide appropriate feedback, incentives, and scoring to the user via visual, audible, and haptic mechanisms.

Claims

1. A system for motion capture of human activity, comprising:

two or more sensing bands attached to a human body;

each sensing band being in communication with every other sensing band and with an external processor;

the sensing bands operative to track motion of the human body in the x, y, and z axes as well as rotational motion along a transverse plane;

the sensing bands capturing motion of the human body along the x, y, z axes and the transverse plane and transmitting said captured motion to said external processor;

where the captured data from the sensing bands is analyzed by the external processor to create a scoring mechanism to incentivize physical activities; and

transmitting the results from the scoring mechanism in real time to one or more human users of the system.

2. The system of claim 1, where the data captured by the sensing bands are analyzed by the external processor to determine direction and level of motion, the part of the human body performing the movement, duration and dynamic qualities of the movement.

3. The system of claim 1, where the sensing bands may operate in pairs.

4. The system of claim 1, where the sensing bands may operate in groups larger than two and permit the user to be a part of an augmented reality experience.

5. The system of claim 1, further comprising communication into and out of the sensing bands using one or more communication channels such as Near Field Communication (NFC), Bluetooth, WiFi, cellular telephone links, and infrared beaming.

6. The system of claim 1, further comprising collection and analysis of motion data from two or more sensing bands and an optional front facing camera associated with a mobile device.

7. The system of claim 1, further comprising sensing bands operable to provide audible feedback to one or more human users.

8. The system of claim 1, further comprising the sensor bands having a haptic function involving the use of multiple microhammers providing pulse sensations of different frequencies to be delivered to the user simultaneously.

9. The system of claim 1, where pairs of the motion sensing bands fit together in an interlocking ‘

yin yang’

configuration.

10. The system of claim 9, where pairs of the motion sensing bands, utilizing the interlocking configuration, are joined together to be charged on a docking station simultaneously.

12. The system of claim 1, where the data captured by the sensing bands are analyzed by the external processor to determine direction and level of motion, the part of the human body performing the movement, duration and dynamic qualities of the movement.

13. The system of claim 1, where the sensing bands may operate in pairs.

14. The system of claim 1, where the sensing bands may operate in groups larger than two and permit the data collected from all sensing bands to be transmitted to the external processor for analysis in real time.

15. The system of claim 1, further comprising communication into and out of the sensing bands using one or more communication channels such as Near Field Communication (NFC), Bluetooth, WiFi, cellular telephone links, and infrared beaming.

16. The system of claim 1, further comprising collection and analysis of motion data from two or more sensing bands and an optional front facing camera associated with a mobile device.

17. The system of claim 1, further comprising sensing bands operable to provide audible feedback to one or more human users.

18. The system of claim 1, further comprising the sensor bands having a haptic function involving the use of multiple microhammers providing pulse sensations of different frequencies to be delivered to the user simultaneously.

19. The system of claim 1, where pairs of the motion sensing bands fit together in an interlocking ‘

yin yang’

configuration, where pairs of the motion sensing bands, utilizing the interlocking configuration, are joined together to be charged on a docking station simultaneously.

11. A method of capturing the physical motion of a human activity, comprising;

attaching two or more sensing bands to a human body;

establishing data communication between each sensing band and each other sensing band and with an external processor;

the sensing bands operative to track motion of the human body in the x, y, and z axes as well as rotational motion along a transverse plane;

the sensing bands capturing the tracked motion of the human body along the x, y, z axes and the transverse plane and transmitting said captured motion data to said external processor;

analyzing the captured motion data by the external processor to create a scoring mechanism to incentivize physical activities.