Method and system to analyze sports motions using motion sensors of a mobile device

• US 9,101,812 B2
• Filed: 10/18/2012
• Issued: 08/11/2015
• Est. Priority Date: 10/25/2011
• Status: Active Grant

• Current Assignee: Aquimo LLC
• Original Assignee: Aquimo LLC
• Inventors: Jeffery, Mark John, Komorous-King, Robert Sunshin, Rana, Manoj
• Primary Examiner(s): Rowland, Steve
• Application Number:
  US13/655,366
• Publication Number:
  US 20130102419A1
• Time in Patent Office: 1,027 Days
• Field of Search: 463/3, 463/42
• US Class Current: 1/1
• CPC Class Codes: A63B 2102/02 Tennis
• CPC Class Codes: A63B 2102/06 Squash
• CPC Class Codes: A63B 2102/14 Lacrosse
• CPC Class Codes: A63B 2102/18 Baseball, rounders or similar games
• CPC Class Codes: A63B 2102/20 Cricket
• CPC Class Codes: A63B 2102/22 Field hockey
• CPC Class Codes: A63B 2102/32 Golf
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/44 Angular acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2243/0054 Bowling, i.e. ten-pin bowling
• CPC Class Codes: A63B 2244/16 Spear or javelin throwing
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0006 Computerised comparison for qualitative assessment of motion sequences or the course of a movement
• CPC Class Codes: A63B 60/46 Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
• CPC Class Codes: A63B 69/3608 Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: A63B 69/3623 for driving A63B69/3608, A63B69/3658, A63B69/3661, A63B69/3667 and A63B69/3691 take precedence
• CPC Class Codes: A63B 69/3632 Clubs or attachments on clubs, e.g. for measuring, aligning A63B69/3614 takes precedence; clubs for swinging exercises in general A63B15/00
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/57 : Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game A63F13/56 takes precedence
• CPC Class Codes: A63F 13/812 : Ball games, e.g. soccer or baseball
• CPC Class Codes: A63F 13/92 : Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: G09B 19/0038 : Sports

Abstract

A method and system to analyze sports motions using the motion sensors of a mobile device, such as a smart phone, is provided. This method uses the mobile device motion sensor output to define the impact point with a virtual object, such as a golf ball, baseball or tennis ball. The motion sensor signature of the sports motion is analyzed for characteristics, specific to each type of sports motion. A method is disclosed using multiple sensors outputs in a mobile device to compute the impact point with a virtual object, such as a golf ball, baseball, tennis ball. Further, a method is disclosed where moving virtual sports objects interact with virtual sports motions and the responsive outputs are displayed on the mobile device and/or any Web-enabled display device.

Claims

1. A method of analyzing sports motions, comprising:

(a) determining a starting point of a sports motion to be simulated using a mobile device having integrated motion sensors, wherein the starting point is indicated solely by a user holding the mobile device still for a predetermined length of time;

(b) moving the mobile device from the starting point along a path to complete the simulation;

(c) obtaining motion data from the motion sensors relating to the starting point and the movement along the path;

(d) determining an occurrence of a simulated sports event using the obtained motion data; and

(e) outputting information related to the simulated sports motion based at least in part on the simulated sports event, wherein the steps (c) to (e) are performed using a processor integral to the mobile device;

(f) wherein the mobile device is not attached to any piece of sports equipment and the starting point is not indicated by user-entered input.

2. The method of claim 1, wherein the mobile device is a phone.

3. The method of claim 1, wherein outputting the information related to the simulated sports event includes outputting the information on a screen of the mobile device.

4. The method of claim 1, wherein outputting the information related to the simulated sports event includes outputting the information to a gaming system.

5. The method of claim 1, wherein the motion sensors include an accelerometer and a multi-axis gyroscope.

6. The method of claim 1, wherein the sports event is an impact point with a virtual object.

7. The method of claim 6, further comprising the step of determining the velocity of a virtual object around the impact point.

8. The method of claim 7, wherein determining the velocity is based at least in part on determined velocity of the mobile device around the impact point, determined arm length, determined club length, and determined arc length for a determined swing type.

9. The method of claim 7, wherein determining the velocity does not include use of data from an accelerometer.

10. The method of claim 7, wherein determining the velocity includes calculating the velocity using first motion data and applying a multiplier based on simultaneous second motion data.

11. The method of claim 6, further comprising determining the instantaneous velocity of a virtual object at the impact point.

12. The method of claim 6, wherein the impact point is determined by finding a moment when a first rotational orientation of the mobile device is at or near a minimum and the derivative of a second rotational orientation of the mobile device is at or near a maximum.

13. The method of claim 6, wherein the motion sensors include a multiaxis gyroscope, and the impact point is determined using two or more of pitch, roll, and yaw.

14. The method of claim 1, further including analyzing the simulated sports motion.

15. The method of claim 14, wherein analyzing the simulated sports motion includes analyzing one of the pitch, roll and yaw of the mobile device during the simulated sports motion.

16. The method of claim 14, wherein the simulated sports motion is determined based on a first motion of the mobile device during the simulated sports motion and a second motion of the mobile device at an impact point.

17. The method of claim 16, wherein analyzing the second motion of the mobile device at the impact point includes subtracting the second motion at the impact point from the second motion at the starting point.

18. The method of claim 1, wherein the sports event is a release point.

19. The method of claim 1, wherein the release point is one of a release point of a bowling ball, a lacrosse handle, a basketball, a baseball, a hockey stick, a bean bag, an American football and a fishing rod.

20. The method of claim 1, wherein outputting information related to the simulated sports motions includes outputting the information using at least one of the mobile device and a separate web-enabled display.

21. The method of claim 1, wherein outputting information related to the simulated sports motions includes outputting one or more of a rendered golf ball flight, a baseball flight, a basketball flight, a tennis ball movement, a ping pong ball movement, a bean bag toss, an American football flight, a bowling ball path, a fishing hook flight and other motion responsive to the simulated sports motion.

28. The method of claim 1, wherein the starting point is indicated by the mobile device emitting a sound or vibration.

29. The method of claim 6, wherein the impact point is found at a minimum of one of pitch, roll or yaw of the mobile device along the path.

30. The method of claim 6, wherein the virtual object is a virtual golf ball.

31. The method of claim 7, wherein the virtual object is a virtual golf ball.

32. The method of claim 31, wherein determining the velocity is based at least in part on determined velocity of the mobile device around the impact point, determined arm length, determined club length, and determined arc length for a determined swing type.

33. The method of claim 31, further including determining ball flight distance based at least in part on the determined velocity of the virtual golf club head.

34. The method of claim 31, wherein determining the velocity includes applying a multiplier based on estimated wrist hinge and forearm rotation as measured by yaw and roll of the mobile device at the impact point.

35. The method of claim 1, wherein moving the mobile device from the starting point along the path includes swinging the mobile device to simulate a golf swing.

36. The method of claim 35, wherein the golf swing is one of a full golf swing, a chip, and a putt.

37. The method of claim 30, wherein the impact point is determined by finding a moment when pitch of the mobile device is at or near a second minimum.

38. The method of claim 14, wherein analyzing the simulated sports motion includes analyzing the pitch of the mobile device during the simulated sports motion.

39. The method of claim 17, wherein the second motion data is roll of the mobile device.

40. The method of claim 6, wherein the impact point is determined by finding a moment when a first rotational orientation of the mobile device is at or near a minimum and the derivative of a second rotational orientation of the mobile device is at or near a maximum.

41. The method of claim 40, wherein the first rotational orientation of the mobile device is pitch and the second rotational orientation of the mobile device is yaw.

42. The method of claim 2, wherein the screen of the phone is substantially perpendicular to the sports motion path at the calibration point of the sports motion.

43. The method of claim 42, wherein the sport is one of golf, baseball, basketball, tennis, bowling, ping pong, and bean bag tossing.

44. The method of claim 1, wherein moving the mobile device from the starting point along the path includes swinging the mobile device to simulate one of a golf swing, a baseball swing, a bowling motion, a tennis swing, a badminton swing, and casting of a fishing rod.

22. A system for analyzing sports motions, comprising:

a mobile device including memory, a processor, an integrated multi-axis gyroscope, and a cloud-based engine which connects the mobile device and a web-enabled display with the Internet and manages game playing, and an analysis engine that includes an application program loaded in the memory of the mobile device, the mobile device configured to;

(a) determine a starting point of a simulated sports motion, wherein the starting point is indicated solely by a user holding the mobile device still for a predetermined length of time;

(b) obtain gyroscope measurements from the gyroscope relating to orientation of the mobile device at the starting point and during movement along a path simulating the sports motion;

(c) determine an impact point with a virtual object and velocity of the mobile device around the impact point using the obtained gyroscope measurements; and

(d) output information related to the simulated sports motion based at least in part on the impact point and the velocity.

23. The system of claim 22, wherein the mobile device is attached to an ancillary device.

24. The system of claim 23, wherein the ancillary device is a piece of sports equipment and a device simulating the grip and feel of the piece of sports equipment.

25. A system for analyzing sports motions, comprising:

a mobile device including memory, a processor, integrated motion sensors, a cloud-based engine which connects the mobile device and a web-enabled display with the Internet and manages game playing, and an analysis engine that includes an application program loaded in the memory of the mobile device, the mobile device configured to;

(a) determine a starting point of a simulated sports motion, the starting point is indicated solely by a user holding the mobile device still for a predetermined length of time;

(b) obtain motion data from the motion sensors relating to orientation of the mobile device at the starting point and during movement along a path simulating the sports motion;

(c) determine an impact point with a virtual object using the obtained motion data related to the orientation of the mobile device along at least two different axes; and

(d) output information related to the simulated sports motion based at least in part on the impact point via the mobile device.

26. The system of claim 25, wherein the mobile device is attached to an ancillary device.

27. The system of claim 25, wherein the ancillary device is one of a piece of sports equipment and a device simulating the grip and feel of the piece of sports equipment.