Aiming feedback system with inertial sensors

• US 10,265,602 B2
• Filed: 03/03/2016
• Issued: 04/23/2019
• Est. Priority Date: 03/03/2016
• Status: Active Grant

• Current Assignee: Newlight Capital, LLC
• Original Assignee: Blast Motion Incorporated
• Inventors: Haas, Juergen, Bose, Bhaskar, Bentley, Michael, Gupta, Piyush, Alam, Sheehan, Gullotti, Ryan
• Primary Examiner(s): Duffy, David
• Application Number:
  US15/060,217
• Publication Number:
  US 20170252607A1
• Time in Patent Office: 1,146 Days
• CPC Class Codes: A61B 2503/10 Athletes
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/681 Wristwatch-type devices
• CPC Class Codes: A61B 5/6895 Sport equipment
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61B 5/7455 characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 2071/0655 Tactile feedback
• CPC Class Codes: A63B 2220/12 Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/40 Acceleration
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: A63B 69/38 for tennis A63B61/006, A63B69/0073 and A63B69/0097 take precedence
• CPC Class Codes: A63B 71/0619 Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop

Abstract

An aiming system that provides feedback on how closely the aim of an object is aligned with a direction to a target. An inertial sensor on the object provides data on the object'"'"'s position and orientation; this data is combined with target direction information to determine how to correct the aim. An illustrative application is a golf club aiming system that measures whether the clubface normal is aligned horizontally with the direction to the hole. The system sends feedback signals to the user to help the user adjust the aim. These signals may include for example audible tones or haptic vibrations that vary in frequency and amplitude to instruct the user to adjust the aim. For example, haptic signals may be sent to a smart watch worn by the user; the user may therefore obtain aiming feedback without having to look at a screen.

Claims

1. An aiming feedback system with inertial sensors, comprising:

an inertial sensor configured to be attached to a location on or embedded within an object that is aimed at a target,

wherein said object comprises a forward direction vector that defines a current aim direction in which said object is currently aimed, wherein said forward direction vector depends on a geometry of said object;

wherein said object is a piece of sporting equipment with a shaft; and

,

wherein said object further comprises a targeting axis parallel to said shaft,

wherein said targeting axis is used to orient said object at said target;

a feedback element configured to

receive an aim alignment signal; and

,

provide a feedback signal based on said aim alignment signal to a user who uses said object while said object is aimed at said target and while said targeting axis is pointed at said target,

such that when said user changes said current aim of said object, said feedback element changes said feedback signal as said user changes said current aim of the object to reflect an updated aim; and

,

a processor configured to

receive an initial inertial sensor data from said inertial sensor, wherein said initial inertial sensor data is captured when said object is oriented such that said targeting axis is oriented at said target;

calculate a target direction vector from said initial inertial sensor data when said targeting axis is oriented at said target, wherein said target direction vector indicates a desired aim direction to said target;

receive additional inertial sensor data from said inertial sensor when said object is placed in its normal use orientation and aimed by said user;

calculate said forward direction vector that defines said current aim direction from said additional inertial sensor data, wherein said current aim direction indicates an actual aim direction in which said object is currently aimed to said target;

calculate a rotation between said forward direction vector of said object and said target direction vector based on said additional inertial sensor data;

calculate said aim alignment signal based on said rotation, wherein said aim alignment signal comprises information on how to align said forward direction vector with said target direction vector; and

,

send said aim alignment signal to said feedback element to assist said user in modifying or correcting said current aim direction of said object to said target while said object is aimed at said target.

2. The system of claim 1, wherein

said piece of sporting equipment is a golf club;

said forward direction vector is a normal vector to a clubface of said golf club; and

,

said target direction vector points towards a golf hole.

3. The system of claim 1, wherein

said feedback element is a display;

and,

said feedback signal is one or more of text and graphics shown on said display.

4. The system of claim 1, wherein

said feedback signal is an audio signal.

5. The system of claim 4, wherein

said audio signal is a spoken message.

6. The system of claim 5, wherein

said spoken message tells said user one or both of

a direction in which to rotate said object to align said forward direction vector and said target direction vector;

and,

an angular magnitude by which to rotate said object to align said forward direction vector and said target direction vector.

7. The system of claim 1, wherein

said feedback signal is a haptic feedback signal.

8. The system of claim 7, wherein

said feedback element is a watch or a wrist band.

9. The system of claim 1, wherein

said feedback signal comprises a magnitude attribute that increases monotonically or decreases monotonically as a function of an angular magnitude of said rotation between said desired aim direction to said target and said current aim direction.

10. The system of claim 9, wherein said magnitude attribute is one or both of

an amplitude of said feedback signal;

and,

a frequency of said feedback signal.

11. The system of claim 1, wherein

said feedback signal comprises a direction attribute that indicates a direction of an axis of said rotation to bring said forward direction vector into alignment with said target direction vector.

12. The system of claim 11, wherein said direction attribute is one or both of

an amplitude of said feedback signal;

and,

a frequency of said feedback signal.

13. The system of claim 1, wherein said processor further

projects said target direction vector onto a horizontal plane, yielding a horizontal target direction vector, before said rotation is calculated;

projects said forward direction vector onto said horizontal plane, yielding a horizontal forward direction vector, before said rotation is calculated; and

,

calculates said rotation between said horizontal forward direction vector and said horizontal target direction vector.

14. The system of claim 1, further comprising

a laser coupled to said object and configured to project a beam of light in a direction of said targeting axis.

15. The system of claim 1, wherein

said piece of sporting equipment is a golf club;

said forward direction vector is a normal vector to a clubface of said golf club; and

,

said targeting axis is an axis along said shaft of said golf club.

16. The system of claim 15, wherein said processor is further configured to

calculate a slope of a ground from said initial inertial sensor data when said shaft of said golf club is placed on said ground;

and,

transmit said slope to said feedback element.

17. The system of claim 1, wherein said calculate said target direction vector from said initial inertial sensor data further comprises tracking and integrating said initial inertial sensor data as said piece of sporting equipment is rotated.

18. The system of claim 1, wherein said processor is further configured to perform a transformation between a reference frame of said inertial sensor and a reference frame associated with said forward direction vector.

19. The system of claim 1, wherein said object being aimed serves as a sensor to acquire said target direction vector.