Electronic tracking system with heads up display

• US 9,802,102 B2
• Filed: 02/20/2017
• Issued: 10/31/2017
• Est. Priority Date: 12/30/2011
• Status: Active Grant

• Current Assignee: Nike, Inc.
• Original Assignee: Nike, Inc.
• Inventors: Leech, Nicholas A.
• Primary Examiner(s): Elisca, Pierre E
• Application Number:
  US15/437,112
• Publication Number:
  US 20170157491A1
• Time in Patent Office: 253 Days
• Field of Search: 473152, 473407, 473353
• CPC Class Codes: A63B 2024/0025 Tracking the path or location of one or more users, e.g. players of a game
• CPC Class Codes: A63B 2024/0028 Tracking the path of an object, e.g. a ball inside a soccer pitch
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2024/0053 for locating an object, e.g. a lost ball
• CPC Class Codes: A63B 2024/0056 for statistical or strategic analysis
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: A63B 2071/0691 Maps, e.g. yardage maps or electronic maps
• CPC Class Codes: A63B 2220/12 Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/13 Relative positions
• CPC Class Codes: A63B 2220/20 Distances or displacements
• CPC Class Codes: A63B 2220/30 Speed
• CPC Class Codes: A63B 2220/35 Spin
• CPC Class Codes: A63B 2220/802 Ultra-sound sensors
• CPC Class Codes: A63B 2220/805 Optical or opto-electronic sensors
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/20 with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2225/54 Transponders, e.g. RFID
• CPC Class Codes: A63B 24/0021 : Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0062 : Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 37/0072 : with a specified number of layers
• CPC Class Codes: A63B 43/008 : with means for improving visibility, e.g. special markings or colours illuminating or reflecting means A63B43/06
• CPC Class Codes: A63B 43/06 : with illuminating devices ; with reflective surfaces
• CPC Class Codes: A63B 69/3605 : Golf club selection aids informing player of his average or expected shot distance for each club
• CPC Class Codes: A63B 69/3608 : Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: A63B 69/3658 : Means associated with the ball for indicating or measuring, e.g. speed, direction
• CPC Class Codes: A63B 71/0619 : Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G01S 13/66 : Radar-tracking systems; Analogous systems
• CPC Class Codes: G01S 13/867 : Combination of radar systems with cameras
• CPC Class Codes: G01S 15/66 : Sonar tracking systems
• CPC Class Codes: G01S 17/66 : Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 19/19 : Sporting applications
• CPC Class Codes: G02B 2027/0138 : comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 : comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 : characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 : Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 : slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 : with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 : Head mounted
• CPC Class Codes: G02B 27/0172 : characterised by optical features
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0304 : Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

An electronic tracking system is disclosed for assisting a user in determining distances to objects in a sporting environment. The system includes a user tracking system for determining the location of a user, a heads up display for displaying information to the user, and a processor operable to communicate with the user tracking system and heads up display. The heads up display is designed to be worn by the user, and to display images within the user'"'"'s field of view. The processor is programmed to determine a distance between the user'"'"'s determined location and an object, such as a ball, located within the sporting environment. This information is displayed via the heads up display as a numeric representation of the determined distance. If tracking a ball, the heads up display may display an object indication, such as an enhanced image or a comet tail, superimposed over or adjacent the ball.

Claims

1. An electronic tracking system for assisting a user with locating objects in a sporting environment, the electronic tracking system comprising:

a ball tracking component configured to track a ball in the sporting environment;

a heads up display configured to be worn by the user, the heads up display having a display screen with a transparent display area configured to display an image within a field of view of the user; and

a processor in communication with the ball tracking component and the heads up display, the processor being configured to;

determine a location of the ball within the sporting environment; and

direct the heads up display to display an object indication adjacent to or superimposed over the ball as the ball is visible through the transparent display area of the display screen within the field of view of the user.

2. The electronic tracking system of claim 1, further comprising a user tracking component in communication with the processor and configured to determine a location of the user, the processor being further configured to:

determine a distance between the determined location of the user and the determined location of the object within the sporting environment; and

direct the heads up display to display a numeric representation of the determined distance coincident with or adjacent to the ball as the ball is visible through the transparent display area of the heads up display.

3. The electronic tracking system of claim 1, wherein the ball tracking component includes a ball tracking sensor in communication with the processor, wherein the ball tracking sensor is configured to track the ball using radar, LIDAR, optical sensing, or sonar, or any combination thereof.

4. The electronic tracking system of claim 1, wherein the ball tracking component is further configured to monitor one or more launch characteristics or flight characteristics, or both, of the ball.

5. The electronic tracking system of claim 4, wherein the processor is further configured to direct the heads up display to display the one or more launch characteristics or flight characteristics, or both, of the ball via the display screen.

6. The electronic tracking system of claim 1, further comprising a landmark location component in communication with the processor and configured to determine a location of a landmark within the sporting environment, the processor being further configured to direct the heads up display to display a landmark indicator of the landmark superimposed over or adjacent to the landmark as the landmark is visible through the transparent display area of the heads up display.

7. The electronic tracking system of claim 6, wherein the landmark includes a tree, a natural hazard, a body of water, a sand trap on a golf course, a dogleg on the golf course, or a portion of a green on the golf course, or any combination thereof.

8. The electronic tracking system of claim 1, wherein the object indication includes a comet tail trailing behind the ball within the field of view of the user, or an enhanced image of the ball that is superimposed over the ball within the field of view of the user, or both.

9. The electronic tracking system of claim 1, further comprising a camera in communication with the processor and configured to capture an image of the field of view of the user, the processor being further configured to determine from the captured image where to display the object indication superimposed over the object upon the field of view.

10. The electronic tracking system of claim 1, further comprising a headgear component configured to be worn on the head of the user, the heads up display being attached to the headgear component and configured to be worn in front of the eyes of the user.

11. The electronic tracking system of claim 10, wherein the ball tracking component and the processor are mounted inside the headgear component.

12. The electronic tracking system of claim 1, wherein the ball tracking component includes one or more communication components and a microchip attached to the ball, and wherein the processor is configured to determine the location of the ball from signals emitted by the microchip and received via the one or more communication components.

13. The electronic tracking system of claim 1, wherein the ball includes a golf ball, a baseball, a tennis ball, a football, and/or a field hockey ball.

14. The electronic tracking system of claim 1, further comprising a user interface in communication with the processor, the user interface having one or more input devices configured to receive inputs from the user and transmit control signals indicative thereof to the processor.

15. An electronic tracking device for assisting a user with locating objects in a sporting environment, the electronic tracking device comprising:

a headgear component configured to be worn on the head of the user;

a user tracking component attached to the headgear component and configured to track a location of the user;

a ball tracking component attached to the headgear component and configured to track a location of a ball within the sporting environment;

a heads up display attached to the headgear component and configured to be worn in front of one or more eyes of the user, the heads up display having a display screen with a transparent display area configured to display images; and

a processor in communication with the user tracking component, the ball tracking component, and the heads up display, the processor being configured to;

determine a location of the user via the user tracking component;

determine a location of the ball within the sporting environment via the ball tracking component; and

direct the heads up display to display an object indication adjacent to or superimposed over the ball as the ball is visible through the transparent display area of the display screen within a field of view of the user.

16. A non-transitory, computer readable medium storing instructions for execution by a processor of an electronic tracking system, the electronic tracking system including a user tracking component, a camera, a sensor, and a heads up display, the instructions causing the electronic tracking system to perform steps comprising:

determining a location of a user via the user tracking component;

detecting a ball in a sporting environment via the sensor;

receiving an indication of a field of view of the user from the camera, the camera being disposed adjacent to the heads up display, and the heads up display having a display screen with a transparent display area configured to display an image within the field of view of the user; and

displaying an object indication coincident with or adjacent to the detected ball as the ball is visible through the transparent display area of the display screen of the heads up display.

17. The computer readable medium of claim 16, further comprising instructions for causing the electronic tracking system to perform steps comprising:

monitoring one or more launch characteristics or flight characteristics, or both, of the ball; and

directing the heads up display to display the one or more launch characteristics or flight characteristics, or both, of the ball via the display screen.

18. The computer readable medium of claim 16, wherein the object indication includes a comet tail trailing behind the ball within the field of view of the user, or an enhanced image of the ball that is superimposed over the ball within the field of view of the user, or both.

19. The computer readable medium of claim 16, wherein the ball includes a golf ball, a baseball, a tennis ball, a football, and/or a field hockey ball.

20. The computer readable medium of claim 16, further comprising instructions for causing the processor to receive, from one or more input devices of a user interface in communication with the processor, control signals indicative of inputs from the user.