WEARABLE AUGMENTED REALITY DEVICE FOR GOLF PLAY

• US 20180071578A1
• Filed: 02/02/2017
• Published: 03/15/2018
• Est. Priority Date: 09/10/2016
• Status: Abandoned Application

• Current Assignee: Jetstron Technologies Co., Ltd.
• Original Assignee: Jetstron Technologies Co., Ltd.
• Inventors: CHU, Chien-Hao
• Application Number:
  US15/422,836
• Publication Number:
  US 20180071578A1
• Time in Patent Office: Days
• CPC Class Codes: A63B 2024/0034 during flight
• CPC Class Codes: A63B 2071/0647 Visualisation of executed movements
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 24/0021 Tracking a path or terminating locations
• CPC Class Codes: A63B 71/0619 Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/42 of sport video content
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04W 4/025 using location based information parameters
• CPC Class Codes: H04W 76/10 Connection setup
• CPC Class Codes: H04W 80/04 Network layer protocols, e.g. mobile IP [Internet Protocol]

Abstract

A wearable augmented reality device for golf play assists a golfer who plays golf with a ball and a club, and includes a camera, a memory, a processor and a display. The camera captures an image of the ball and the club so as to obtain a captured image. The memory stores an image recognition module and an image calculation module. The processor executes the image recognition module so as to recognize the ball and the club in the captured image, to execute the image calculation module so as to determine whether the ball is hit by the club according to a positional relationship between the ball and the club in the captured image, and to calculate flight information of the ball to be displayed by the display when it is determined that the ball is hit by the club.

Claims

1. A wearable augmented reality device for golf play, said wearable augmented reality device assisting a golfer who plays golf with a ball and a club, and comprising:

a camera configured to capture an image of the ball and the club which is swung by the golfer for hitting the ball so as to obtain a captured image;

a memory configured to store an image recognition module and an image calculation module;

a processor configured to execute said image recognition module so as to recognize the ball and the club in the captured image, to execute said image calculation module so as to determine whether the ball is hit by the club according to a positional relationship between the ball and the club in the captured image, to calculate flight information of the ball when it is determined that the ball is hit by the club, and to output the flight information; and

a display configured to receive the flight information from said processor and to di splay the flight information.

2. The wearable augmented reality device as claimed in claim 1, the golfer playing at a golf course, said wearable augmented reality device further comprising:

a positioning unit configured to determine geographic position information associated with a position of said wearable augmented reality device; and

a direction finder configured to determine geographic direction information associated with a direction of said wearable augmented reality device;

wherein said memory is further configured to store map information that is associated with the golf course; and

wherein said processor is further configured to output, according to the geographic position information, the geographic direction information and the map information, a message which indicates orientation of said wearable augmented reality device with respect to the golf course and which is to be displayed on said display.

3. The wearable augmented reality device as claimed in claim 2, wherein said processor is further configured to generate, according to the geographic position information, the geographic direction information and the map information, green information associated with a green in the golf course, obstacle information associated with an obstacle in the golf course, and a club recommendation of club specifications of a club suitable for a current shot, and to output the green information, the obstacle information and the club recommendation to said display to be displayed thereon.

4. The wearable augmented reality device as claimed in claim 3, wherein:

said memory is further configured to store a club-carry database containing at least one correlation between a set of club specifications and a carry;

said processor is further configured to generate the club recommendation according to the club-carry database, the geographic position information, the geographic direction information and the map information.

5. The wearable augmented reality device as claimed in claim 1, wherein said camera is a high-speed camera.

6. The wearable augmented reality device as claimed in claim 1, wherein said display is a transparent display.

7. The wearable augmented reality device as claimed in claim 1, wherein said display is a projection display including a micro projector and a prism.

8. The wearable augmented reality device as claimed in claim 1, wherein when it is determined by said processor that the ball is hit by the club, said processor increases a stroke number by one and outputs the stroke number to said display for displaying the same.

9. The wearable augmented reality device as claimed in claim 1, wherein said processor is further configured to calculate impact information that includes a face angle when the ball is hit by the club, a club path and an attack angle, and to output the impact information to said display for displaying the same.

10. The wearable augmented reality device as claimed in claim 1, wherein the flight information includes at least one of a carry, a maximum height, a club speed, a ball speed, or a backspin rate.

11. The wearable augmented reality device as claimed in claim 1, wherein said processor is further configured to calculate a predicted position where the ball lands, and to output the predicted position to said display for displaying the same.

12. The wearable augmented reality device as claimed in claim 1, the golfer playing at a golf course which includes a green, further comprising:

a laser scanner configured to output a scanning result by scanning a grain of the green and a height variation of the green;

wherein said processor is further configured to execute said image recognition module so as to generate a green recognition result associated with the grain and the height variation of the green according to the scanning result, and to execute said image calculation module so as to calculate, according to the green recognition result, a putting suggestion which is associated with a putting direction and a putting force of a putting stroke to be taken on the green, said processor outputting the putting suggestion to said display to be displayed thereon.

13. The wearable augmented reality device as claimed in claim 1, wherein:

said memory is further configured to store an identification-specification database containing at least one correlation between an identification of the club, a template of the club and club specifications of the club; and

said processor is further configured to execute said image recognition module so as to recognize one of the identification and an image feature of the club in the captured image, and to execute said image calculation module so as to determine, by comparing said one of the identification and the image feature thus recognized with the identification or the template in the identification-specification database, the club specifications which is to be outputted to said display thereby for display on said display.

14. The wearable augmented reality device as claimed in claim 1, further comprising:

a touch module;

wherein said memory is further configured to store a user interface operable via said touch module by virtue of touch control.

15. The wearable augmented reality device as claimed in claim 1, further comprising a microphone and a loudspeaker, said microphone and said loudspeaker enabling the golfer to interact with said wearable augmented reality device by virtue of voice control.

16. The wearable augmented reality device as claimed in claim 1, the golfer playing at a golf course, said wearable augmented reality device further comprising:

a wireless communication module configured to access the Internet;

wherein said memory is further configured to store map information that is associated with the golf course and that is updatable via the Internet through said wireless communication module.

17. The wearable augmented reality device as claimed in claim 1, communicable with a cloud server via a mobile communication network, said wearable augmented reality device further comprising:

a wireless communication module configured to establish a connection to the cloud server by accessing the Internet via the mobile communication network.

18. The wearable augmented reality device as claimed in claim 1, communicable with a cloud server via a mobile communication network, said wearable augmented reality device further comprising:

a wireless communication module configured to establish a connection to the cloud server via one of a computer, a mobile phone and a wireless access point.