Systems, devices, and methods for virtual and augmented reality sports training

• US 10,118,080 B2
• Filed: 02/21/2017
• Issued: 11/06/2018
• Est. Priority Date: 02/21/2017
• Status: Active Grant

• Current Assignee: Robosport Technologies, LLC
• Original Assignee: Robosport Technologies, LLC
• Inventors: Loduca, Salvatore
• Primary Examiner(s): Laneau, Ronald
• Application Number:
  US15/437,913
• Publication Number:
  US 20180236335A1
• Time in Patent Office: 623 Days
• Field of Search: None
• CPC Class Codes: G09B 19/0038 Sports

Abstract

Disclosed are devices, systems, and methods for training a player to hit a ball at a target using a virtual or augmented reality display device, an exemplary method including detecting a position of a real ball, determining a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball, displaying, by the virtual or augmented reality display device, a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball, displaying, by the virtual or augmented reality display device, a target towards which the player should hit the real ball, determining whether the real ball is hit at the target, and providing an indication of whether the real ball is hit at the target.

Claims

1. A system for training a player to hit a real ball at a target using a virtual or augmented reality display device, the system comprising:

a virtual or augmented reality display device having a camera, a display, and a computing device disposed therein, the computing device having;

one or more processors, and

at least one memory coupled to the one or more processors, the at least one memory having instructions stored thereon which, when executed by the one or more processors, cause the computing device to;

receive sensor signals from the camera and, based on the sensor signals, detect a position of a real ball;

determine a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball;

transmit a signal that causes the display to display a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball;

transmit a signal that causes the display to display a target towards which the player should hit the real ball;

determine whether the real ball is hit at the target; and

transmit to a speaker a signal that causes the speaker to provide an indication of whether the real ball is hit at the target;

wherein the virtual or augmented reality display device is configured to communicate with a glove worn by a player, the glove including a sensor configured to;

detect vibrations caused by an impact between a bat and the real ball; and

transmit to the computing device a signal that causes the computing device to determine whether a level of the vibrations is within a predetermined range; and

wherein the virtual or augmented reality display device is configured to communicate with the speaker within audible range of the player and cause the speaker to emit an audible tone in response to receiving a signal from the sensor indicating that the level of the vibrations is within the predetermined range.

2. The system according to claim 1, wherein transmitting to the speaker the signal that causes the speaker to provide an indication includes causing the speaker to emit an audible tone when it is determined that the real ball is hit at the target.

3. The system according to claim 1, further comprising:

a robotic tee configured to support the real ball thereon.

4. The system according to claim 1, wherein the speaker is included in an earpiece worn by the player.

5. The system according to claim 1, wherein the speaker is included in the virtual or augmented reality display device.

6. The system according to claim 1, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to:

receive data from the sensor, the data including the detected level of vibrations;

analyze the data received from the sensor to determine analytics and statistics regarding the impact between the bat and the real ball; and

display the analytics and statistics on the display of the virtual or augmented reality display device.

7. The system according to claim 1, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to:

receive data from the sensor, the data including the detected level of vibrations;

analyze the data of the glove received from the sensor to determine one or more of;

a hitting pattern,

a swing path,

a swing style,

a swing speed,

a swing angle, and

a timing metric; and

generate guidance based on the determining.

8. The system according to claim 7, wherein the at least one memory stores further instructions that, when executed by the one or more processors, cause the computing device to display the guidance via the display.

9. A non-transitory computer-readable storage medium storing a program for using a virtual or augmented reality device having a camera, a display, and a computing device disposed therein for training a player to hit a real ball at a target, the program including instructions which, when executed by a processor, cause the computing device to:

receive sensor signals from the camera and, based on the sensor signals, detect a position of a real ball based on an image captured by the camera;

determine a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball;

transmit a signal that causes the display to display a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball;

transmit a signal that causes the display to display a target towards which the player should hit the real ball;

determine, based on an image captured by the camera coupled to the virtual or augmented reality display device, whether the real ball is hit at the target; and

transmit to a speaker a signal that causes the speaker to provide an indication of whether the real ball is hit at the target.

10. The non-transitory computer-readable storage medium according to claim 9, wherein the real ball is positioned on a robotic tee.

11. The non-transitory computer-readable storage medium according to claim 9, wherein transmitting to the speaker the signal that causes the speaker to provide an indication also causes the speaker to emit an audible tone when it is determined that the real ball is hit at the target.

12. The non-transitory computer-readable storage medium according to claim 9, wherein the instructions, when executed by the processor, further cause the computing device to:

receive data from the glove including a detected level of vibrations from a sensor;

analyze the data received from the sensor to determine analytics and statistics regarding an impact between a bat and the real ball; and

transmit to the display a signal that causes the display to display the analytics and statistics.

13. The non-transitory computer-readable storage medium according to claim 9, wherein the instructions, when executed by the processor, further cause the computing device to:

receive data from the sensor of the glove including a detected level of vibrations;

analyze the data received from the sensor of the glove to determine one or more of;

a hitting pattern,

a swing path,

a swing style,

a swing speed,

a swing angle, and

a timing metric; and

generate guidance based on the determining.

14. The non-transitory computer-readable storage medium according to claim 13, wherein the instructions, when executed by the processor, further cause the computing device to cause the virtual or augmented reality display device to display the guidance on the display.

15. A method of training a player to hit a real ball at a target using a virtual or augmented reality display device having a camera, a display, and a computing device disposed therein, the method comprising:

detecting, by the camera, a position of a real ball;

determining a trajectory for a virtual ball, the trajectory intersecting with the detected position of the real ball;

displaying, by the display, a virtual pitch of the virtual ball along the trajectory intersecting with the detected position of the real ball;

displaying, by the display, a target towards which the player should hit the real ball;

determining whether the real ball is hit at the target; and

transmitting a signal to a speaker to cause the speaker to provide an indication of whether the real ball is hit at the target.

16. The method according to claim 15, wherein providing the indication of whether the ball is hit at the target is displayed by the display.

17. The method according to claim 15, wherein providing the indication of whether the ball is hit at the target is provided as an audible tone emitted by a speaker.

18. The method according to claim 15, further comprising:

receiving data, the glove configured to be worn by a player, including a detected level of vibrations from a sensor;

analyzing the data received from the sensor of the glove to determine analytics and statistics regarding an impact between a bat and the real ball; and

displaying, by the display, the analytics and statistics.

19. The method according to claim 15, further comprising:

receiving data from the sensor of the glove including a detected level of vibrations;

analyzing the data received from the sensor of the glove to determine one or more of;

a hitting pattern,

a swing path,

a swing style,

a swing speed,

a swing angle, and

a timing metric; and

generating, guidance based on the determining.

20. The method according to claim 19, further comprising displaying the guidance on the display.