User interface and fitness meters for remote joint workout session

• US 9,811,639 B2
• Filed: 10/30/2012
• Issued: 11/07/2017
• Est. Priority Date: 11/07/2011
• Status: Active Grant

• Current Assignee: Nike, Inc.
• Original Assignee: Nike, Inc.
• Inventors: Aragones, Teresa, Gordon, John M., Guerrero, Adriana, Self, Christina S., Winsper, Paul T., Homsi, Kristopher L.
• Primary Examiner(s): Gishnock, Nikolai A
• Application Number:
  US13/664,261
• Publication Number:
  US 20130115584A1
• Time in Patent Office: 1,834 Days
• Field of Search: 482 8, 482 9, 434247, 434257, 434258
• CPC Class Codes: A63B 21/0053 using alternators or dynamos
• CPC Class Codes: A63B 21/0058 using motors
• CPC Class Codes: A63B 21/153 wound-up and unwound during exercise, e.g. from a reel
• CPC Class Codes: A63B 22/0023 the inclination of the main axis of the movement path being adjustable, e.g. the inclination of an endless band
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 24/00 Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 5/16 Training devices for jumping; Devices for balloon-jumping; Jumping aids A63B25/02, A63B25/10 take precedence
• CPC Class Codes: A63B 69/00 Training appliances or apparatus for special sports training of parachutists B64D23/00
• CPC Class Codes: A63B 69/36 for golf
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G09B 19/0076 Body hygiene; Dressing; Knot tying
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Example embodiments relate to a system, method, apparatus, and computer readable media configured to generate a multiple renditions of a user interface that is updated based upon athletic movements of two or more users remotely located from each other. The UI may be configured to simultaneously display energy expenditure values in real-time. In further embodiments, a joint energy expenditure values determined from multiple remote users may be simultaneously displayed.

Claims

1. A computer-implemented method comprising:

generating a first rendition of a user interface configured to be displayed at a first display device at a first location comprising a first virtual trainer configured to instruct a first user at the first location to perform a predetermined athletic movement during a defined first time period, wherein the first virtual trainer is configured to perform the predetermined athletic movement at a predetermined tempo during the defined first time period;

generating a second rendition of the user interface configured to be displayed at a second display device at a second location comprising a second virtual trainer configured to instruct a second user to simultaneously perform the predetermined athletic movement during the defined first time period, wherein the second virtual trainer is configured to simultaneously perform the predetermined athletic movement at the predetermined tempo during the defined first time period;

receiving movement data from at least one sensor at the first location and at least one sensor at the second location during the first and second users'"'"' performance of the predetermined athletic movement;

based on the movement data during the defined first time period, calculating real-time energy expenditure values for the first user and the second user for each of a plurality of sequential time frames within the defined first time period;

in real-time, displaying the real-time energy expenditure values for the first user and the second user simultaneously on both the first and second renditions of the user interface;

in real-time, calculating with a processor, a joint energy expenditure value derived from the real-time energy expenditure values from both users throughout each of the plurality of sequential time frames within the defined first time period;

determining a form of a selected user, from the first and second users, during the predetermined athletic movement based on a detected location of a first body part relative to a second body part of the selected user;

generating and displaying in real-time a strength meter indicating a quantitative comparison of the form of the selected user to an ideal form for the predetermined athletic movement;

based on the quantitative comparison of the form of the selected user to the ideal form, determining an adjusted energy expenditure value for the selected user; and

in real-time, displaying the joint energy expenditure values for the first user and the second user simultaneously with the displayed adjusted energy expenditure values for the selected user on both the first and second renditions of the user interface.

2. The computer-implemented method of claim 1, wherein the predetermined athletic movement is associated with an estimated energy expenditure value, the method further comprising:

wherein the calculating of the real-time energy expenditure values for the first user and the second user for each of a plurality of sequential time frames within the defined first time period comprises;

determining an angle score based on comparing an angle between two body parts of the selected user during performance of the predetermined athletic movement and a desired angle between the two body parts during the predetermined athletic movement.

3. The computer-implemented method of claim 1, further comprising:

during the defined first time period, determining which of the first or the second user has a higher energy expenditure value, and

in response, altering the first and second renditions of the user interface in real-time to indicate which of the first user or the second user has the higher energy expenditure value.

4. The computer-implemented method of claim 1, further comprising:

displaying on the first and the second renditions of the user interface during the defined first time period, real-time image data of both the first user and the second user each performing the predetermined athletic movement.

5. The computer-implemented method of claim of claim 4, further comprising:

for both the first user and the second user, determining, based on the at least one sensor located at the first and the second locations, real-time form of the respective user during the plurality of sequential time frames of the first defined time frame; and

displaying a real-time graphical representation of the first user'"'"'s form during the plurality of sequential time frames on the first rendition of the user interface and displaying a real-time graphical representation of the second user'"'"'s form on the second rendition of the user interface,

wherein during the defined first time frame, the first rendition of the user interface is configured to simultaneously;

display the first virtual trainer instructing the first user to perform the predetermined athletic movement and perform the predetermined athletic movement;

display the real-time graphical representation of the first user performing the predetermined athletic movement based upon the at least one sensor at the first location;

display the energy expenditure value calculated from the first user'"'"'s movements during the defined first time frame;

display the energy expenditure value calculated from the second user'"'"'s movements during the defined first time frame; and

display the joint energy expenditure value.

6. The computer-implemented method of claim 5, wherein the second rendition of the user interface is configured to displaying the real-time graphical representation of the second user'"'"'s form during the plurality of sequential time frames without displaying any graphical representation of the first user'"'"'s form during the sequential time frames.

7. The computer-implemented method of claim 1, further comprising:

based upon the determined athletic movement performed by the first virtual trainer, selecting a strength meter or a cardio meter to be displayed on the first and the second renditions of the user interface;

on each rendition of the user interface, displaying a first selected meter to represent the first user'"'"'s performance of the predetermined athletic movement and a second selected meter to represent the second user'"'"'s performance of the predetermined athletic movement; and

in real-time, altering properties of the first selected meter based upon data received from the at least one sensor located at the first location and simultaneously altering properties of the second selected meter based upon data received from the at least one sensor at the second location.

8. The computer-implemented method of claim 1, further comprising:

based upon the determined athletic movement performed by the virtual trainer, selecting an attribute meter to be displayed on the first and the second renditions of the user interface simultaneously with the real-time energy expenditure values, wherein the attribute meter is configured to display attribute values regarding a first attribute;

on each rendition of the user interface, displaying a first attribute meter rendition to represent the first user'"'"'s performance of the predetermined athletic movement with respect to the first attribute and a second attribute meter rendition to represent the second user'"'"'s performance of the predetermined athletic movement with respect to the first attribute; and

in real-time, altering properties of the first attribute meter on both renditions based upon data received from the at least one sensor located at the first location and simultaneously altering properties of the second attribute meter on both renditions based upon data received from the at least one sensor at the second location; and

in real-time, displaying the attribute values for the first user and the second user simultaneously on both the first and second renditions of the user interface.

9. The computer-implemented method of claim 8, wherein the first attribute is selected from at least one of:

a strength attribute, a cardiovascular attribute, a fitness attribute, an athleticism attribute, a speed attribute, and tempo attribute.

10. The computer-implemented method of claim 1, wherein the at least one sensor comprises an image-capturing device.

11. The computer-implemented method of claim 1, wherein the at least one sensor comprises at least one accelerometer, gyroscope, or location-determining device.

12. A non-transitory computer-readable medium comprising computer-executable instructions, that when executed by a processor, are configured to perform a method of:

generating a first rendition of a user interface configured to be displayed at a first display device at a first location comprising a first virtual trainer configured to instruct a first user at the first location to perform a predetermined athletic movement during a defined first time period, wherein the first virtual trainer is configured to perform the predetermined athletic movement at a predetermined tempo during the defined first time period;

generating a second rendition of the user interface configured to be displayed at a second display device at a second location comprising a second virtual trainer configured to instruct a second user to simultaneously perform the predetermined athletic movement during the defined first time period, wherein the second virtual trainer is configured to simultaneously perform the predetermined athletic movement at the predetermined tempo during the defined first time period;

receiving movement data from at least one sensor at the first location and at least one sensor at the second location during the first and second users'"'"' performance of the predetermined athletic movement;

based on the movement data during the defined first time period, calculating real-time energy expenditure values for the first user and the second user for each of a plurality of sequential time frames within the defined first time period;

in real-time, displaying the real-time energy expenditure values for the first user and the second user simultaneously on both the first and second renditions of the user interface;

in real-time, calculating with a processor, a joint energy expenditure value derived from the real-time energy expenditure values from both users throughout each of the plurality of sequential time frames within the defined first time period;

determining a form of a selected user, from the first and second users, during the predetermined athletic movement based on a detected location of a first body part relative to a second body part of the selected user;

generating and displaying in real-time a strength meter indicating a quantitative comparison of the form of the selected user to an ideal form for the predetermined athletic movement;

based on the quantitative comparison, determining, in real-time, an adjusted energy expenditure value for the selected user; and

in real-time, displaying the joint energy expenditure values for the first user and the second user simultaneously with the displayed adjusted energy expenditure values for the selected user on both the first and second renditions of the user interface.

13. The non-transitory computer-readable medium of claim 12, further comprising computer-executable instructions that when executed by a processor perform at least:

wherein the calculating of the real-time energy expenditure values for the first user and the second user for each of a plurality of sequential time frames within the defined first time period comprises;

determining an angle score based on comparing an angle between two body parts of the selected user during performance of the predetermined athletic movement and a desired angle between the two body parts during the predetermined athletic movement.

14. The non-transitory computer-readable medium of claim 12, further comprising computer-executable instructions that when executed by a processor perform at least:

during the defined first time period, determining which of the first or the second user has a higher energy expenditure value, and

in response, altering the first and second renditions of the user interface in real-time to indicate which of the first user or the second user has the higher energy expenditure value.

15. The non-transitory computer-readable medium of claim 12, further comprising computer-executable instructions that when executed by a processor perform at least:

displaying on the first and the second renditions of the user interface during the defined first time period, real-time image data of both the first user and the second user each performing the predetermined athletic movement.

16. The non-transitory computer-readable medium of claim 15, further comprising computer-executable instructions that when executed by a processor perform at least:

for both the first user and the second user, determining, based on the at least one sensor located at the first and the second locations, real-time form of the respective user during the plurality of sequential time frames of the first defined time frame; and

displaying a real-time graphical representation of the first user'"'"'s form during the plurality of sequential time frames on the first rendition of the user interface and displaying a real-time graphical representation of the second user'"'"'s form on the second rendition of the user interface,

wherein during the defined first time frame, the first rendition of the user interface is configured to simultaneously;

display the virtual first trainer instructing the first user to perform the predetermined athletic movement and perform the predetermined athletic movement;

display the real-time graphical representation of the first user performing the predetermined athletic movement based upon the at least one sensor at the first location;

display the energy expenditure value calculated from the first user'"'"'s movements during the defined first time frame;

display the energy expenditure value calculated from the second user'"'"'s movements during the defined first time frame; and

display the joint energy expenditure value.

17. The non-transitory computer-readable medium of claim 16, wherein the second rendition of the user interface is configured to displaying the real-time graphical representation of the second user'"'"'s form during the plurality of sequential time frames without displaying any graphical representation of the first user'"'"'s form during the sequential time frames.

18. The non-transitory computer-readable medium of claim 12, further comprising computer-executable instructions that when executed by a processor perform at least:

based upon the determined athletic movement performed by the first virtual trainer, selecting a strength meter or a cardio meter to be displayed on the first and the second renditions of the user interface;

on each rendition of the user interface, displaying a first selected meter to represent the first user'"'"'s performance of the predetermined athletic movement and a second selected meter to represent the second user'"'"'s performance of the predetermined athletic movement; and

in real-time, altering properties of the first selected meter based upon data received from the at least one sensor located at the first location and simultaneously altering properties of the second selected meter based upon data received from the at least one sensor at the second location.

19. The non-transitory computer-readable medium of claim 13, further comprising computer-executable instructions that when executed by a processor perform at least:

based upon the determined athletic movement performed by the first virtual trainer, selecting an attribute meter to be displayed on the first and the second renditions of the user interface simultaneously with the real-time energy expenditure values, wherein the attribute meter is configured to display attribute values regarding a first attribute;

on each rendition of the user interface, displaying a first attribute meter rendition to represent the first user'"'"'s performance of the predetermined athletic movement with respect to the first attribute and a second attribute meter rendition to represent the second user'"'"'s performance of the predetermined athletic movement with respect to the first attribute; and

in real-time, altering properties of the first attribute meter on both renditions based upon data received from the at least one sensor located at the first location and simultaneously altering properties of the second attribute meter on both renditions based upon data received from the at least one sensor at the second location; and

in real-time, displaying the attribute values for the first user and the second user simultaneously on both the first and second renditions of the user interface.

20. The non-transitory computer-readable medium of claim 19, wherein the first attribute is selected from at least one of:

a strength attribute, a cardiovascular attribute, a fitness attribute, an athleticism attribute, a speed attribute, and tempo attribute.

21. The non-transitory computer-readable medium of claim 12, wherein the at least one sensor comprises an image-capturing device.

22. The non-transitory computer-readable medium of claim 12, wherein the at least one sensor comprises at least one accelerometer, gyroscope, or location-determining device.