Dynamic exercise content

• US 10,839,954 B2
• Filed: 06/20/2012
• Issued: 11/17/2020
• Est. Priority Date: 05/23/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Flavell, Andrew C., Kennett, Daniel G., McCarthy, David C.
• Primary Examiner(s): Hull, James B
• Application Number:
  US13/528,689
• Publication Number:
  US 20130316316A1
• Time in Patent Office: 3,072 Days
• Field of Search: 434247
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising

Abstract

Techniques for dynamic exercise content are described. In implementations, exercise content is provided that includes a variety of different selectable exercise segments that can be individually selected and played back to generate an exercise routine. For example, particular exercise segments can be selected based on user-specified exercise goals, the physical abilities of a particular user, based on various types of feedback, and so on. To assist in the selection of particular exercise segments, exercise segments can be individually tagged with descriptive information, such as using metadata tags. Embodiments can also provide a variety of different types of performance-related feedback to a user during an exercise routine.

Claims

1. A system comprising:

light sensors;

a Natural User Interface (NUI) configured to detect points on a human body via the light sensors;

one or more processors; and

one or more computer-readable storage media storing instructions that are executable by the one or more processors to perform operations including;

receiving parameters that are specific to a user;

acquiring historic data specific to the user;

selecting a set of segments from different individually selectable segments of pre-recorded content based on the received parameters and the acquired historic data specific to the user;

generating, based at least on the received parameters and the acquired historic data specific to the user, a custom content stream that includes the selected set of segments;

causing at least a portion of the custom content stream to be output to a display;

during a playback of the custom content stream, detecting one or more of a gesture, a pose, or a body movement of the user received via the light sensors;

upon detecting the one or more of the gesture, the pose, or the body movement of the user received via the light sensors, identifying particular points of the body; and

using the particular points of the body to compare parameters of the one or more of the gesture, the pose, or the body movement to known parameters for the one or more of the gesture, the pose, or the body movement to determine whether the one or more of the gesture, the pose, or the body movement is being performed properly based on instructions of the custom content stream output to the display;

modifying the custom content stream based on whether the one or more of the gesture, the pose, or the body movement is determined to be performed properly, wherein the modification of the custom content stream comprises one or more of the following;

applying new segments of content to the custom content stream, repeating content that has already been played in the custom content stream, changing a pace at which the custom content stream is provided, and rearranging content that has already been retrieved in the custom content stream;

receiving a visual representation of the user captured by the NUI such that movements of the user are reflected in similar movements of the visual representation of the user; and

causing an output of the visual representation with the modified custom content stream to the display.

2. A system as described in claim 1, wherein the parameters comprise at least one of physical attributes of the user or exercise-related abilities of the user.

3. A system as described in claim 1, wherein the light sensors are configured to sense vertical movement, horizontal movement, and forward and backward movement relative to the NUI.

4. A system as described in claim 3, wherein the light sensors capture information about image composition, movement, and/or position.

5. A system as described in claim 1, wherein the individually selectable segments are selected from at least one of selectable segments of one or more content streams, or one or more content clips.

6. A system as described in claim 1, wherein the operations further include:

receiving user-associated feedback during playback of the at least a portion of the custom content stream; and

modifying the custom content stream based on the user-associated feedback.

7. A system as described in claim 1, wherein the operations further include:

receiving user-associated feedback during playback of the at least a portion of the custom content stream; and

providing performance feedback based on the user-associated feedback.

8. A system as described in claim 7, wherein the performance feedback comprises one or more of a visual or an audible indication of user performance of an activity.

9. A system as described in claim 1, wherein the acquired historic data comprises one or more of the following:

a user profile, user preferences, and user content history.

10. A computer-implemented method comprising:

receiving input detected by a light sensor of a Natural User Interface (NUI) device during playback of content to detect points on a body of a user;

receiving parameters that are specific to the user;

acquiring historic data specific to the user;

generating a representation of the user based on the received input detected by the light sensor;

displaying the representation of the user on a display in real time such that movements of the user are reflected in similar movements of the representation of the user;

executing logic by a computing device to interpret the input detected by the light sensor as the user performs a portion of an exercise routine relating to a playback of an exercise routine content on the display;

responsive to interpreting the input detected by the light sensor as the user performing the portion of the exercise routine;

executing logic by the computing device to dynamically modify the playback of the exercise routine content comprising one or more segments based on a comparison of the user performance of the portion of the exercise routine to known parameters for the exercise routine content during playback of the exercise routine content and the acquired historic data specific to the user; and

causing dynamically modified playback of the exercise routine content to be displayed on the display with the representation of the user in real time, wherein the dynamically modified playback comprises one or more of the following;

applying new segments of content to the exercise routine content, repeating content that has already been played in the exercise routine content, changing a pace at which the exercise routine content is played back, and rearranging content that has already been retrieved in the exercise routine content.

11. A computer-implemented method as described in claim 10, wherein the dynamically modified playback comprises an indication of user performance of one or more activities as detected by the NUI device.

12. A computer-implemented method as described in claim 10, wherein the input comprises at least one of voice or gesture feedback detected by the NUI device from the user.

13. A computer-implemented method as described in claim 10, wherein said modifying occurs dynamically during playback of one or more portions of the exercise routine content.

14. A computer-implemented method as described in claim 10, wherein said modifying comprises selecting one or more subsequent portions of the exercise routine content based on the comparison of the user performance of the portion of the exercise routine to the known parameters for the exercise routine content.

15. A computer-implemented method as described in claim 10, wherein said modifying comprises replacing one or more portions of the exercise routine content with one or more different portions of content.

16. A computer-implemented method as described in claim 10, further comprising updating user profile data based on the comparison of the user performance of the portion of the exercise routine to the known parameters for the exercise routine content, wherein the user profile data is accessible to determine one or more subsequent selections of content.

17. A computer-implemented method, comprising:

displaying an exercise routine content stream on a display;

receiving, by a computing device, parameters that are detected by a light sensor of a Natural User Interface (NUI) device;

during a playback of the exercise routine content stream;

acquiring historic data specific to a user;

identifying particular points of a body of the user detected by the light sensor;

based on the identified particular points of the body of the user, identifying one or more of a gesture, a pose, or a body movement of the user detected by the light sensor;

executing logic by the computing device to dynamically select a set of segments from different individually selectable segments of pre-recorded content based at least on the received parameters and the acquired historic data specific to the user and the one or more of the gesture, the pose, or the body movement, at least some segments of the set of segments being selected from different content streams that include different respective segments of the individually selectable segments;

updating the exercise routine content stream to include the selected set of segments;

receiving a visual representation of the user captured by the NUI device such that movements of the user are reflected in similar movements of the visual representation of the user;

inserting the visual representation into the pre-recorded content; and

causing an output of the visual representation with the updated exercise routine content stream to the display.

18. A computer-implemented method as described in claim 17, wherein the parameters are captured by a second light sensor of the NUI device.

19. A computer-implemented method as described in claim 17, wherein the parameters comprise one or more of gender, age, height, and weight of the user detected by the NUI device.

20. A computer-implemented method as described in claim 17,

wherein the individually selectable segments are selected from at least one of selectable segments of one or more content streams or one or more content clips.