Generating custom audio content for an exercise session

• US 9,613,659 B2
• Filed: 03/10/2014
• Issued: 04/04/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Fitbit, Inc. (Alphabet Inc.)
• Original Assignee: Fitbit, Inc. (Alphabet Inc.)
• Inventors: Maser, Mike, Grijalva, Dave
• Primary Examiner(s): AL HASHEMI, SANA A
• Application Number:
  US14/203,406
• Publication Number:
  US 20140280156A1
• Time in Patent Office: 1,121 Days
• Field of Search: 707607, 707609, 707790, 707813, 707821, 707899, 707953
• CPC Class Codes: A63B 2024/0081 Coaching or training aspects related to a group of users
• CPC Class Codes: A63B 24/0075 Means for generating exercise programs or schemes, e.g. computerized virtual trainer, e.g. using expert databases
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence

Abstract

System, apparatuses, and methods can provide customized exercise sessions and customized videos corresponding to the exercise session. Audio clips can be dynamically selected to make custom audio content for an exercise session. The audio clips and metadata can be obtained, where the audio clips correspond to categories. The exercise session can include one or more components. A destination timeline for a component can include one or more first segments that require audio, and one or more second segments that can optionally have audio. Audio clips can be selected for the various segments, where a segment can be designated for a particular category of audio clips. Identification information for the selected audio clips can be saved and used to generate the custom audio content.

Claims

1. A method of generating custom audio content of an exercise session for a user, the method comprising:

receiving data of a plurality of audio clips corresponding to a plurality of audio categories;

receiving, at a computer system, metadata corresponding to the plurality of audio clips, the metadata identifying an audio category for each audio clip;

identifying a component of the exercise session, the component corresponding to a physical exercise;

creating, by a computer system, a destination timeline of audio for the component;

identifying a first segment of the destination timeline that uses audio, the first segment corresponding to an audio category;

selecting, for the first segment, a first audio clip based on metadata of the first audio clip indicating that the first audio clip has an audio category that matches the corresponding audio category;

generating, by the computer system, the exercise session comprising the first audio clip;

playing back the exercise session comprising the first audio clip to the user;

receiving sensor data of the user from a wearable sensor device, wherein;

the wearable sensor device comprises one or more sensors, and

the sensor data of the user are generated by the one or more sensors when the user is wearing the wearable sensor device;

identifying a second segment of the destination timeline that optionally uses audio;

selecting a second audio clip for the second segment based at least in part on the sensor data of the user or data derived therefrom, wherein the sensor data of the user or data derived therefrom are indicative of the user'"'"'s physical or physiological condition in the exercise session; and

inserting the second audio clip into the exercise session at the second segment of the destination timeline to generate the custom audio content.

3. The method of claim 1, wherein the sensor data indicate that the user fails at a particular point while performing a particular component, wherein a second audio clip corresponding to an encouragement is selected to be played at the particular point.

4. The method of claim 1, wherein selecting the second audio clip for the second segment includes:

assigning a score to the audio clip; and

determining whether the score, alone or in combination with one or more scores of one or more other audio clips, satisfies one or more criteria.

5. The method of claim 1, wherein selecting the first audio clip from the corresponding audio category for the first segment includes:

assigning scores to a plurality of audio clips of the corresponding category; and

determining that the first audio clip is an audio clip in the plurality of audio clips that has a first score that satisfies one or more criteria.

6. The method of claim 1, further comprising:

providing identification information of the selected audio clips in the identified first and second segments of the destination timeline to an audio generation engine for combining the selected audio clips to obtain the custom audio content.

7. The method of claim 1, further comprising:

receiving a selection of an audio template, the audio template specifying a duration for each segment of a plurality of segments of the destination timeline for a particular component.

8. The method of claim 1, wherein the metadata for an audio clip identifies a last time that the audio clip was played in an exercise session for a user.

9. The method of claim 1, further comprising:

processing the data of the plurality of audio clips to obtain the metadata.

15. The method of claim 6, further comprising:

generating, by the audio generation engine, the custom audio content using the identification information.

16. The method of claim 7, wherein the audio template specifies which one or more segments are first segment(s) and which one or more segments are second segment(s).

2. A computer product comprising a non-transitory computer readable medium storing a plurality of instructions that when executed control a computer system to generate custom audio content of an exercise session for a user, the instructions comprising:

receiving data of a plurality of audio clips corresponding to a plurality of audio categories;

receiving metadata corresponding to the plurality of audio clips, the metadata identifying an audio category for each audio clip;

identifying a component for the exercise session, the component corresponding to a physical exercise;

creating a destination timeline of audio for the component;

identifying a first segment of the destination timeline that uses audio, the first segment corresponding to an audio category;

selecting, for the first segment, a first audio clip based on metadata of the first audio clip indicating that the first audio clip has an audio category that matches the corresponding audio category;

generating, by the computer system, the exercise session comprising the first audio clip;

playing back the exercise session comprising the first audio clip to the user;

receiving sensor data of the user from a wearable sensor device, wherein;

the wearable sensor device comprises one or more sensors, and

the sensor data of the user are generated by the one or more sensors when the user is wearing the wearable sensor device;

identifying a second segment of the destination timeline that optionally uses audio;

selecting a second audio clip for the second segment based at least in part on the sensor data of the user or data derived therefrom, wherein the sensor data of the user or data derived therefrom are indicative of the user'"'"'s physical or physiological condition in the exercise session; and

inserting the second audio clip into the exercise session at the second segment of the destination timeline to generate the custom audio content.

10. The computer product of claim 2, wherein the sensor data indicate that the user fails at a particular point while performing a particular component, wherein a second audio clip corresponding to an encouragement is selected to be played at the particular point.

11. The computer product of claim 2, wherein selecting a set of the one or more second audio clips for the one or more second segments includes:

assigning a score to the audio clip; and

determining whether the score, alone or in combination with one or more scores of one or more other audio clips, satisfies one or more criteria.

12. The computer product of claim 2, wherein selecting the first audio clip from the corresponding audio category for the first segment includes:

assigning scores to a plurality of audio clips of the corresponding category; and

determining that the first audio clip is an audio clip in the plurality of audio clips that has a first score that satisfies one or more criteria.

13. The computer product of claim 2, wherein the instructions further comprise:

receiving a selection of an audio template, the audio template specifying a duration for each segment of a plurality of segments of the destination timeline for a particular component.

14. The computer product of claim 2, wherein the metadata for an audio clip identifies a last time that the audio clip was played in an exercise session for a user.