Systems and methods for providing audio and visual cues via a portable electronic device

• US 8,001,472 B2
• Filed: 03/27/2007
• Issued: 08/16/2011
• Est. Priority Date: 09/21/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Gilley, Glenn Gregory, Ubillos, Randall Hayes, Brody, Sarah A., Borchers, Robert Edward, Ginsburg, Donald, Pacurariu, Mihnea Calin, Dorogusker, Jesse Lee
• Primary Examiner(s): Do; Chat
• Assistant Examiner(s): NUNEZ, JORDANY
• Application Number:
  US11/729,133
• Publication Number:
  US 20080077620A1
• Time in Patent Office: 1,603 Days
• Field of Search: 715/716, 715/834, 482/8, 482/9, 725/87
• US Class Current: 715/716
• CPC Class Codes: A63B 2024/0068 Comparison to target or threshold, previous performance or not real time comparison to other individuals
• CPC Class Codes: A63B 2024/0093 the load of the exercise apparatus being controlled by performance parameters, e.g. distance or speed
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/755 used as a control parameter for the apparatus
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 24/0075 Means for generating exercise programs or schemes, e.g. computerized virtual trainer, e.g. using expert databases
• CPC Class Codes: A63B 24/0087 Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Methods and systems for providing a lifestyle companion system are provided. The lifestyle companion system can provide a platform to conduct a user interview. Based on the user interview responses, the system can suggest activities, references, and/or plug-in modules. During performance of activities, the system can provide audio and/or visual cues related to the activities and collect data indicative of the user'"'"'s performance. Based on the collected data, the system can dynamically adapt the user'"'"'s goals and/or activities the user is performing or will perform. In some embodiments of the present invention, the lifestyle companion system of the present invention can be applied to fitness, nutrition, and/or medical modules. The system also can be used to facilitate synchronous group activities.

Claims

1. A portable electronic device comprising:

a display;

memory for storing information about multiple activities;

a communication module for accepting sensor data indicative of a user'"'"'s performance metrics; and

a controller configured to provide a filmstrip of graphics and a visual representation of entertainment media simultaneously on the display, wherein the filmstrip of graphics is related to at least a current activity and a first future activity, wherein the entertainment media is associated with at least one of the current activity and the first future activity, wherein the controller is configured to generate the graphics based on the information stored in the memory and to update the filmstrip based on data informative of advancement from the current activity to the first future activity, and wherein the visual representation is an entertainment filmstrip comprising;

a graphic representation of a first entertainment media file associated with the current activity; and

a graphic representation of a second entertainment media file associated with the first future activity.

2. The portable electronic device of claim 1, wherein the controller is configured to provide an index of graphics and a progress indicator on the display, wherein:

the graphics of the index represent activities for which information is stored in the memory; and

the progress indicator visually distinguishes activities that the user already has performed from activities that the user has yet to perform.

3. The portable electronic device of claim 2, wherein the controller is configured to determine which activities the user has performed based on the sensor data.

4. The portable electronic device of claim 1, wherein the controller is configured to update the filmstrip based on sensor data indicative of the user'"'"'s completion of the current activity.

5. The portable electronic device of claim 1, wherein the controller is configured to update the filmstrip based on user input data.

6. The portable electronic device of claim 1, wherein the controller is configured to provide instructions related to the current activity on the display, wherein the instructions are a part of the information stored in the memory.

7. The portable electronic device of claim 6, wherein the controller is configured to update the instructions to relate to the first future activity based on data that indicates the user has completed performance of the current activity.

8. The portable electronic device of claim 1, wherein the controller is configured to update the filmstrip by adding a graphic related to a second future activity, wherein the graphic is generated based on the information stored in the memory.

9. The portable electronic device of claim 1, wherein the graphics comprises:

a graphic representation of the current activity; and

at least one of a graphic representation of the first future activity and a graphic representation of a first previous activity.

10. The portable electronic device of claim 1, wherein the controller is configured to update the filmstrip by at least one of:

adding a graphic representation of a second future activity to the filmstrip; and

removing a graphic representation of a previous activity from the filmstrip.

11. The portable electronic device of claim 1, wherein the entertainment media comprises at least the first entertainment media file that is associated with at least the current activity.

12. The portable electronic device of claim 11, wherein the first entertainment media file is stored in the memory.

13. The portable electronic device of claim 11, wherein the controller is configured to accept user input for associating the first entertainment media file with the current activity.

14. The portable electronic device of claim 11, wherein the first entertainment media file is associated with the current activity based on the energy rank of the first entertainment media file and the expected intensity of the current activity.

15. The portable electronic device of claim 14, wherein the energy rank of the first entertainment media file is based on the tempo of the first entertainment media file.

16. The portable electronic device of claim 11, wherein the first entertainment media file comprises one of a music file and a video file.

17. The portable electronic device of claim 11, wherein the graphic representation of the first entertainment media file comprises at least one of text and a still image that identifies the contents of the first entertainment media file.

18. The portable electronic device of claim 11, wherein the controller is configured to playback the first entertainment media file when the controller simultaneously provides the filmstrip and the visual representation.

19. The portable electronic device of claim 11, wherein:

a plurality of entertainment media files comprising the first entertainment media file are accessible by the controller;

each entertainment media file of the plurality of entertainment media files comprises an energy rank; and

the controller is configured to select the first entertainment media file from the plurality of entertainment media files for association with the current activity based on the energy rank of the first entertainment media file and the expected intensity of the current activity.

20. The portable electronic device of claim 1, wherein the controller is configured to update the visual representation based on the data informative of advancement from the current activity to the first future activity by at least one of:

adding a graphic representation of a third entertainment media file associated with a second future activity to the visual representation; and

removing a graphic representation of a fourth entertainment media file associated with a previous activity from the visual representation.

21. The portable electronic device of claim 1, wherein the entertainment media comprises a playlist of a plurality of entertainment media files that is associated with at least the current activity.

22. The portable electronic device of claim 1, wherein:

the entertainment media comprises the first entertainment media file that is associated with the current activity and the second entertainment media file that is associated with the first future activity; and

the controller is configured to update the visual representation of the entertainment media based on the data informative of advancement from the current activity to the first future activity.

23. A method for guiding a user of an electronic device through a compilation of activities comprising at least a first activity and a second activity, the method comprising:

accessing a first graphic related to the first activity in the compilation;

accessing a second graphic related to the second activity in the compilation;

accessing a visual representation of at least a first entertainment media file that is associated with the compilation;

simultaneously displaying on a display of the portable electronic device;

an activity filmstrip comprising at least the first graphic and the second graphic; and

the visual representation;

accepting input to the portable electronic device informative of advancement from the first activity of the compilation to the second activity of the compilation; and

updating the activity filmstrip in response to the accepted input, wherein the updating the activity filmstrip comprises at least one of;

adding to the activity filmstrip a graphic related to an activity that follows the second activity in the compilation; and

removing from the activity filmstrip a graphic related to an activity that precedes the second activity in the compilation, wherein the visual representation is an entertainment filmstrip comprising;

a first entertainment graphical representation of the first entertainment media file that is associated with the first activity; and

a second entertainment graphical representation of a second entertainment media file that is associated with the second activity.

24. The method of claim 23 further comprising playing back the first entertainment media file simultaneously with the displaying.

25. The method of claim 23 further comprising updating the entertainment filmstrip in response to the accepted input.

26. The method of claim 25, wherein the updating the entertainment filmstrip comprises at least one of:

adding to the entertainment filmstrip a graphical representation of an entertainment media file that is associated with the activity that follows the second activity in the compilation; and

removing from the entertainment filmstrip a graphical representation of an entertainment media file that is associated with the activity that precedes the second activity in the compilation.

27. The method of claim 23, wherein the input comprises sensor data indicative of the user'"'"'s completion of the first activity.

28. An electronic device for guiding a user through a compilation of activities comprising at least a first activity and a second activity, the device comprising:

a display; and

a controller configured to;

access a first instructional graphic related to the performance of the first activity;

access a second instructional graphic related to the performance of the second activity;

access a visual representation of at least a first entertainment media file associated with the compilation;

simultaneously display on the display;

an activity filmstrip comprising at least the first instructional graphic and the second instructional graphic; and

the visual representation;

accept an input to the electronic device informative of advancement from the first activity of the compilation to the second activity of the compilation; and

update the activity filmstrip in response to the input by at least one of;

adding to the activity filmstrip a graphic related to an activity that follows the second activity in the compilation; and

removing from the activity filmstrip a graphic related to an activity that precedes the second activity in the compilation, wherein the visual representation is an entertainment filmstrip comprising;

a first entertainment graphical representation of the first entertainment media file that is associated with the first activity; and

a second entertainment graphical representation of a second entertainment media file that is associated with the second activity.

29. The electronic device of claim 28, wherein the controller is further configured to play back the first entertainment media file simultaneously with the displaying.

30. The electronic device of claim 28, wherein the controller is further configured to update the entertainment filmstrip in response to the accepted input.

31. The electronic device of claim 30, wherein the controller is configured to update the entertainment filmstrip by at least one of:

adding to the entertainment filmstrip a graphical representation of an entertainment media file that is associated with the activity that follows the second activity in the compilation; and

removing from the entertainment filmstrip a graphical representation of an entertainment media file that is associated with the activity that precedes the second activity in the compilation.

32. The electronic device of claim 28, wherein the input comprises sensor data indicative of the user'"'"'s completion of the first activity.