Systems and methods for providing audio and visual cues via a portable electronic device

• US 20080077620A1
• Filed: 03/27/2007
• Published: 03/27/2008
• Est. Priority Date: 09/21/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Pacurariu, Mihnea Calin, Gilley, Glenn Gregory, Ubillos, Randall Hayes, Dorogusker, Jesse Lee, Brody, Sarah A., Borchers, Robert Edward, Ginsburg, Donald
• Granted Patent: US 8,001,472 B2
• Time in Patent Office: Days
• US Class Current: 707/104.1
• CPC Class Codes: A63B 2024/0068 Comparison to target or threshold, previous performance or not real time comparison to other individuals
• CPC Class Codes: A63B 2024/0093 the load of the exercise apparatus being controlled by performance parameters, e.g. distance or speed
• CPC Class Codes: A63B 2071/0625 Emitting sound, noise or music
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 2220/833 Sensors arranged on the exercise apparatus or sports implement
• CPC Class Codes: A63B 2220/836 Sensors arranged on the body of the user
• CPC Class Codes: A63B 2225/50 Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/755 used as a control parameter for the apparatus
• CPC Class Codes: A63B 24/0062 Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 24/0075 Means for generating exercise programs or schemes, e.g. computerized virtual trainer, e.g. using expert databases
• CPC Class Codes: A63B 24/0087 Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
• CPC Class Codes: A63B 71/0622 Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Methods and systems for providing a lifestyle companion system are provided. The lifestyle companion system can provide a platform to conduct a user interview. Based on the user interview responses, the system can suggest activities, references, and/or plug-in modules. During performance of activities, the system can provide audio and/or visual cues related to the activities and collect data indicative of the user'"'"'s performance. Based on the collected data, the system can dynamically adapt the user'"'"'s goals and/or activities the user is performing or will perform. In some embodiments of the present invention, the lifestyle companion system of the present invention can be applied to fitness, nutrition, and/or medical modules. The system also can be used to facilitate synchronous group activities.

Claims

1. A portable media device comprising:

a display;

a communication module for accepting sensor data indicative of a user'"'"'s performance metrics; and

a controller configured to provide a graphical user interface on the display, wherein the graphical user interface simultaneously provides information about an entertainment media file being played back by the portable media device and activity information about at least a first activity, wherein the controller is configured to update the activity information based on the sensor data.

2. The portable media device of claim 1, wherein the communication module is configured to accept sensor data from one or more exercise machines.

3. The portable media device of claim 1, wherein the information about the entertainment media file comprises text and one or more still images that identify the contents of the entertainment media file.

4. The portable media device of claim 1, wherein the instructions comprise an instructional video.

5. The portable media device of claim 1, wherein the activity information comprises a value of at least a first adjustable parameter associated with the first activity.

6. The portable media device of claim 5, wherein:

the value of the first adjustable parameter is user-adjustable; and

the controller is configured to adjust the value of the first adjustable parameter based on a user-specified value.

7. The portable media device of claim 5, wherein the first adjustable parameter represents an amount of time allocated to the first activity.

8. The portable media device of claim 1, wherein:

the first activity is associated with a compilation of multiple activities; and

the graphical user interface provides a progress indicator that indicates the user'"'"'s progress in performing the multiple activities associated with the compilation.

9. The portable media device of claim 1, wherein the graphical user interface is configured to provide information about at least a first performance metric based on the sensor data.

10. The portable media device of claim 1, wherein the controller is configured to provide audio cues simultaneously with the graphical user interface, wherein the audio cues are based on the sensor data.

11. The portable media device of claim 1, further comprising memory for storing multiple entertainment media files, wherein:

each of the multiple entertainment media files has an energy rank based on energy level; and

the controller is configured to change the entertainment media file being played back based on user indication for an entertainment media file having a lower or higher energy rank.

13. The method of claim 1, further comprising generating first control signals to influence operation of the first exercise machine, wherein the first control signals are generated based on the first sensor data.

14. The method of claim 1, further comprising:

accepting second identification data from a second exercise machine;

accepting second sensor data from at least a second sensor integrated within the second exercise machine;

linking the second sensor data with the second identification data; and

storing the second identification data and the second sensor data in the memory of the portable electronic device.

15. The method of claim 1, further comprising:

accepting third sensor data from at least a third sensor attached to a user, wherein the third sensor is a duplicative data source for the first sensor; and

identifying whether the first or third sensor data is the more accurate sensor data.

12. A method for a portable electronic device to interact with multiple exercise machines, the method comprising:

accepting first identification data from a first exercise machine, wherein the first identification data comprises data for identifying the first exercise machine;

accepting first sensor data from at least a first sensor integrated within the first exercise machine;

linking the first sensor data with the first identification data;

storing the first identification data and the first sensor data in memory of the portable electronic device; and

generating a first media cue based on the first sensor data.

16. A method for use by a portable electronic device to influence performance of an activity by a first user based on performance by a second user, the method comprising:

accepting first sensor data indicative of a first user'"'"'s performance metrics;

accepting second sensor data indicative of a second user'"'"'s performance metrics;

comparing the first sensor data with the second sensor data; and

transmitting a first media cue based on the comparison of the first sensor data with the second sensor data.

17. The method of claim 16, wherein the first media cue comprises graphics related to the first user'"'"'s performance metrics and the second user'"'"'s performance metrics.

18. The method of claim 16, wherein the first media cue comprises audio indications of the first user'"'"'s performance metrics and the second user'"'"'s performance metrics.

19. The method of claim 16, wherein the first media cue comprises audio indications and graphics related to the first user'"'"'s performance metrics and the second user'"'"'s performance metrics.

20. A portable electronic device comprising:

a display;

memory for storing information about multiple activities;

a communication module for accepting sensor data indicative of a user'"'"'s performance metrics; and

a controller configured to provide a filmstrip of graphics on the display, wherein the filmstrip of graphics is related to at least a current activity and a first future activity, wherein the controller is configured to generate the graphics based on the information stored in the memory and to update the filmstrip based on data informative of advancement from the current activity to the first future activity.

21. The portable electronic device of claim 20, wherein the controller is configured to provide an index of graphics and a progress indicator on the display, wherein:

the graphics represent activities for which information is stored in the memory; and

the progress indicator visually distinguishes activities that a user already has performed from activities that the user has yet to perform.

22. The portable electronic device of claim 21, wherein the controller is configured to determine which activities the user has performed based on the sensor data.

23. The portable electronic device of claim 20, wherein the controller is configured to update the filmstrip based on sensor data indicative of the user'"'"'s completion of the current activity.

24. The portable electronic device of claim 20, wherein the controller is configured to update the filmstrip based on user input data.

25. The portable electronic device of claim 20, wherein the first graphical user interface simultaneously provides instructions related to the current activity, wherein the instructions are a part of the information stored in the memory.

26. The portable electronic device of claim 25, wherein the controller is configured to update the instructions to relate to the first future activity based on data that indicates the user has completed performance of the current activity.

27. The portable electronic device of claim 20, wherein the controller is configured to update the filmstrip by adding a graphic related to a second future activity, wherein the graphic is generated based on the information stored in the memory.

28. A method for a portable electronic device to electronically coach a user through a compilation of activities, the method comprising:

accessing first activity information stored in memory of the portable electronic device, wherein the first activity information comprises at least a first instructional graphic related to a first activity in the compilation;

accessing a first entertainment media file stored in the memory;

displaying the first instructional graphic on a display of the portable electronic device;

playing back the first entertainment media file;

accepting input to the portable electronic device informative of advancement from the first activity of the compilation to a second activity of the compilation;

accessing second activity information stored in the memory responsive to the input, wherein the second activity information comprises at least a second instructional graphic related to the second activity; and

displaying the second instructional graphic on the display.

29. The method of claim 28, wherein the input comprises sensor data indicative of the user'"'"'s completion of the first activity.

30. The method of claim 28, wherein the input comprises user input data.

31. The method of claim 28, wherein the first or second instructional graphic comprises an instructional video.

32. The method of claim 28, wherein the first and second activity information comprise information about first and second fitness activities.