Method and apparatus for exercise monitoring combining exercise monitoring and visual data with wireless wearable devices

• US 9,272,183 B2
• Filed: 03/20/2014
• Issued: 03/01/2016
• Est. Priority Date: 12/11/2003
• Status: Expired due to Term

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Q-Tec Systems LLC
• Inventors: Quy, Roger J.
• Primary Examiner(s): VOORHEES, CATHERINE M
• Application Number:
  US14/220,682
• Publication Number:
  US 20140207264A1
• Time in Patent Office: 712 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/335 using integrated circuit memory devices
• CPC Class Codes: A61B 5/6801 specially adapted to be attached to or worn on the body surface
• CPC Class Codes: A61B 5/6826 Finger
• CPC Class Codes: A61B 5/6838 Clamps or clips
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A63B 2071/0663 worn on the wrist, e.g. wrist bands
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: A63B 22/0076 Rowing machines for conditioning the cardio-vascular system seats moving during exercise A63B22/0087; training appliances for rowing or sculling on boats A63B69/06
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 22/04 with movable multiple steps , i.e. more than one step per limb, e.g. steps mounted on endless loops, endless ladders steppers with cantilevered support elements pivoting about an axis A63B22/0048
• CPC Class Codes: A63B 22/0605 performing a circular movement, e.g. ergometers
• CPC Class Codes: A63B 22/0664 : performing an elliptic movement
• CPC Class Codes: A63B 2220/12 : Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/20 : Distances or displacements
• CPC Class Codes: A63B 2220/40 : Acceleration
• CPC Class Codes: A63B 2220/62 : Time or time measurement used for time reference, time stamp, master time or clock signal
• CPC Class Codes: A63B 2225/20 : with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/50 : Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/06 : heartbeat rate only
• CPC Class Codes: A63B 2230/30 : blood pressure A63B2230/04 takes precedence
• CPC Class Codes: A63B 2230/50 : temperature
• CPC Class Codes: A63B 2230/70 : body fat
• CPC Class Codes: A63B 24/0021 : Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0062 : Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G08B 21/02 : Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/0211 : Combination with medical sensor, e.g. for measuring heart rate, temperature
• CPC Class Codes: G08B 21/04 : responsive to non-activity, e.g. of elderly persons G08B21/06 takes precedence
• CPC Class Codes: G09B 19/003 : Repetitive work cycles; Sequence of movements
• CPC Class Codes: G09B 5/06 : with both visual and audible presentation of the material to be studied
• CPC Class Codes: G16H 10/60 : for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/10 : relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 20/30 : relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 20/60 : relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42201 : biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44213 : Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 2201/0084 : Digital still camera
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 24/00 : Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 88/02 : Terminal devices
• CPC Class Codes: Y10S 128/903 : Radio telemetry
• CPC Class Codes: Y10S 128/904 : Telephone telemetry

Abstract

Embodiments of the invention provide a method and apparatus for a wireless exercise monitoring system for interactively monitoring an aspect of exercise, sports, or fitness utilizing a wearable device, such as a watch, eyewear, or smart apparel. The device is equipped with, or connected to, a digital camera. Sensors integrated with, or wirelessly connected to, the wearable internet device record physiological data during exercise and data measuring the amount of exercise performed. The data and visual images from the camera are transmitted to one or more internet servers, and may be shared with other mobile internet devices.

Claims

1. A system for monitoring exercise using a mobile phone, connected in at least partial wireless communication with one or more internet servers through a network, comprising:

a physiological monitoring device adapted to be coupled to a mobile phone for monitoring a first type of data that is physiological data related to a user of a mobile phone measured during exercise;

a mobile phone, wherein the mobile phone is a web-enabled phone configured to display information and images through a connection to the internet, the mobile phone including a sensor, keypad or keyboard system, or voice processing technology for user input, a digital camera, a GPS or other device tracking rate, intensity, distance, duration, or total amount of exercise, and a display for images including photographs and video clips captured by the camera;

the mobile phone configured to receive the first type of data that is physiological data related to a user of the mobile phone measured during exercise, and the mobile phone further configured to determine a second type of data that is a quantitative amount of exercise work performed using the GPS or other device; and

a non-transitory computer-readable medium within the mobile phone, the non-transitory computer-readable medium having instructions stored thereon for causing the mobile phone to perform a method for monitoring exercise, the method comprising steps of;

accepting the first type of data during exercise from the physiological monitoring device;

accepting the second type of data measuring a quantitative amount of exercise performed from the GPS device or other device;

accepting a visual image captured by the camera; and

displaying the physiological data, the data measuring the quantitative amount of exercise work performed, and the visual image, on the mobile phone.

2. The system of claim 1, wherein the mobile phone is further adapted to receive the second type of data that is a quantitative amount of exercise work performed from an exercise tracking device selected from the group consisting of an external GPS device, pedometer, accelerometer, a body weight scale, a body fat gauge, a biofeedback device, a treadmill, a rowing machine, an exercise bicycle, or a stepper.

3. The system of claim 1, wherein the mobile phone is coupled to the physiological monitoring device by means of a wireless connection and wherein the wireless connection employs a protocol selected from a variety of 802.11 protocols, other IEEE family protocols, or a variety of RF protocols.

4. The system of claim 2, wherein the mobile phone is coupled to the exercise tracking device by means of a wireless connection and wherein the wireless connection employs a protocol selected from a variety of 802.11 protocols, Bluetooth, or other short range wireless transmission methods.

5. The system of claim 2, further comprising a second mobile internet device, and wherein the instructions further cause the mobile phone to transmit the first and second types of data, and the visual images, to the second mobile internet device, so that a the second mobile device displays the data sent from the mobile phone.

6. The system of claim 5 wherein the physiological monitoring device and the exercise tracking device are deployed on the second mobile internet device.

7. The system of claim 6, wherein the mobile internet device is selected from the group comprising:

a watch, eyewear, apparel, or other device configured to be worn by a person.

8. A computer program, which is downloadable from a server to a mobile device, residing on a non-transitory computer-readable medium, containing instructions for causing the mobile phone to perform the following steps:

accepting a first type of data during exercise from a physiological monitoring device, the first type of data corresponding to physiological data related to a user of a mobile phone measured during exercise;

accepting a second type of data measuring a quantitative amount of exercise performed, the second type of data accepted from a GPS device or other exercise tracking device;

accepting a visual image captured by the camera; and

displaying the physiological data, the data measuring the quantitative amount of exercise work performed, and the visual image, on the mobile phone.

9. A system for monitoring exercise, comprising:

a mobile internet device configured to be carried on a person, the mobile internet device including;

voice processing technology for receiving user input, a connected digital camera, a sensor for measuring physiological data, and a sensor for determining an amount of exercise performed;

a communications port providing an interactive wireless connection with one or more internet servers;

a non-transitory computer readable medium within the mobile internet device having instructions stored thereon for performing a method, the method comprising steps of;

providing a user interface for displaying visual images including graphics, photographs, and video clips;

receiving a first type of data that is physiological data measured during exercise, and receiving a second type of data that is a quantitative amount of exercise work performed;

receiving a third type of data representing visual images captured by the camera; and

displaying the first type of data measuring the physiological data, the second type of data measuring the quantitative amount of exercise work performed, and the third type of data representing the visual images.

10. The system of claim 9, further comprising a second mobile internet device coupled by a wired or wireless connection to the mobile internet device, and wherein the instructions further cause the mobile device to transmit the first and second types of data, and visual images, to the second mobile internet device so that the second mobile device displays the data transmitted from the mobile device.

11. The system of claim 10, wherein the wireless connection employs a protocol selected from a variety of 802.11, other IEEE family protocols, cellular, or other RF protocols.

12. The system of claim 10, wherein the first or second mobile internet device is selected from the group comprising:

a watch, eyewear, apparel, or other device configured to be worn by a person.

13. A computer program residing on a non-transitory computer-readable medium, containing instructions for causing a mobile internet device to perform the following steps:

providing a user interface for displaying visual images including graphics, photographs, and video clips;

receiving a first type of data that is physiological data measured during exercise, and receiving a second type of data that is a quantitative amount of exercise work performed;

receiving a third type of data representing visual images captured by the camera; and

displaying the first type of data measuring the physiological data, the second type of data measuring the quantitative amount of exercise work performed, and the third type of data representing the visual images.