Method and apparatus for exercise monitoring combining exercise monitoring and visual data with wireless wearable devices

• US 9,943,723 B2
• Filed: 02/26/2016
• Issued: 04/17/2018
• Est. Priority Date: 02/06/2004
• Status: Expired due to Term

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Quy, Roger J.
• Primary Examiner(s): VOORHEES, CATHERINE M
• Application Number:
  US15/054,711
• Publication Number:
  US 20160175652A1
• Time in Patent Office: 781 Days
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/02438 with portable devices, e.g. worn by the patient
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/335 using integrated circuit memory devices
• CPC Class Codes: A61B 5/6801 specially adapted to be attached to or worn on the body surface
• CPC Class Codes: A61B 5/6826 Finger
• CPC Class Codes: A61B 5/6838 Clamps or clips
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A63B 2071/0663 worn on the wrist, e.g. wrist bands
• CPC Class Codes: A63B 2071/0666 worn on the head or face, e.g. combined with goggles or glasses
• CPC Class Codes: A63B 22/0076 Rowing machines for conditioning the cardio-vascular system seats moving during exercise A63B22/0087; training appliances for rowing or sculling on boats A63B69/06
• CPC Class Codes: A63B 22/02 with movable endless bands , e.g. treadmills other training appliances for running on the spot A63B69/0028
• CPC Class Codes: A63B 22/04 with movable multiple steps , i.e. more than one step per limb, e.g. steps mounted on endless loops, endless ladders steppers with cantilevered support elements pivoting about an axis A63B22/0048
• CPC Class Codes: A63B 22/0605 performing a circular movement, e.g. ergometers
• CPC Class Codes: A63B 22/0664 : performing an elliptic movement
• CPC Class Codes: A63B 2220/12 : Absolute positions, e.g. by using GPS
• CPC Class Codes: A63B 2220/20 : Distances or displacements
• CPC Class Codes: A63B 2220/40 : Acceleration
• CPC Class Codes: A63B 2220/62 : Time or time measurement used for time reference, time stamp, master time or clock signal
• CPC Class Codes: A63B 2225/20 : with means for remote communication, e.g. internet or the like
• CPC Class Codes: A63B 2225/50 : Wireless data transmission, e.g. by radio transmitters or telemetry
• CPC Class Codes: A63B 2230/06 : heartbeat rate only
• CPC Class Codes: A63B 2230/30 : blood pressure A63B2230/04 takes precedence
• CPC Class Codes: A63B 2230/50 : temperature
• CPC Class Codes: A63B 2230/70 : body fat
• CPC Class Codes: A63B 24/0021 : Tracking a path or terminating locations
• CPC Class Codes: A63B 24/0062 : Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance
• CPC Class Codes: A63B 71/0622 : Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
• CPC Class Codes: G08B 21/02 : Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/0211 : Combination with medical sensor, e.g. for measuring heart rate, temperature
• CPC Class Codes: G08B 21/04 : responsive to non-activity, e.g. of elderly persons G08B21/06 takes precedence
• CPC Class Codes: G09B 19/003 : Repetitive work cycles; Sequence of movements
• CPC Class Codes: G09B 5/06 : with both visual and audible presentation of the material to be studied
• CPC Class Codes: G16H 10/60 : for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 20/10 : relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 20/30 : relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 20/60 : relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 : with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42201 : biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4223 : Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44213 : Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 2201/0084 : Digital still camera
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 24/00 : Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 88/02 : Terminal devices
• CPC Class Codes: Y10S 128/903 : Radio telemetry
• CPC Class Codes: Y10S 128/904 : Telephone telemetry

Abstract

Embodiments of the invention provide a method and apparatus for a wireless exercise monitoring system for interactively monitoring an aspect of exercise, sports, or fitness utilizing a wearable device, such as a watch, eyewear, or smart apparel. The device is equipped with, or connected to, a digital camera. Sensors integrated with, or wirelessly connected to, the wearable internet device record physiological data during exercise and data measuring the amount of exercise performed. The data and visual images from the camera are transmitted to one or more internet servers, and may be shared with other mobile internet devices.

Claims

1. A system for monitoring exercise, comprising:

a mobile internet device configured to be carried on a person, the mobile internet device including;

a keyboard, keypad, or voice processing technology for receiving user input, an integral digital camera, and a generic port providing a connection to an exercise monitoring device;

a communications port providing an interactive wireless connection with one or more internet servers;

a non-transitory computer readable medium having instructions stored thereon for providing a user interface for displaying visual images including graphics, photographs, and video clips;

the non-transitory computer readable medium further having instructions stored thereon for performing a method comprising steps of;

receiving a first type of data that is physiological data measured during exercise, and receiving a second type of data that is an amount of exercise work performed;

receiving a third type of data representing visual images captured by the camera, and

transmitting the first type of data measuring the physiological data, the second type of data measuring the quantitative amount of exercise work performed, and the third type of data representing the visual images, to one or more internet servers, and

a non-transitory computer readable medium residing on one or more internet servers having instructions stored thereon defining a server application for performing a method comprising steps of;

receiving the first type of data that is the physiological data, and receiving the second type of data that is a quantitative amount of exercise work performed, and receiving the third type of data representing visual images from the mobile internet device;

processing the first, second, and third types of data;

transmitting the processed data to the mobile internet device in response; and

transmitting the processed data to a second mobile device, whereby a user of the second mobile device may review the transmitted data and images;

wherein the non-transitory computer readable medium of the wireless internet device further has instructions for causing the wireless internet device to receive and display the processed data on the user interface of the wireless internet device.

2. The system of claim 1, wherein the mobile internet device is selected from the group comprising:

a watch, eyewear, apparel, or other device configured to be worn by a person.

3. The system of claim 1, further comprising a GPS device, an accelerometer, or a timer, integral within the mobile internet device or connected to it, and wherein the data measuring a quantitative amount of exercise work performed is received from the GPS device, the accelerometer, or the timer.

4. The system of claim 1, wherein the first or second types of data, or both, are received from the generic port, and wherein the generic port for connection to an exercise monitoring device is adapted to receive signals from a device selected from the group comprising:

a heart rate monitor, a respiration rate monitor, a blood pressure monitor, a temperature monitor, an accelerometer, a pedometer, a GPS device, a timer;

a device tracking, rate, intensity, distance, duration, or total amount of exercise;

a body weight scale, a body fat gauge, a biofeedback device, a treadmill, a rowing machine, an exercise bicycle, or a stepper.

5. The system of claim 1, wherein the generic port for connection to an exercise monitoring device is configured to provide a wired connection.

6. The system of claim 1, wherein the generic port for connection to an exercise monitoring device is configured to provide a wireless connection, that employs a protocol selected from a variety of 802.11, Bluetooth, or other short range wireless transmission methods.

7. The system of claim 1, wherein the communications port providing an interactive wireless connection to one or more internet servers is configured to provide a wireless link that employs a protocol selected from a variety of 802.11, other IEEE family protocols, cellular, or other RF protocols.

8. A method of monitoring exercise using a mobile internet device wherein the mobile internet device is a device configured to be carried on a person and including a keyboard, keypad, or voice processing technology for user input, a digital camera, and a display for data or images;

the mobile internet device connected in wireless communication with a network, comprising;

receiving a first type of data that is physiological data measured during exercise, and further receiving a second type of data, the second type of data being an amount of exercise work performed;

receiving a third type of data representing visual images captured by the digital camera, the visual images including photographic or video images; and

displaying the first, second, or third types of data on the mobile internet device;

transmitting the first, second, or third types of data to one or more internet servers; and

transmitting from the one or more internet servers the processed data to a second mobile device, whereby a user of the second mobile device may review the transmitted data and images.

9. The method of claim 8, wherein the mobile internet device is selected from the group comprising:

a watch, eyewear, apparel, or other device configured to be worn by a person.

10. A system for monitoring exercise, comprising:

a mobile internet device configured to be carried on a person, the mobile internet device including;

a keyboard, keypad, or voice processing technology for receiving user input, an integral digital camera, and a generic port providing a connection to an exercise monitoring device;

a communications port providing an interactive wireless connection with one or more internet servers;

a non-transitory computer readable medium having instructions stored thereon for providing a user interface for displaying visual images including graphics, photographs, and video clips;

the non-transitory computer readable medium further having instructions stored thereon for performing a method comprising steps of;

receiving a first type of data that is physiological data measured during exercise, and receiving a second type of data that is an amount of exercise work performed;

receiving a third type of data representing visual images captured by the camera, and

transmitting the first type of data measuring the physiological data, the second type of data measuring the quantitative amount of exercise work performed, and the third type of data representing the visual images, to one or more internet servers, and

a non-transitory computer readable medium residing on one or more internet servers having instructions stored thereon defining a server application for performing a method comprising steps of;

receiving the first type of data that is the physiological data, and receiving the second type of data that is a quantitative amount of exercise work performed, and receiving the third type of data representing visual images from the mobile internet device;

processing the first, second, and third types of data;

transmitting the processed data to the mobile internet device in response; and

sharing the physiological data related to exercise, or the data measuring a quantitative amount of exercise work performed, or the visual images related to exercise, or combinations thereof, with multiple other mobile internet devices;

wherein the non-transitory computer readable medium of the wireless internet device further has instructions for causing the wireless internet device to receive and display the processed data on the user interface of the wireless internet device.

11. A method of monitoring exercise using a mobile internet device wherein the mobile internet device is a device configured to be carried on a person and including a keyboard, keypad, or voice processing technology for user input, a digital camera, and a display for data or images;

the mobile internet device connected in wireless communication with a network, comprising;

receiving a first type of data that is physiological data measured during exercise, and further receiving a second type of data, the second type of data being an amount of exercise work performed;

receiving a third type of data representing visual images captured by the digital camera, the visual images including photographic or video images;

displaying the first, second, or third types of data on the mobile internet device; and

sharing the physiological data related to exercise, or the data measuring a quantitative amount of exercise work performed, or the visual images related to exercise, or combinations thereof, with multiple mobile internet devices.