Modifying a person's eating and activity habits

• US 9,268,910 B2
• Filed: 12/05/2006
• Issued: 02/23/2016
• Est. Priority Date: 12/15/2005
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Simons-Nikolova, Mariana, Bodlaender, Maarten Peter
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US12/097,124
• Publication Number:
  US 20080267444A1
• Time in Patent Office: 3,367 Days
• Field of Search: 382/100, 382/103, 382/106, 382/107, 382/110, 382/118, 382/168, 382/181, 382/184, 382192-195, 382/201, 382/203, 382/209, 382/232, 382/254, 382/274, 382/276, 382/282, 382286-291, 382/305, 382/312, 600/590, 600/595, 345/810, 340/573.1
• US Class Current: 1/1
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G09B 19/0092 Nutrition
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A system for managing the food intake of a person comprises means for collecting information about food consumed by the subject, and means for providing feedback to the subject regarding the food consumed. It further comprises a sensor (57) for obtaining a signal related to the person and monitoring means for generating the information by performing a pattern recognition of the obtained signal for detecting whether the person is consuming food. The sensor comprises a camera and the pattern recognition comprises image processing. The image processing comprises the detection of a mouth and of a hand and of food. The system further comprises means for causing an audio/video-rendering device (56) to deliver the feedback. The camera is attached to the rendering device. The system further comprises means for identifying available rendering devices (56) arranged for being caused to deliver feedback.

Claims

1. A system for managing the food intake of a person, comprising:

a camera for obtaining a signal related to an eating behavior of the person;

a memory for storing a program; and

a microprocessor for executing the program to;

perform camera image processing on the signal and, based primarily on the camera image processing, provide data corresponding to a limited moving pattern that indicates the eating behavior of the person;

provide the data as feedback comprising an animated object presented on an audio/video-rendering device, the animated object comprising a physical, visual appearance that changes based on a quantity or type of the food consumed by the person;

determine a total amount of food consumed by the person or a trend in the amount of food consumed by the person; and

periodically cause the audio/video-rendering device to deliver feedback relating to the total amount of food consumed or to the trend in the amount of food consumed.

2. The system of claim 1, wherein, based on the camera image processing, the microprocessor is configured to detect unhealthy food.

3. The system of claim 2, wherein, based on the camera image processing, the microprocessor is configured to detect one or any combination of a hand or arm of the person near the unhealthy food, movement of the hand or the arm near the unhealthy food, movement of the unhealthy food near a mouth of the person, proximity of the unhealthy food near the mouth, or whether the mouth is open or closed.

4. The system of claim 1, wherein the camera is attached to the audio/video-rendering device.

5. The system of claim 1, wherein the microprocessor is configured to identify available rendering devices arranged for being caused to deliver the feedback, obtain properties of the identified rendering devices, and select one of the rendering devices based on a predefined set of criteria related to the properties, wherein the microprocessor is configured to cause only the selected rendering device to deliver the feedback.

6. The system of claim 1, wherein the microprocessor is configured to obtain at least one property related to content of an audio/video program being rendered, and wherein the microprocessor is configured to cause the audio/video-rendering device to deliver the feedback in dependence on the at least one property.

7. The system of claim 6, wherein the microprocessor is configured to cause the audio/video-rendering device to deliver the feedback only during selected intervals that correspond to the receptiveness of the person to receive the feedback.

8. The system of claim 1, further comprising a motion sensor or an accelerometer for obtaining an additional signal related to the eating behavior of the person.

9. A method for managing the food intake of a person, comprising:

obtaining a signal related to an eating behavior of the person;

performing camera image processing on the signal;

based primarily on the camera image processing, providing data corresponding to a limited moving pattern that indicates the eating behavior of the person;

identifying available rendering devices arranged for being caused to deliver the data as feedback, obtaining properties of the identified rendering devices, selecting at least one of the rendering devices based on a predefined set of criteria related to the properties, and causing feedback corresponding to the data to be presented on the rendering device immediately after unhealthy food consumption is detected or after a predetermined period of the consumption of the unhealthy food,

wherein the feedback comprises an animated object presented on the audio/video-rendering device, the animated object comprising a physical, visual appearance that changes based on a quantity or type of the unhealthy food and healthy food consumed by the person.

10. The method of claim 9, further comprising detecting unhealthy food based on the camera image processing.

11. The method of claim 10, further comprising detecting, based on the camera image processing, one or any combination of a hand or arm of the person near the unhealthy food, movement of the hand or the arm near the unhealthy food, movement of the unhealthy food near a mouth of the person, proximity of the unhealthy food near the mouth, or whether the mouth is open or closed.

12. A system, comprising:

means for providing feedback to a person regarding food consumed, the means for providing feedback comprising;

a camera for obtaining a signal related to the person; and

monitoring means for generating data primarily based on camera image processing of the signal, the data indicating an eating behavior of the person;

means for causing an audio/video-rendering device to deliver the feedback; and

means for identifying available rendering devices arranged for being caused to deliver the data as feedback, means for obtaining properties of the identified rendering devices, and means for selecting at least one of the rendering devices based on a predefined set of criteria related to the properties,

wherein the means for causing the rendering device to deliver the feedback is arranged for causing the selected rendering device to deliver the feedback,

wherein the feedback comprises an animated object presented on a audio/video-rendering device, the animated object comprising a physical, visual appearance that changes based on a quality of the food consumed by the person.

13. The system of claim 12, wherein the monitoring means detects, based on the camera image processing, food, a hand or arm of the person near the food, movement of the hand or the arm near the food, movement of the food near a mouth of the person, and proximity of the food near the mouth.

14. The system of claim 13, wherein the monitoring means detects, based on the camera image processing, whether the mouth is open or closed.