Modifying a person's eating and activity habits

• US 9,524,654 B2
• Filed: 01/07/2016
• Issued: 12/20/2016
• Est. Priority Date: 12/15/2005
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Simons-Nikolova, Mariana, Bodlaender, Maarten Peter
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US14/989,828
• Publication Number:
  US 20160117952A1
• Time in Patent Office: 348 Days
• Field of Search: 382/100, 382/103, 382106-107, 382/110, 382/118, 382/168, 382/181, 382/184, 382192-195, 382/201, 382/203, 382/209, 382/232, 382/254, 382/274, 382/276, 382/282, 382286-291, 382/305, 382/312, 600/590, 600/595, 600/587, 345/810, 340/573.1, 715/810, 434/127, 434/238
• US Class Current: 1/1
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G09B 19/0092 Nutrition
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

A system for managing the food intake of a person comprises means for collecting information about food consumed by the subject, and means for providing feedback to the subject regarding the food consumed. It further comprises a sensor 57 for obtaining a signal related to the person and monitoring means for generating the information by performing a pattern recognition of the obtained signal for detecting whether the person is consuming food. The sensor comprises a camera and the pattern recognition comprises image processing. The image processing comprises the detection of a mouth and of a hand and of food. The system further comprises means for causing an audio/video-rendering device 56 to deliver the feedback. The camera is attached to the rendering device. The system further comprises means for identifying available rendering devices 56 arranged for being caused to deliver feedback.

Claims

1. An apparatus, comprising:

a microprocessor configured to;

receive image data of a food;

receive data corresponding to movement by a subject relative to the food;

based on the image data, determine that the food is unhealthy;

based on the determination that the food is unhealthy and further based on a determination by the microprocessor that the data about the movement by the subject corresponds to a limited movement pattern, determine that the subject is engaged in unhealthy behavior;

based on the determination of the unhealthy behavior, provide feedback related to the unhealthy behavior; and

store in memory the image data and the data corresponding to movement by the subject over a predefined time duration and provide the feedback after the predefined time duration.

2. The apparatus of claim 1, wherein the predefined time duration comprises one of a day or week.

3. The apparatus of claim 1, wherein the feedback comprises a visual message, audible message, or a combination of a visual and audible message.

4. The apparatus of claim 1, wherein the microprocessor is further configured to receive data corresponding to a location where the subject is consuming the food relative to a first device comprising an audio device, visual device, or a combination of an audio and visual rendering device.

5. The apparatus of claim 1, wherein the microprocessor is further configured to:

receive data corresponding to a property related to contents of a multimedia presentation presented on the first device; and

provide the feedback in dependence on the property.

6. The apparatus of claim 5, wherein the microprocessor is further configured to provide the feedback at an adjusted volume based on a volume of the multimedia presentation.

7. The apparatus of claim 6, wherein the microprocessor is further configured to adjust a presentation time of the feedback depending on a mood conveyed by the multimedia presentation.

8. The apparatus of claim 6, wherein the microprocessor is further configured to:

provide the feedback only at a select interval during presentation of the multimedia presentation; and

determine the select interval based on a determination by the microprocessor as to when the subject is anticipated to be more receptive to the feedback.

9. The apparatus of claim 1, wherein the microprocessor is further configured to provide the feedback proximal in time to when the subject is consuming the food or periodically.

10. The apparatus of claim 1, wherein the microprocessor is configured to provide the feedback immediately upon the determination or after determining that the unhealthy behavior continues for a predetermined period of time.

11. The apparatus of claim 1, wherein the microprocessor is configured to provide the feedback according to an adaptable time of presentation and adaptable content of a message corresponding to the feedback related to the unhealthy behavior.

12. The apparatus of claim 11, wherein the microprocessor is configured to adapt the content based on a condition of the subject.

13. The apparatus of claim 11, wherein the microprocessor is configured to adapt the content based on a preferred diet of the subject.

14. The apparatus of claim 11, wherein the microprocessor is configured to adapt the content based on a motivation of the subject to stop the unhealthy behavior.

15. The apparatus of claim 1, wherein the microprocessor is further configured to provide the feedback as a message conveying any one or a combination of an identity of the consumed foods, quantities of the consumed foods, and types of nutrients making up the consumed foods.

16. The apparatus of claim 1, wherein the microprocessor is further configured to provide the feedback as a message conveying a healthy alternative to the consumed food.

17. A non-transitory computer readable medium comprising executable code that, when executed by a microprocessor, causes the microprocessor to:

receive image data of a food;

receive data corresponding to movement by a subject relative to the food;

determine that the data about the movement by the subject corresponds to a limited movement pattern;

based on the image data, determine that the food consumed by the subject is unhealthy;

based on the determinations that the food is unhealthy and the movement corresponds to the limited movement pattern, determine that the subject is engaged in unhealthy behavior;

based on the determination of the unhealthy behavior, provide feedback related to the unhealthy behavior; and

store in memory the image data and the data corresponding to movement by the subject over a predefined time duration and provide the feedback after the predefined time duration.

18. The non-transitory computer readable medium of claim 17, further comprising executable code that, when executed by the microprocessor, causes the microprocessor to:

receive data corresponding to a location where the subject is consuming the food relative to a first device comprising an audio device, visual device, or a combination of an audio and visual rendering device;

receive data corresponding to a property related to contents of a multimedia presentation presented on the first device; and

provide the feedback in dependence on the property.

19. A method, comprising:

at a microprocessor;

receiving image data of a food;

receiving data corresponding to movement by the subject consuming the food;

determining that the data about the movement by the subject corresponds to a limited movement pattern;

determining that the food consumed by the subject is unhealthy based on the image data;

determining that the subject is engaged in unhealthy behavior based on the determinations that the food is unhealthy and the movement corresponds to the limited movement pattern;

providing feedback related to the unhealthy behavior based on the determination of the unhealthy behavior; and

storing in memory the image data and the data corresponding to movement by the subject over a predefined time duration and provide the feedback after the predefined time duration.