Dietary Assessment System and Method

• US 20100111383A1
• Filed: 09/03/2009
• Published: 05/06/2010
• Est. Priority Date: 09/05/2008
• Status: Active Grant

• Current Assignee: Purdue Research Foundation (The Trustees of Purdue University (d/b/a Purdue University))
• Original Assignee: Purdue Research Foundation (The Trustees of Purdue University (d/b/a Purdue University))
• Inventors: Ebert, David Scott, Kerr, Deborah, Delp, Edward John, Boushey, Carol, Lutes, Kyle DelMar
• Granted Patent: US 8,363,913 B2
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: A23L 33/30 Dietetic or nutritional methods, e.g. for losing weight A23L33/10 takes precedence
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables

Abstract

The present system and method provides a more precise way to record food and beverage intake than traditional methods. The present disclosure provides custom software for use in mobile computing devices that include a digital camera. Photos captured by mobile digital devices are analyzed with image processing and comparisons to certain databases to allow a user to discretely record foods eaten. Specifically, the user captures images of the meal or snack before and after eating. The foods pictured are identified. Image processing software may identify the food or provide choices for the user. Once a food is identified and volume of the food is estimated, nutrient databases are used for calculating final portion sizes and nutrient totals.

Claims

1. A method of measuring food intake of a user, the method comprising:

providing a mobile device having a built-in camera;

capturing a first image of food to be eaten by the user using the mobile device;

capturing a second image of the food, or absence of food, after the user has finished eating;

identifying the food; and

comparing the first and second images using image analysis to determine the amount of food consumed by the user.

2. The method of claim 1 where in the mobile device is network-connected and allows for the transferring and receiving of information.

3. The method of claim 1 wherein the user labels the identity of the food on at least the first image.

4. The method of claim 1 wherein the step of identifying the food comprises comparing the images of the food taken by the user to images of known food items in a food database.

5. The method of claim 1, further comprising the step of segmenting at least the first image into one or more segmented regions where different food items are located.

6. The method of claim 1 wherein at least the first image includes a fiducial marker of a known size as a reference for size or volume calculations.

7. The method of claim 1, further comprising estimating the volume of each food item in the first and second images.

8. The method of claim 1, further comprising calculating nutritional information based on the amount and identity of each food item eaten.

9. The method of claim 8, further comprising storing the nutritional information in a database.

10. A method of measuring food intake of a user, the method comprising:

providing a mobile device having a built-in camera;

capturing a first image of food to be eaten by the user using the mobile device;

calibrating a size of the food items in the image;

segmenting the first image into one or more segmented regions where different food items are located;

identifying the food of the segmented regions;

estimating the volume of food in the segmented regions of the first image.

11. The method of claim 10, further comprising calculating the nutritional information of the food items of the first image and communicating this information to the user before the user starts eating.

12. The method of claim 10, further comprising determining an amount of each food item consumed by the user by capturing a second image of any remaining food items after the user has eaten and repeating the calibrating, segmenting, identifying, and estimating steps for the food items in the second image, and then subtracting the remaining volume of each food item in the second image from the original volume of each food item in the first image to determine the amount of each food item eaten.

13. The method of claim 10, further comprising the selection by the user of an option given by the mobile device for indicating that all food was consumed.

14. The method of claim 10 where in the mobile device is network-connected and allows for the transferring and receiving of information.

15. The method of claim 10 wherein the user labels the identity of the food on at least the first image.

16. The method of claim 10 wherein the step of identifying the food comprises comparing the image of the food taken by the user to images of known food items in a food database.

17. The method of claim 10 wherein the image includes a fiducial marker of a known size as a reference for size or volume calculations.

18. The method of claim 12, further comprising calculating nutritional information based on the amount and identity of each food item eaten.

19. The method of claim 10 for measuring beverage intake rather than food intake.

20. The method of claim 10 wherein the user can enter food identity and volume estimation manually into the mobile device the when an image cannot be captured or is insufficient;

and wherein the nutritional content of food items identified can be calculated using known measurements for food items in a food database.