ESTMATION OF FOOD VOLUME AND CARBS
First Claim
1. A system for estimating the carbs content of food on a plate (single or multiple), said system comprising instructions which when performed by a processor causes the system to operate to:
- receive a first image of the food from an image acquisition component;
project a light pattern on the surface of the food with a light pattern projection component;
receive a second image of the food being highlighted with said light pattern from the image acquisition component;
identify a movement of the image acquisition component between the first and second image;
correct the first and/or the second image by an operation which compensates the movements of the image acquisition component throughout the image acquisition operation based on the artifacts to get a corrected pair of images;
subtract the first and second images of the corrected pair of images;
identify the projected light pattern on the food based upon a subtraction of the first and second corrected image; and
compute the tridimensional shape and the volume of the food given the deformations of the projected light pattern;
make segmentation and recognition of the food from the first image; and
compute the carbs content of the food based upon the volume, segmentation and recognition of food via use of nutritional databases.
3 Assignments
0 Petitions
Accused Products
Abstract
There is disclosed a system for estimating the volume of food on a plate, for example meal, with a mobile device. The system uses a camera and a light pattern projector. Images of the food with and without a projected light pattern on it enable to compute the tridimensional shape and volume, while image segmentation and recognition steps estimate one or more food types in said images. By applying accessible knowledge databases, the carbs content is estimated and the associated insulin bolus doses are provided. Developments comprise coding of the light pattern, different light sources and associated wavelengths, motion compensations, additional optics, estimation of fat content and associated multi-wave boluses. The invention can be implemented in a glucometer or in an insulin pump controller provided with a test strip port or with a mobile phone.
-
Citations
24 Claims
-
1. A system for estimating the carbs content of food on a plate (single or multiple), said system comprising instructions which when performed by a processor causes the system to operate to:
-
receive a first image of the food from an image acquisition component; project a light pattern on the surface of the food with a light pattern projection component; receive a second image of the food being highlighted with said light pattern from the image acquisition component; identify a movement of the image acquisition component between the first and second image; correct the first and/or the second image by an operation which compensates the movements of the image acquisition component throughout the image acquisition operation based on the artifacts to get a corrected pair of images; subtract the first and second images of the corrected pair of images; identify the projected light pattern on the food based upon a subtraction of the first and second corrected image; and compute the tridimensional shape and the volume of the food given the deformations of the projected light pattern; make segmentation and recognition of the food from the first image; and compute the carbs content of the food based upon the volume, segmentation and recognition of food via use of nutritional databases. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
Specification