Analysis of food items captured in digital images

• US 9,165,398 B2
• Filed: 02/25/2011
• Issued: 10/20/2015
• Est. Priority Date: 02/25/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Kyungjin, Lee, Kiwon, Cho, Sungil, Hong, Jiyoung, Kim, Sungeun
• Primary Examiner(s): Liu, Zhengxi
• Application Number:
  US14/001,446
• Publication Number:
  US 20130335418A1
• Time in Patent Office: 1,698 Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G16H 20/60 relating to nutrition control, e.g. diets
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

Data analysis of a food item based on one or more digital images of the food item is disclosed. In one embodiment, the method comprises displaying, on a display unit of the smart device, first and second digital images of a meal, where the first digital image is captured before the second digital image. The method also comprises determining a volume of each food item in the first digital image and a volume of each food item in the second digital image by analyzing the first digital image and the second digital image using a digital image processing technique. The method further comprises generating, on the display unit, an amount of intake for the meal based on a difference between the volume of each food item in the first digital image and the volume of each food item in the second digital image.

Claims

1. A smart device for analyzing food items captured in a digital image for diet watch, the smart device comprising:

a display unit;

a memory; and

a processor coupled to the display unit and the memory and the processor configured to;

preset a calorie amount as a goal for the diet watch;

display, on the display unit, a first digital image of a meal and a second digital image of the meal, wherein the first digital image of the meal is captured before the second digital image of the meal;

determine a volume of each food item in the first digital image of the meal and a volume of the each food item in the second digital image of the meal by analyzing the first digital image and the second digital image using a digital image processing technique; and

generate for displaying on the display unit an amount of intake for the meal based on a difference between the volume of the each food item in the first digital image and the volume of the each food item in the second digital image,

wherein the processor is further configured to;

display, on the display unit, a third digital image of a specific food item, wherein the third digital image of the food item is captured after the second digital image of the meal;

calculate the remaining calorie amount which can be consumed by a user by subtracting the amount of intake for the meal from the preset calorie amount;

compare the calculated remaining calorie amount with the total calorie amount of the specific food item; and

display, on the third digital image, a marking identifying a recommended portion and a caption related to the recommended portion, and

wherein the recommended portion corresponds to or is less than the remaining calorie amount.

2. The smart device of claim 1, further comprising a digital camera configured to capture the first digital image and the second digital image.

3. The smart device of claim 2, wherein the digital camera is a two-dimensional digital camera or a three-dimensional digital camera.

4. The smart device of claim 1, wherein the amount of intake is in calorie or nutrient weight.

5. The smart device of claim 1, wherein the first digital image of the meal is captured before the meal is eaten and the second digital image of the meal is captured after the meal is eaten.

6. A method of a smart device for analyzing food items captured in a digital image for diet watch, the method comprising:

presetting a calorie amount as a goal for the diet watch;

displaying, on a display unit of the smart device, a first digital image of a meal and a second digital image of the meal, wherein the first digital image of the meal is captured before the second digital image of the meal;

determining a volume of each food item in the first digital image of the meal and a volume of the each food item in the second digital image of the meal by analyzing the first digital image and the second digital image using a digital image processing technique;

generating, on the display unit, an amount of intake for the meal based on a difference between the volume of the each food item in the first digital image and the volume of the each food item in the second digital image,

displaying, on the display unit of the smart device, a third digital image of a specific food item, wherein the third digital image of the food item is captured after the second digital image of the meal;

calculating the remaining calorie amount which can be consumed by a user by subtracting the amount of intake for the meal from the preset calorie amount;

comparing the calculated remaining calorie amount with the total calorie amount of the specific food item; and

displaying, on the third digital image, a marking identifying a recommended portion and a caption related to the recommended portion,

wherein the recommended portion corresponds to or is less than the remaining calorie amount.

7. The method of claim 6, wherein the first digital image of the meal and the second digital image of the meal are received from an external device.

8. The method of claim 6, wherein the first digital image of the meal and the second digital image of the meal are captured using a camera implemented on the smart device.

9. The method of claim 6, wherein the displaying the first digital image further comprises displaying metadata of the each food item on the display unit.

10. The method of claim 9, wherein the metadata comprises identification data of the each food item.

11. The method of claim 9, wherein the metadata comprises an icon for the each food item.

12. The method of claim 9, further comprising associating the each food item on the first digital image with a respective item of the metadata.

13. The method of claim 12, wherein the associating the each food item with the respective item of the metadata is performed when the respective item of the metadata is dragged to a domain of the each food item displayed on the display unit.

14. The method of claim 6, further comprising displaying an image of at least one food item recommended for next meal.