Mobile device for food identification an quantification using spectroscopy and imaging

• US 10,458,845 B2
• Filed: 01/25/2018
• Issued: 10/29/2019
• Est. Priority Date: 06/14/2012
• Status: Active Grant

• Current Assignee: Medibotics, LLC
• Original Assignee: Medibotics, LLC
• Inventors: Connor, Robert A.
• Primary Examiner(s): Hillery, Nathan
• Application Number:
  US15/879,581
• Publication Number:
  US 20180149519A1
• Time in Patent Office: 642 Days
• CPC Class Codes: G01J 2003/1213 Filters in general, e.g. dichroic, band
• CPC Class Codes: G01J 2003/1226 Interference filters
• CPC Class Codes: G01J 2003/4332 frequency-modulated
• CPC Class Codes: G01J 3/00 Spectrometry; Spectrophotometry; Monochromators; Measuring colours
• CPC Class Codes: G01J 3/0202 Mechanical elements; Supports for optical elements
• CPC Class Codes: G01J 3/0256 Compact construction
• CPC Class Codes: G01J 3/0264 Electrical interface; User interface
• CPC Class Codes: G01J 3/0272 Handheld
• CPC Class Codes: G01J 3/0278 Control or determination of height or angle information for sensors or receivers
• CPC Class Codes: G01J 3/0283 using a charging unit
• CPC Class Codes: G01J 3/0289 Field-of-view determination; Aiming or pointing of a spectrometer; Adjusting alignment; Encoding angular position; Size of measurement area; Position tracking
• CPC Class Codes: G01J 3/0291 Housings; Spectrometer accessories; Spatial arrangement of elements, e.g. folded path arrangements
• CPC Class Codes: G01J 3/1256 using acousto-optic tunable filter; acousto-optic elements or systems G02F1/11, G02F1/33
• CPC Class Codes: G01J 3/26 using multiple reflection, e.g. Fabry-Perot interferometer, variable interference filters
• CPC Class Codes: G01J 3/42 Absorption spectrometry; Double beam spectrometry; Flicker spectrometry; Reflection spectrometry beam switching arrangements G01J3/08
• CPC Class Codes: G01J 3/501 Colorimeters using spectrally-selective light sources, e.g. LEDs
• CPC Class Codes: G01J 3/513 having fixed filter-detector pairs
• CPC Class Codes: G01N 21/15 Preventing contamination of the components of the optical system or obstruction of the light path
• CPC Class Codes: G01N 21/255 Details, e.g. use of specially adapted sources, lighting or optical systems
• CPC Class Codes: G01N 21/3563 for analysing solids; Preparation of samples therefor
• CPC Class Codes: G01N 2201/0221 : Portable; cableless; compact; hand-held
• CPC Class Codes: G01N 2201/129 : Using chemometrical methods
• CPC Class Codes: G01N 33/02 : Food
• CPC Class Codes: G06T 1/0007 : Image acquisition
• CPC Class Codes: G06T 2207/30128 : Food products

Abstract

This invention can be embodied in a mobile device for food identification and quantification with both a spectroscopic sensor and a camera. It can be a handheld food scanner, food probe, smart food utensil, utensil attachment, removable component of a smart watch or wrist band, phone component, or phone accessory. It can provide information on types and quantities of food (and nutrients, chemicals, and microorganisms in that food). It can be wirelessly linked with a wearable device to comprise a system for monitoring and modifying a person'"'"'s food consumption habits.

Claims

1. A mobile device for food identification and quantification comprising:

a housing which is configured to be held by a person'"'"'s thumb and index finger;

wherein the housing further comprises a food probe which is inserted into food;

wherein the housing further comprises a spectroscopic sensor, wherein the spectroscopic sensor further comprises at least one first energy emitter and at least one first energy receiver, wherein a first energy emitter sends light beams toward the food, wherein a first energy receiver receives some of the light beams after they have been reflected by the food, and wherein changes in the spectrum of the light beams caused by their reflection by the food are analyzed to help identify the type of food;

and

wherein the housing further comprises a camera on the distal half of the housing, wherein the camera creates images of the food, and wherein the images of the food are analyzed in order to help identify the type of food and/or measure the quantity of food.

2. A system for food identification and quantification comprising:

augmented reality eyewear which is configured to be worn by a person, wherein the eyewear further comprises a camera, wherein the camera records images of food, and wherein the images of the food are analyzed in order to help identify the type of food and/or measure the quantity of food; and

a handheld housing, which is configured to be held by the person'"'"'s thumb and index finger, wherein the housing further comprises a spectroscopic sensor, wherein the spectroscopic sensor further comprises at least one first energy emitter and at least one first energy receiver, wherein a first energy emitter sends light beams toward the food, wherein a first energy receiver receives some of the light beams after they have been reflected by the food, and wherein changes in the spectrum of the light beams caused by their reflection by the food are analyzed to help identify the type of food; and

a virtual pointer which the eyewear displays in the person'"'"'s field of view at different locations on the food in order to direct where the person should place the spectroscopic sensor in order to take scans of the food.

3. A system for food identification and quantification comprising:

augmented reality eyewear which is configured to be worn by a person, wherein the eyewear further comprises a camera, wherein the camera records images of food, and wherein the images of the food are analyzed in order to help identify the type of food and/or measure the quantity of food; and

a handheld housing, which is configured to be held by the person'"'"'s thumb and index finger, wherein the housing further comprises a spectroscopic sensor, wherein the spectroscopic sensor further comprises at least one first energy emitter and at least one first energy receiver, wherein a first energy emitter sends light beams toward the food, wherein a first energy receiver receives some of the light beams after they have been reflected by the food, and wherein changes in the spectrum of the light beams caused by their reflection by the food are analyzed to help identify the type of food; and

wherein the eyewear tracks where the person moves the spectroscopic sensor for food scans and links scan results from those locations with different portions or types of food identified by analysis of images of the food.