Method of digital image analysis for isolating a region of interest within a tongue image and health monitoring method and apparatus using the tongue image

• US 7,764,815 B2
• Filed: 12/29/2003
• Issued: 07/27/2010
• Est. Priority Date: 12/28/2002
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Tae-woo, Lee, Jeong-whan, Yoon, Gil-won, Shin, Sang-hoon
• Primary Examiner(s): Bella; Matthew C
• Assistant Examiner(s): Rosario; Dennis
• Application Number:
  US10/746,257
• Publication Number:
  US 20040151379A1
• Time in Patent Office: 2,402 Days
• Field of Search: 382/115, 382/128, 382/209, 600/590
• US Class Current: 382/128
• CPC Class Codes: A61B 5/416 the spleen
• CPC Class Codes: A61B 5/4854 Diagnosis based on concepts of traditional oriental medicine
• CPC Class Codes: G06T 2207/20132 Image cropping
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

A health monitoring method using a tongue image including constructing a database in which a tongue image obtained from a person, a template image set for the person, and a result of determining a health condition of the person with respect to at least one characteristic factor are linked together; isolating a region of interest within the tongue image, which is acquired from a person whose health condition is to be determined, using template matching; detecting at least one characteristic factor from the isolated region of interest; and determining a health condition of the person based on a change in an appearance of the tongue, which is detected by a comparison between the detected characteristic factor and a characteristic factor searched from the database with respect to the region of interest in different health conditions.

Claims

1. A method of monitoring health via a health monitoring apparatus using a tongue image, the method comprising:

linking with each other a tongue image obtained from a person whose health condition is to be determined, a template image which is set for the person, and a result of determining a health condition of the person with respect to at least one characteristic factor for the person;

storing in a database the linked tongue image, the template image and the result;

automatically isolating a region of interest within the tongue image by using template matching with the template image of the person, which is stored in the database;

automatically detecting at least one characteristic factor from the isolated region of interest; and

automatically determining the health condition of the person based on a change in an appearance of the tongue in the tongue image by comparing the detected characteristic factor and a corresponding reference characteristic factor in the template image from the database.

2. The health monitoring method as claimed in claim 1, wherein isolating the region of interest comprises:

performing thresholding on each pixel in the acquired tongue image using a predetermined threshold value to segment the tongue area from the tongue image.

3. The health monitoring method as claimed in claim 2, wherein the thresholding is performed using at least one among Red/Green/Blue (RGB) color values of each pixel in the tongue image.

4. The health monitoring method as claimed in claim 2, wherein the thresholding is performed using an intensity (I) value obtained by converting RGB color values of each pixel in the tongue image into Hue Saturation Intensity (HSI) color values.

5. The health monitoring method as claimed in claim 1, wherein the characteristic factor is an average of H, S, or I values obtained from a histogram of an HSI color coordinate system for the region of interest.

6. The health monitoring method as claimed in claim 1, wherein the region of interest is at least one region selected from the group consisting of:

a tongue middle, a tongue root, a tongue edge, and a tongue tip.

7. The health monitoring method as claimed in claim 1, further comprising:

informing the person of the result of determining the health condition via a wired connection or wirelessly.

8. A computer-readable recording medium comprising computer-executable programs recorded thereon for performing a method, execution of which by a computer facilitates health monitoring using a tongue image, the programs including:

a first program for linking with each other a tongue image obtained from a person whose health condition is to be determined, a template image which is set for the person, and a result of determining a health condition of the person with respect to at least one characteristic factor for the person and storing in a database the linked tongue image, the template image and the result recorded on the medium;

a second program for automatically isolating a region of interest from the tongue image using template matching recorded on the medium with the template image of the person, which is stored in the database;

a third program for automatically detecting at least one characteristic factor from the isolated region of interest recorded on the medium; and

a fourth program for automatically determining the health condition of the person based on a change in an appearance of the tongue in the tongue image by comparing the detected characteristic factor and a corresponding reference characteristic factor in the template image from the database.

9. A health monitoring apparatus using a tongue image, the apparatus comprising:

a tongue image database adapted to store a tongue image obtained from a person whose health condition is to be determined, a template image which is set for the person, and a result of determining a health condition of the person with respect to at least one characteristic factor for the person,

wherein the tongue image, the template image and the result are linked together;

a region of interest isolator adapted to automatically isolate a region of interest within the tongue image by using template matching with the template image of the person, which is stored in the tongue image database;

a characteristic detector adapted to automatically detect at least one characteristic factor from the isolated region of interest; and

a health condition determiner adapted to automatically determine the health condition of the person based on a change in an appearance of the tongue in the tongue image by comparing the detected characteristic factor and a corresponding reference characteristic factor in the template image from the database.

10. The health monitoring apparatus as claimed in claim 9, further comprising:

a color compensator for automatically compensating for color distortion of the tongue image acquired by the tongue image acquisition unit by using a color checker and for providing the compensated tongue image to the region of interest isolator.

11. The health monitoring apparatus as claimed in claim 10, wherein the color compensator generates and stores a color checker including a plurality of colors to be displayed on the tongue image during the acquisition of the tongue image, compares the color checker included in the tongue image with a color checker provided from the tongue image acquisition unit, obtains a color difference value between the two color checkers, and determines a degree of compensation based on the color difference value.

12. The health monitoring apparatus as claimed in claim 9, wherein the region of interest isolator performs template matching using a tongue width, a rotation angle of a tongue, and a tongue length, which are calculated from the tongue.

13. The health monitoring apparatus as claimed in claim 9, wherein the health monitoring apparatus is integrated into a mobile communication equipment having a digital camera.

14. The health monitoring apparatus as claimed in claim 9, wherein the health monitoring apparatus is integrated into a personal computer having a digital camera.

15. The health monitoring apparatus as claimed in claim 9, wherein the tongue image database, the region of interest isolator, the characteristic detector, the comparator, and the health condition determiner are implemented in a remote health care service center, and the tongue image acquired by the tongue image acquisition unit is transmitted via a wired connection or wirelessly to the health care service center.

16. The health monitoring apparatus as claimed in claim 15, wherein the health care service center is a computer server of a mobile communication equipment company or a hospital.

17. The health monitoring apparatus as claimed in claim 9, wherein the health condition determiner informs the person of the result of determining the health condition via a wired connection or wirelessly.

18. The health monitoring apparatus as claimed in claim 9, wherein the region of interest isolator segments the tongue area within the tongue image, by performing thresholding on each pixel in the tongue image using a predetermined threshold value to define an inner mouth area and the tongue area.

19. The health monitoring apparatus as claimed in claim 9, wherein the characteristic factor is an average of H, S, or I values obtained from a histogram of an HSI color coordinate system for the region of interest.