ELECTRONIC APPARATUS FOR PROVIDING HEALTH STATUS INFORMATION, METHOD OF CONTROLLING THE SAME, AND COMPUTER-READABLE STORAGE MEDIUM

• US 20150261996A1
• Filed: 03/16/2015
• Published: 09/17/2015
• Est. Priority Date: 03/14/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Seon-ae
• Granted Patent: US 10,366,487 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/634 Warning indications
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Provided is a device and method of providing health status information. The device includes: a device including: a storage configured to store a first image including a face of a user and first health status information extracted from the first image; an imager configured to capture an image; a controller configured to control the imager to capture a second image including the face of the user and to extract second health status information from the captured second image; and a display configured to output the second image and information other than the stored first health status information from among the extracted second health status information.

Claims

1. A device comprising:

a storage configured to store a first image including a face of a user and first health status information extracted from the first image;

an imager configured to capture an image;

a controller configured to control the imager to capture a second image including the face of the user and to extract second health status information from the captured second image; and

a display configured to output the second image and information other than the stored first health status information from among the extracted second health status information.

2. The device of claim 1, wherein, from among a plurality of applications in the device, when a first application which captures an image by using the imager is executed, the controller is configured to control the imager to capture the second image, and when a second application that is different from the first application is executed, the controller is configured to control the display to output the second image and the information other than the first health status information from among the extracted second health status information.

3. The device of claim 1, further comprising:

a user interface unit configured to receive a user input for unlocking the device when in a locked state,

wherein the controller is configured, when the user input for unlocking the device in the locked state is received, to control the imager to capture the second image and to extract the second health status information from the captured second image.

4. The device of claim 1, further comprising:

a user interface unit configured to receive a user input for executing a video call application in the device,

wherein the controller is configured to, when the video call application is executed according to the received user input, control the imager to capture the second image, and to extract the second health status information from the captured second image.

5. The device of claim 1, wherein the first image is a photograph that is received from a server in which the user is registered.

6. The device of claim 1, wherein the controller is configured to normalize a resolution of the face of the user in the captured second image by expanding or reducing a size of the second image to a pre-set size, and to extract the second health status information from the normalized second image.

7. The device of claim 1, wherein the controller is configured to obtain a color temperature of illumination on the face of the user at a point of time when the second image is captured, to normalize a hue value of the face of the user by adjusting a hue value of the second image based on the obtained color temperature, and to extract the second health status information from the normalized second image.

8. The device of claim 1, wherein the display is configured to output the second image by displaying an indicator on a face region of the user in the second image, from which the information other than the first health status information is extracted, to indicate that the information other than the first health status information is extracted.

9. The device of claim 1, wherein the display is configured to output, in chronological order, a plurality of second images that are captured during a predetermined time period and health status information extracted from the plurality of second images.

10. The device of claim 1, wherein:

the display is configured to output photographing guide information for guiding capturing of the face of the user based on a pre-set face image obtaining condition; and

the controller is configured to determine whether the imager captured the face of the user according to the pre-set face image obtaining condition, and to determine, when it is determined that the face of the user is captured according to the pre-set face image obtaining condition, an image of the face of the user as the second image.

11. The device of claim 1, further comprising:

a sensor configured to obtain bio-information of the user at a point of time when the second image is captured,

wherein the controller is configured to determine a biological condition of the user at the point of time when the second image is captured based on the obtained bio-information, and to exclude some of the second facial condition information, which is shown on the face of the user due to the biological condition.

12. A method of providing health status information, by a device, the method comprising:

obtaining first health status information extracted from a first image including a face of the user;

capturing a second image including the face of the user;

extracting second health status information from the captured second image; and

outputting the second image and information other than the first health status information from among the extracted second health status information.

13. The method of claim 12, wherein:

the capturing the second image comprises, from among a plurality of applications in the device, when a first application which captures an image by using an imager is executed, capturing the second image; and

the outputting the second image and the information comprises, from among the plurality of applications in the device, when a second application that is different from the first application is executed, outputting the second image and the information other than the first health status information from among the second health status information.

14. The method of claim 12, further comprising:

receiving a user input for unlocking the device when in a locked state,

wherein the capturing the second image comprises, when the user input is received, capturing the second image.

15. The method of claim 12, further comprising:

receiving a user input for executing a video call application in the device,

wherein the capturing the second image comprises, when the user input is received, capturing the second image.

16. The method of claim 12, wherein the first image is a photograph that is received from a server in which the user is registered.

17. The method of claim 12, wherein the extracting the second health status information comprises:

normalizing a resolution of the face of the user in the second image by expanding or reducing a size of the second image to a pre-set size; and

extracting the second health status information from the normalized second image.

18. The method of claim 12, wherein the extracting the second health status information comprises:

obtaining a color temperature of illumination on the face of the user at a point of time when the second image is captured;

normalizing a hue value of the face of the user by adjusting a hue value of the second image based on the obtained color temperature; and

extracting the second health status information from the normalized second image.

19. The method of claim 12, wherein the outputting the second image and the information comprises outputting the second image by displaying an indicator on a face region of the user in the second image, from which the information other than the first health status information is extracted, to indicate that the information other than the first health status information is extracted.

20. The method of claim 12, wherein the outputting the second image and the information comprises outputting, in chronological order, a plurality of the second images that are captured during a predetermined time period and health status information extracted from the plurality of second images.

21. The method of claim 12, wherein the capturing the second image comprises:

outputting photographing guide information for guiding capturing of the face of the user based on a pre-set face image obtaining condition;

determining whether an imager captured the face of the user according to the pre-set face image obtaining condition; and

when it is determined that the face of the user is captured according to the pre-set face image obtaining condition, determining an image of the face of the user as the second image.

22. The method of claim 12, further comprising:

detecting bio-information of the user at a point of time when the second image is captured,

wherein the extracting the second health status information comprises;

determining a biological condition of the user at the point of time when the second image is captured based on the detected bio-information; and

excluding some of the second facial condition information, which is shown on the face of the user due to the biological condition.

23. A non-transitory computer-readable recording medium having recorded thereon a program executable by a computer for performing the method of claim 12.