Method and apparatus for generating image that induces eye blinking of user, and computer-readable recording medium therefor

• US 9,846,955 B2
• Filed: 12/19/2014
• Issued: 12/19/2017
• Est. Priority Date: 07/08/2014
• Status: Active Grant

• Current Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Original Assignee: Samsung Display Company Limited (Samsung Electronics Co. Ltd.)
• Inventors: Lee, Changhoon, Kim, Ilnam, Baek, Jongin, Ahn, Yijoon, Park, Wonsang
• Primary Examiner(s): Wilson, Nicholas R
• Application Number:
  US14/578,026
• Publication Number:
  US 20160012622A1
• Time in Patent Office: 1,096 Days
• Field of Search: None
• CPC Class Codes: A61B 3/00 Apparatus for testing the eyes; Instruments for examining the eyes eye inspection using ultrasonic, sonic or infrasonic waves A61B8/10; devices for treatment of the eyes A61F9/00; exercisers for the eyes A61H5/00; optical systems in general G02B
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/1103 Detecting eye twinkling
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G09G 2340/10 Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2380/08 Biomedical applications
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

A method of displaying an image that induces eye blinking of a user is disclosed. In one aspect, the method includes displaying a main image in a display area of a display device and generating an auxiliary image configured to induce eye blinking of a user. The method also includes combining the main image and the auxiliary image and displaying the combined image in a first area corresponding to a portion of the display area.

Claims

1. A method of displaying an image, the method being performed by a processor and comprising:

displaying a main image in a display area of a display device;

generating, at an image generator, an auxiliary image configured to induce eye blinking of a user;

combining, at a display controller, the main image and the auxiliary image; and

displaying, at the display device, the combined image in a first area corresponding to a portion of the display area,

wherein the position of the first area varies periodically by randomly determining the position of the first area and setting a time limit,

wherein the combining is performed by using a first material image which includes at least a portion of the main image and a second material image which is the auxiliary image, wherein the combining comprises at least partially overlapping the second material image on the first material image, wherein a transparency of each pixel of the second material image is determined based on a pixel value of the second material image,

wherein when pixel values of a first portion of the second material image are lower than pixel values of a second portion of the second material image, a first transparency is set to the first portion of the second material image and a second transparency higher than the first transparency is set to the second portion of the second material image,

wherein when the pixel values of the first portion of the second material image are higher than the pixel values of the second portion of the second material image, the second transparency is set to the first portion of the second material image and the first transparency is set to the second portion of the second material image, and

wherein the combining is performed by applying a preset predetermined weight to the pixel value of the second material image to generate a weighted pixel value and averaging a sum of the weighted pixel value and a pixel value of the first material image.

2. The method of claim 1, wherein the auxiliary image has a shape of closed eyes or opened eyes.

3. The method of claim 1, wherein the predetermined weight is determined based on brightness of the second material image.

4. The method of claim 1, further comprising correcting the combined image by performing a reversal processing on pixel values of pixels of a first portion of the combined image or increasing pixel values of the pixels of the first portion of the combined image, when pixel values of pixels of the first material image corresponding to the first area are equal to or less than a preset reference value.

5. The method of claim 1, wherein the combining is performed such that a variation in a pixel value of the first area before and after the combined image is displayed in the first area corresponds to a just noticeable difference (JND).

6. The method of claim 1, wherein the combining and the displaying are repeated every time when the time limit elapses.

7. The method of claim 1, wherein the time limit varies as the combining and the displaying are repeated.

8. The method of claim 1, wherein as the combining and the displaying are repeated, the auxiliary image alternately displays closed eyes and opened eyes.

9. The method of claim 1, wherein the first portion of the second material image comprises shapes of eyebrows and eyes, the method further comprising, when a color of the shapes of the eyebrows and the eyes of the second material image is darker than the second portion of the second material image, setting, at the image generator, the first transparency to the first portion of the second material image and the second transparency to the second portion so as to generate an image that induces eye blinking such that the shapes of the eyebrows and the eyes are clearly distinguished.

10. The method of claim 1, wherein the first portion of the second material image comprises shapes of eyebrows and eyes, the method further comprising, when a color of the shapes of the eyebrows and the eyes of the second material image is brighter than the second portion of the second material image, setting, at the image generator, the second transparency to the first portion and the first transparency to the second portion so as to generate an image that induces eye blinking such that the shapes of the eyebrows and the eyes are clearly distinguished.

11. An apparatus for displaying an image, the apparatus comprising:

an image generator configured to generate an auxiliary image configured to induce eye blinking of a user; and

a display controller configured to i) display a main image in a display area, ii) combine the main image and the auxiliary image and iii) display the combined image in a first area corresponding to a portion of the display area, wherein the auxiliary image has a smaller displayable area than the main image,

wherein the position of the first area varies periodically by randomly determining the position of the first area and setting a time limit,

wherein the display controller is configured combine by using a first material image which includes at least a portion of the main image and a second material image which is the auxiliary image, wherein the combining comprises at least partially overlapping the second material image on the first material image, wherein a transparency of each pixel of the second material image is determined based on a pixel value of the second material image,

wherein when pixel values of a first portion of the second material image are lower than pixel values of a second portion of the second material image, a first transparency is set to the first portion of the second material image and a second transparency higher than the first transparency is set to the second portion of the second material image,

wherein when pixel values of the first portion of the second material image are higher than pixel values of the second portion of the second material image, the second transparency is set to the first portion of the second material image and the first transparency is set to the second portion of the second material image, and

wherein the display controller is configured to perform the combining by applying a preset predetermined weight to the pixel value of the second material image to generate a weighted pixel value and averaging a sum of the weighted pixel value and a pixel value of the first material image.

12. The apparatus of claim 11, wherein the auxiliary image has a shape of closed eyes or opened eyes.

13. A non-transitory computer readable recording medium having stored thereon code that when executed performs a method of displaying an image, the method comprising:

displaying a main image in a display area of a display device;

generating, at an image generator, an auxiliary image configured to induce eye blinking of a user;

combining, at a display controller, the main image and the auxiliary image; and

displaying, at the display device, the combined image in a first area corresponding to a portion of the display area,

wherein the position of the first area varies periodically by randomly determining the position of the first area and setting a time limits wherein the combining is performed by using a first material image which includes at least a portion of the main image and a second material image which is the auxiliary image, wherein the combining comprises at least partially overlapping the second material image on the first material image, wherein a transparency of each pixel of the second material image is determined based on a pixel value of the second material image,

wherein when pixel values of a first portion of the second material image are lower than pixel values of a second portion of the second material image, a first transparency is set to the first portion of the second material image and a second transparency higher than the first transparency is set to the second portion of the second material image,

wherein when pixel values of the first portion of the second material image are higher than pixel values of the second portion of the second material image, the second transparency is set to the first portion of the second material image and the first transparency is set to the second portion of the second material image, and

wherein the combining is performed by applying a preset predetermined weight to the pixel value of the second material image to generate a weighted pixel value and averaging a sum of the weighted pixel value and a pixel value of the first material image.

14. The medium of claim 13, wherein the auxiliary image is a shape of closed eyes or opened eyes.