Integrated chip for detecting eye movement

• US 7,697,032 B2
• Filed: 01/17/2006
• Issued: 04/13/2010
• Est. Priority Date: 07/15/2005
• Status: Active Grant

• Current Assignee: EyeChip Corporation
• Original Assignee: MIRU Enterprise, Inc.
• Inventors: Han, Gunhee, Kim, Dongsoo, Song, Jae Hoon
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US11/332,489
• Publication Number:
  US 20070013652A1
• Time in Patent Office: 1,547 Days
• Field of Search: 345/156, 345/157, 382/103, 348/308, 348/207.99, 348144-146, 600/558
• US Class Current: 348/207.99
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G09G 2310/0267 Details of drivers for scan electrodes, other than drivers for liquid crystal, plasma or OLED displays
• CPC Class Codes: G09G 2310/0275 Details of drivers for data electrodes, other than drivers for liquid crystal, plasma or OLED displays, not related to handling digital grey scale data or to communication of data to the pixels by means of a current
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen

Abstract

According to one embodiment, the present invention relates to an integrated chip for detecting eye movement. An eye tracker device may include a CMOS image sensor which provides an imaging process of a user'"'"'s eye image. The eye tracker device may be implemented on a single chip where pixel-level image processing is performed, thereby achieving high operating speed. A smart CMOS Image Sensor (CIS) pixel array may include a CMOS image sensor with a “shrink” function of locating a center of a pupil while eliminating influence of a black region around the eyebrow or pupil at the pixel level so as to accurately find the location at which a user views. The CIS pixel array may include an “expand” function of removing glint or other interference occurring in the pupil due to external light or other source.

Claims

1. An integrated chip for detecting eye movement, the integrated chip comprising:

a sensor component for receiving an image of a user'"'"'s eye and processing the eye image to identify a center of a pupil of the eye image;

wherein the sensor component comprises a CMOS image sensor (CIS) pixel array,

wherein the CIS pixel array comprises;

a shrink means for reducing a dark interference region around a pupil portion of the eye'"'"'s image; and

an expand means for reducing a light interference region occurring in the pupil portion of the eye'"'"'s image,

wherein the CIS pixel array identifies a center of the pupil of the eye image at a pixel level by shrinking the eye image toward the center of the pupil where the center of the pupil identifies a point the user is viewing.

2. The integrated chip of claim 1, wherein the shrink means reduces the dark interference region by convening a plurality of dark pixels of the dark interference region to a plurality of white pixels to locate a center of the pupil.

3. The integrated chip of claim 1, wherein the expand means reduces the light interference region caused by a light source or external source.

4. The integrated chip of claim 1, wherein the CIS pixel array comprises a M×

N cellular neural network having M columns and N rows, where each pixel of the CIS pixel array outputs a current state value where each corresponding current state value for each pixel is summed for a plurality of rows and columns.

5. The integrated chip of claim 4, wherein the each pixel of the CIS pixel array comprises a photodiode, where an output voltage of the photodiode is changed depending on brightness of light.

6. The integrated chip of claim 1, further comprising:

a plurality of winner-take-all (WTA) circuits connected to a plurality of rows and columns of the CIS pixel array for identifying a location of a row and a column having a highest current value in the row and column and generating an output signal indicative of the identified location; and

a plurality of loadable shift registers (LSRs) connected to the plurality of WTA circuits for receiving the output signal, storing the received output signal and outputting the stored output signal though a shift operation.

7. The integrated chip of claim 1, further comprising:

a plurality of winner-take-all (WTA) circuits connected to a plurality of rows and columns of the CIS pixel array for identifying a location of a row and a column having a highest current value and generating an output signal indicative of identified location; and

a plurality of encoders connected to the plurality of WTA circuits for receiving the output signal to encode the received output signal and outputting the encoded signal.

8. The integrated chip of claim 6, further comprising

a stop criterion circuit connected to the plurality of WTA circuits and the plurality of LSRs for receiving the output signal and generating a LSR latch signal so that when a number of black pixels of the row and column of the CIS pixel array is less than a predetermined number, the location of the row and column is stored in the LSR.

9. The integrated chip of claim 8, wherein the predetermined number of the black pixels is two.

10. The integrated chip of claim 8, wherein the stop criterion circuit compares a highest current value I_WIN,h and I_WIN,V of the input signals of the row and column with a reference current value I_STOP and generates a latching signal for application to the LSRs if I_WIN,h and I_WIN,V are lower than I_STOP, respectively, wherein the LSRs outputs digital data.

11. A semiconductor integrated circuit in which the integrated chip of claim 1 is manufactured by a well-known semiconductor integration technique.

12. A system comprising the integrated chip of claim 1, wherein the integrated chip is in communication with a receiving device configured to receive an output from the integrated chip for identifying the point the user is viewing on the receiving device.

13. The system of claim 12, wherein the point the user is viewing is a target in a training simulator.

14. The system of claim 13, wherein the training simulator identifies the target viewed by the user and an actual target of the training simulator and wherein the target viewed by the user and the actual target are compared.

15. The system of claim 12, wherein the point the user is viewing is a target in an interactive game application.

16. The system of claim 12, wherein a direction that the receiving device is positioned is controlled by the output.

17. The system of claim 16, wherein an action of the receiving device is further controlled by another output of the integrated chip.

18. The system of claim 12, wherein one or more characteristics of the eye image are determined.

19. The system of claim 18, wherein the user'"'"'s identity is determined by the one or more characteristics of the eye image.

20. The system of claim 12, wherein the receiving device is a laser device used in eye laser surgery wherein the laser device is configured to avoid a predetermined area of the eye.

21. The system of claim 12, wherein the receiving device is a transportation device that is configured to receive the point the user is viewing as input to control the transportation device.

22. The system of claim 21, wherein the transportation device is one of a vehicle and a wheelchair.

23. The system of claim 12, wherein the point the user is viewing identifies a security code for entry to the receiving device.

24. The system of claim 23, wherein the receiving device is an automated teller machine.

25. The system of claim 12, wherein the point the user is viewing is received as input to a component within a vehicle.

26. The system of claim 25, wherein the component within the vehicle is a global positioning system.

27. The system of claim 12, wherein the integrated chip is connected to an eye piece positioned at a close proximity to a user'"'"'s eye area.

28. A method for implementing an integrated chip for detecting eye movement, wherein the integrated chip comprises an image sensor component for receiving an eye image and processing the eye image to identify a center of a pupil of the eye, the method comprising the steps of:

receiving an eye image by the image sensor;

identifying an interference in the eye image;

removing the interference in the eye image, wherein the step of removing interference comprises at least one of a shrink function for removing a dark interference region around the pupil of the eye image by modifying a plurality of dark pixels into white pixels and an expand function for removing a light interference region in the pupil of the eye image; and

locating a center of a pupil of the eye image at a pixel level by shrinking the eye image toward the center of the pupil where the center of the pupil identifies a point the user is viewing.

29. The method of claim 28, further comprising the steps of:

outputting a current state value of each pixel of a CIS pixel array that corresponds to one or more of light and shade wherein the corresponding current values are summed for the rows and columns of the CIS pixel array;

identifying a location of row and column having a highest current value in the CIS pixel array and

outputting a signal indicative of the location of the row and column to a receiving device.

30. The method of claim 29, wherein the step of outputting further comprises the steps of:

comparing the highest current value I_WIN,h and I_WIN,V of input signals of the row and column with a reference current value I_STOP; and

generating digital data as an output if I_WIN,h and I_WIN,V are lower than I_STOP.