Finger motion virtual object indicator with dual image sensor for electronic device

• US 8,878,796 B2
• Filed: 01/10/2012
• Issued: 11/04/2014
• Est. Priority Date: 08/01/2007
• Status: Active Grant

• Current Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Original Assignee: Mass International Co., Ltd.
• Inventors: Chiang, Kuo-Ching
• Primary Examiner(s): Behnamian, Shahriar
• Application Number:
  US13/347,659
• Publication Number:
  US 20120105324A1
• Time in Patent Office: 1,029 Days
• Field of Search: 345157-162, 455/566, 455/158.4, 455/154.2
• US Class Current: 345/173
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04B 1/401 for selecting or indicating operating mode
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264

Abstract

The virtual object indicator having dual image sensors for an electronic device comprises a housing to receive component therein. A user finger motion detecting device having the dual image sensors is attached on an upper surface of the housing for detection the motion of user finger. A controller is received in the housing for generating a control signal in responsive to the user finger motion detection, wherein the images captured by at least one of the dual image sensors is analyzed to drive a virtual object on a display of the electronic device, a communication interface is coupled to the controller for communication with the electronic device.

Claims

1. A method of controlling an electronic computing device with a display by figure motion and face recognition comprising:

providing at least one image sensor for said electronic computing device to capture a face image of a user in front of said display, followed by analyzing said face image to output a first control signal without touching said display, wherein said at least one image sensor includes CMOS or CCD sensor to capture said face image of said user;

capturing a figure image of said user without touching said display by said at least one image sensor;

analyzing said figure image, followed by generating a second control signal in responsive to said analysis to control a first displayed image on said display without touching said display of said electronic computing device; and

providing a vocal control through a microphone and a vocal control software of said electronic computing device for voice recognition to control a second displayed image on said display without touching said display of said electronic computing device.

2. The method of claim 1, further providing a detecting light source for detecting said user.

3. The method of claim 1, wherein said first, or said second control signal includes bar scrolling, application instruction, webpage movement or image size change.

4. The method of claim 1, further comprising detecting eye motion of said user by projecting spots at pupil of said user'"'"'s.

5. The method of claim 4, further comprising a step of evaluating pupil position information and to determine where said user looks.

6. A method of controlling an electronic computing device with a display by figure motion and face recognition comprising:

providing at least one image sensor for said electronic computing device to capture image of a face image of a user in front of said display, followed by analyzing said face image to output a first control signal without touching said display;

providing infrared ray (IR) source for detecting said user;

capturing images of a figure image of said user without touching said display by said at least one image sensor;

analyzing said figure image, followed by generating a second control signal in responsive to said analysis to control a first displayed image on said display; and

providing a vocal control through a microphone and a vocal control software of said electronic computing device for voice recognition to control a second displayed image on said display without touching said display for said electronic computing device.

7. The method of claim 6, wherein said at least one image sensor includes CMOS or CCD sensor.

8. The method of claim 6, further comprising capturing a gesture image of said user without touching said display by said at least one image sensor;

and analyzing said gesture image, followed by generating a third control signal in responsive to said gesture image analysis.