Multifunctional integrated image sensor and application to virtual interface technology

• US 7,307,661 B2
• Filed: 06/26/2003
• Issued: 12/11/2007
• Est. Priority Date: 06/26/2002
• Status: Expired due to Fees

• Current Assignee: VKB, Inc.
• Original Assignee: VBK Incorporated
• Inventors: Maor, Yaniv, Lieberman, Klony, Sharon, Yuval
• Primary Examiner(s): Villecco; John M.
• Application Number:
  US10/481,932
• Publication Number:
  US 20040246338A1
• Time in Patent Office: 1,629 Days
• Field of Search: 348/156, 348/148, 348/158, 348/273, 348/276, 348/277, 348/278, 348/279, 348/280, 348/281, 348/333.1, 348/342, 348/360, 345/168, 345/170, 345/173, 345/175
• US Class Current: 348/333.1
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

An electronic camera including an electronic imaging sensor providing an output representing an imaged field, a first imaging functionality employing the electronic imaging sensor for taking a picture of a scene in the imaged field, a second imaging functionality employing the electronic imaging sensor for data entry responsive to user hand activity and a user-operated imaging functionality selection switch operative to enable a user to select operation in one of the first and second imaging functionalities.

Claims

1. An electronic camera comprising:

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor for taking a picture of a scene in said imaged field;

a second imaging functionality employing said electronic imaging sensor for data entry responsive to user hand activity; and

a user-operated imaging functionality selection switch operative to enable a user to select operation in one of said first and second imaging functionalities,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.

2. An electronic camera according to claim 1 and wherein said electronic imaging sensor comprises a CMOS sensor.

3. An electronic camera according to claim 1 and wherein said first imaging functionality incorporates a first lens arrangement upstream of said electronic imaging sensor.

4. An electronic camera according to claim 1 and wherein said second imaging functionality incorporates a second lens arrangement upstream of said electronic imaging sensor.

5. An electronic camera according to claim 1 and wherein said second imaging functionality incorporates an infrared light generator for defining a light beam, impingement of which resulting from said user hand activity produces a light pattern representative of said data.

6. An electronic camera according to claim 5 and wherein said second imaging functionality also incorporates at least one infrared passing light filter associated with said electronic imaging sensor.

7. An electronic camera according to claim 1 and wherein said second imaging functionality incorporates a processor receiving an output from said electronic imaging sensor for providing a data entry output.

8. An electronic camera according to claim 7 and wherein said processor is incorporated together with said electronic imaging sensor on a single chip.

9. An electronic camera according to claim 1 and wherein said first imaging functionality is a color photography functionality.

10. An electronic camera according to claim 1 and wherein said second imaging functionality is an infrared beam impingement sensing data entry functionality.

11. An electronic camera according to claim 1 and wherein said first imaging functionality incorporates a first lens arrangement upstream of said electronic imaging sensor and wherein said second imaging functionality incorporates a second lens arrangement upstream of said electronic imaging sensor and wherein said user-operated imaging functionality selection switch is a mechanically responsive switch which selectably mechanically associates said first and second lens arrangements upstream of said electronic imaging sensor.

12. An electronic camera according to claim 1 and wherein said user-operated imaging functionality selection switch is a mechanically responsive switch which selectably mechanically associates selected filters with said electronic imaging sensor.

13. An electronic camera according to claim 1 and wherein said user-operated imaging functionality selection switch is an electronically responsive switch which selectably electronically determines responsiveness to selected outputs from predetermined portions of said electronic imaging sensor.

14. An electronic camera according to claim 1 and comprising an array of red, green, blue and infrared passing pixelwise elements arranged over said electronic imaging sensor.

15. An electronic camera according to claim 1 and also comprising a data entry template projector employed by said second imaging functionality.

16. An electronic camera according to claim 1 and wherein said electronic camera forms part of a telephone.

17. An electronic camera according to claim 1 and wherein said electronic camera forms part of a personal digital assistant.

18. An electronic camera according to claim 1 and wherein said electronic camera forms part of a wristwatch.

19. An electronic camera comprising:

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor in a visible radiation imaging mode for taking a picture of a scene in said imaged field; and

a second imaging functionality employing said electronic imaging sensor in an infrared radiation sensing mode for data entry responsive to user hand activity,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.

20. An electronic camera according to claim 19 and comprising an array of red, green, blue and infrared passing pixelwise elements arranged over said electronic imaging sensor.

21. An electronic camera according to claim 20 and wherein in said first imaging functionality output of the pixels underlying the red, green and blue passing elements are employed.

22. An electronic camera according to claim 21 and wherein output of the pixels underlying said infrared passing elements is employed to prevent distortion of color response of said imaging sensor.

23. An electronic camera according to claim 20 and wherein in said second imaging functionality output of the pixels underlying the infrared passing elements are employed.

24. An electronic camera according to claim 20 and also comprising a processor.

25. An electronic camera according to claim 20 and wherein said electronic camera forms part of a telephone.

26. An electronic camera according to claim 20 and wherein said electronic camera forms part of a personal digital assistant.

27. An electronic camera according to claim 20 and wherein said electronic camera forms part of a wristwatch.

28. A portable telephone comprising:

telephone functionality;

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor for taking a picture of a scene in said imaged field;

a second imaging functionality employing said electronic imaging sensor for data entry responsive to user hand activity; and

a user-operated imaging functionality selection switch operative to enable a user to select operation in one of said first and second imaging functionalities,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.

29. A portable telephone comprising:

telephone functionality;

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor in a visible radiation imaging mode for taking a picture of a scene in said imaged field;

a second imaging functionality employing said electronic imaging sensor in an infrared radiation sensing mode for data entry responsive to user hand activity; and

an array of red, green, blue and infrared passing pixelwise elements arranged over said electronic imaging sensor,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.

30. A digital personal assistant comprising:

at least one personal digital assistant functionality;

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor for taking a picture of a scene in said imaged field;

a second imaging functionality employing said electronic imaging sensor for data entry responsive to user hand activity; and

a user-operated imaging functionality selection switch operative to enable a user to select operation in one of said first and second imaging functionalities,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.

31. A digital personal assistant comprising:

at least one personal digital assistant functionality;

an electronic imaging sensor providing an output representing an imaged field;

a first imaging functionality employing said electronic imaging sensor in a visible radiation imaging mode for taking a picture of a scene in said imaged field;

a second imaging functionality employing said electronic imaging sensor in an infrared radiation sensing mode for data entry responsive to user hand activity; and

an array of red, green, blue and infrared passing pixelwise elements arranged over said electronic imaging sensor,

said second imaging functionality comprising an illuminator providing synchronized illumination power variation functionality.