Electronic device having an image-based data input system

• US 7,176,905 B2
• Filed: 02/19/2003
• Issued: 02/13/2007
• Est. Priority Date: 02/19/2003
• Status: Expired due to Fees

• Current Assignee: Agilent Technologies, Inc.
• Original Assignee: Agilent Technologies, Inc.
• Inventors: Zhang, Xuemei, Kakarala, Ramakrishna, Baharav, Izhak, Vook, Dietrich W., Iimura, Russell M.
• Primary Examiner(s): Awad; Amr A.
• Assistant Examiner(s): HOLTON, STEVEN E
• Application Number:
  US10/368,717
• Publication Number:
  US 20040160420A1
• Time in Patent Office: 1,455 Days
• Field of Search: 345/168, 345/169, 345/170, 345173-178, 345/156, 178/18.01, 178/18.09, 178/18.11
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

Electronic devices having image-based data input systems are described. In one aspect, an electronic device includes a window, multiple indicia, an image sensor, and a data input processor. The window has a contact surface with an input region. The multiple indicia are viewable in the input region of the contact surface. The image sensor is constructed and arranged to produce image signals corresponding to images of the input region. The data input processor is coupled to the image sensor and is operable to produce input signals based on image signals produced by the image sensor and a mapping between areas of the input region images and locations of the input indicia.

Claims

1. An electronic device, comprising:

a window having a contact surface with an input region;

multiple indicia corresponding to respective markings viewable in the input region of the contact surface;

an image sensor constructed and arranged to capture images of the input region of the contact surface through the window; and

a data input processor coupled to the image sensor and operable to compute a central coordinate of an area of contact between an object and the contact surface in one of the captured images and to select as a user-selected indicium one of multiple ones of the indicia located within the contact area based on the central coordinate and a mapping between areas of the captured images and locations of the input indicia.

2. The device of claim 1, wherein the multiple input indicia resemble keys of a cellular telephone.

3. The device of claim 1, wherein the multiple input indicia resemble keys of a computer keyboard.

4. The device of claim 1, wherein the multiple input indicia correspond to markings on the contact surface.

5. The device of claim 1, wherein the contact surface comprises a single central bump in the input region.

6. The device of claim 1, wherein the contact surface comprises depressions at locations corresponding to respective ones of the indicia.

7. The device of claim 1, wherein the window is movable into and out of a field of view of the image sensor.

8. The device of claim 1, wherein the image sensor comprises a camera module.

9. The device of claim 8, wherein the camera module is operable to capture images of a scene beyond the window.

10. The device of claim 8, comprising multiple camera modules each operable to capture images of a respective area of the input region of the contact surface through the window.

11. The device of claim 1, wherein the data input processor is operable to compute coordinates of touched locations within the input region.

12. The device of claim 11, wherein the data input processor is operable to compute the central coordinate based on a computation of center of mass of the touched location coordinates.

13. The device of claim 11, wherein the data input processor is operable to compute the central coordinate based on computations of edges of the contact area.

14. The device of claim 13, wherein the data input processor is operable to compute the central coordinate based on computations of edges of an area of contact between the contact surface and a fingertip contacting the contact surface.

15. The device of claim 11, wherein the data input processor is operable to compute coordinates of touched locations within the input region based on determinations of areas of the input regions in which ambient light is shadowed by an object contacting the touch surface.

16. The device of claim 1, further comprising a light source.

17. The device of claim 16, wherein the light source is operable to illuminate the contact surface through the window.

18. The device of claim 16, wherein the light source is operable to inject light into an edge of the window, wherein injected light is retained by total internal reflection.

19. The device of claim 1, wherein each indicium occupies in the input region an area on the order of about 2 mm×

2 mm.

20. The device of claim 1, wherein the electronic device corresponds to a cellular telephone.

21. The device of claim 1, wherein the electronic device corresponds to a handheld computer.