Camera based touch system

• US 8,338,725 B2
• Filed: 04/29/2010
• Issued: 12/25/2012
• Est. Priority Date: 04/29/2010
• Status: Active Grant

• Current Assignee: AU Optronics Corporation
• Original Assignee: AU Optronics Corporation
• Inventors: Fan, Fu-Cheng, Chen, Chih-Yen
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): Patel, Sanjiv D
• Application Number:
  US12/770,163
• Publication Number:
  US 20110266074A1
• Time in Patent Office: 971 Days
• Field of Search: 356 3- 22, 356621-623, 345/173, 345/175, 348139-140
• US Class Current: 178/18.09
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

One aspect of the present invention relates to an apparatus for touch detection. In one embodiment, the apparatus includes a touch panel, an imaging device mounted to the touch panel and configured such that when a pointer touches the touch panel, the imaging device acquires an image of the pointer touching the touch panel, and a processor in communication with the imaging device for receiving and processing the acquired image to obtain its width and its angle relative to the touch panel so as to determine the location of the pointer in the touch panel.

Claims

1. An apparatus for touch detection, comprising:

(a) a touch panel characterized with X-Y coordinates;

(b) an imaging device associated with the touch panel and configured to acquire an image of the touch panel and transfer the acquired image into a signal array that is a function of an angle; and

(c) a processor in communication with the imaging device for receiving the signal array therefrom, comparing a peak signal of the signal array with a predefined threshold and if the peak signal is greater than the predefined threshold, obtaining the peak'"'"'s width, W, and angle, Θ

, relative to the touch panel so as to determine the location (X, Y) of a pointer in the touch panel in the forms of;

X=R×

cos(Θ

),

Y=R×

sin(Θ

),

wherein R is a distance of the pointer and the imaging device, and satisfies the relationship of

W=A×

R^B+C,

wherein A, B and C are constant coefficients.

2. The apparatus of claim 1, wherein the pointer is calibrated to the imaging device by acquiring first, second and third images of the pointer touching the touch panel at first, second and third pre-selected locations, R₁, R₂ and R₃, respectively, to establish the relationships of:

W₁=A×

R₁^B+C,

W₂=A×

R₂^B+C,

W₃=A×

R₃^B+C,

wherein W₁, W₂ and W₃ are the widths of the first, second and third images, respectively, and wherein the coefficients A, B and C are obtained by solving the equations.

3. The apparatus of claim 1, wherein the imaging device is mounted to the touch panel at a pre-selected mounting position such that the imaging device has a field of view encompassing the touch panel.

4. The apparatus of claim 3, further comprising a light source associated with the imaging device.

5. The apparatus of claim 4, further comprising a retro-reflector disposed on the periphery of the touch panel at a location that is opposite to the pre-selected mounting position so as to reflect light emitted from the light source backward to the image device.

6. The apparatus of claim 3, wherein the imaging device comprises a camera, CCD and/or CMOS.

7. The apparatus of claim 6, wherein the camera comprises an infra light emitting diode (LED) camera.

8. The apparatus of claim 1, wherein the imaging device is configured to acquire the image of the touch panel at a predetermined frequency.

9. The apparatus of claim 1, wherein the processor comprises a computer.

10. A method for optically detecting a touch location in a touch panel, comprising the steps of:

(a) providing an imaging device associated with the touch panel;

(b) acquiring an image of the touch panel;

(c) transferring the acquired image into a signal array that is a function of an angle;

(d) comparing a peak signal of the signal array with a predefined threshold; and

(e) if the peak signal is not greater than the predefined threshold, repeating steps (b)-(d), otherwise, obtaining the peak'"'"'s width, W, and angle, Θ

, relative to the touch panel so as to determine the location (X, Y) of a pointer in the touch panel in the forms of;

X=R×

cos(Θ

),

Y=R×

sin(Θ

),

wherein R is a distance of the pointer and the imaging device, and satisfies the relationship of

W=A×

R^B+C,

wherein A, B and C are constant coefficients.

11. The method of claim 10, further comprising the step of calibrating the pointer to the imaging device to obtain the coefficients A, B and C.

12. The method of claim 11, wherein the calibrating step comprises the steps of:

(a) initializing a touch at a first pre-selected location, R₁, on the panel;

(b) acquiring an image of the pointer touching the touch panel at the pre-selected location, wherein the acquired image is transferred into a signal array that is a function of an angle;

(c) comparing a peak signal of the signal array with a predefined threshold;

(d) if the peak signal is not greater than the predefined threshold, repeating steps (a)-(c), otherwise, obtaining the peak'"'"'s width, W₁, and angle, Θ

₁, relative to the touch panel;

(e) repeating steps (a)-(d) at the second and third pre-selected locations, R₂ and R₃ to obtain W₂ and Θ

₂, and W₃ and Θ

₃, respectively; and

(f) solving the following equations;

W₁=A×

R₁^B+C,

W₂=A×

R₂^B+C, and

W₃=A×

R₃^B+C,

to obtain the coefficients A, B and C.

13. The method of claim 10, wherein the imaging device is mounted to the touch panel at a pre-selected mounting position such that the imaging device has a field of view encompassing the touch panel.

14. The method of claim 13, wherein the pre-selected mounting position is located in the periphery of the touch panel.

15. The method of claim 14, further comprising the step of providing a light source associated with the imaging device.

16. The method of claim 15, further comprising the step of providing a retro-reflector disposed on the periphery of the touch panel at a location that is opposite to the pre-selected mounting position so as to reflect light emitted from the light source backward to the image device.

17. The method of claim 10, wherein the imaging device comprises a camera, CCD and/or CMOS.

18. The method of claim 17, wherein the camera comprises an infra light emitting diode (LED) camera.

19. The method of claim 10, wherein the acquiring step is performed at a predetermined frequency.

20. An apparatus for detecting touch locations of first and second pointers in a touch panel, comprising:

(a) at least first and second imaging devices spatially mounted to the touch panel, each imaging device configured to acquire an image of the touch panel, and transfer the acquired image into a corresponding signal array that is a function of an angle; and

(b) a processor in communication with each imaging device for receiving the corresponding signal arrays therefrom, comparing each peak signal of each signal array with a predefined threshold and if the peak signals are greater than the predefined threshold, obtaining the maximal widths, W₁ and W₂, and its corresponding angles, Θ

₁ and Θ

₂, of the signal arrays corresponding to the images captured by the first and second imaging devices, respectively, so as to determine touch locations (X1, Y1) and (X2, Y2) of first and second pointers, respectively, in the touch panel in the forms of;

X1=R1×

cos(Θ

₁),

Y1=R1×

sin(Θ

₁),

X2=D−

[R2×

cos(Θ

₂)],

Y2=R2×

sin(Θ

₂),

wherein D is a distance between the first and second imaging devices, and

wherein Rj is a distance between the j-th pointer and the j-th imaging device, j=1 and 2, and satisfies the relationship of

W_j=A_j×

Rj^Bj+C_j,

wherein A_j, B_j and C_j are constant coefficients.

21. The apparatus of claim 20, wherein each of the first and second pointers is calibrated to the corresponding first and second imaging devices by acquiring first, second and third images of a printer touching the touch panel at first, second and third pre-selected locations, R₁, R₂ and R₃, respectively, to establish the relationships of:

W₁=A_j×

R₁^Bj+C_j,

W₂=A_j×

R₂^Bj+C_j,

W₃=A_j×

R₃^Bj+C_j,

wherein W₁, W₂ and W₃ are the widths of the first, second and third images, respectively, and wherein the coefficients A_j, B_j and C_j are obtained by solving the equations, wherein j=1 for the first imaging device and j=2 for the second imaging device.

22. The apparatus of claim 21, wherein the first and second imaging devices are mounted to the touch panel at pre-selected first and second mounting positions, respectively, such that the first and second imaging devices have overlapping fields of view encompassing the touch panel.

23. The apparatus of claim 22, wherein the pre-selected first and second mounting positions are located in the periphery of the touch panel.

24. The apparatus of claim 23, further comprising first and second light sources associated with the first and second imaging devices, respectively.

25. The apparatus of claim 24, further comprising a retro-reflector disposed on the periphery of the touch panel at a location that is opposite to the pre-selected first and second mounting position so as to reflect light emitted from the first and second light sources backward to the first and second image devices, respectively.

26. The apparatus of claim 20, wherein each of the first and second imaging devices comprises a camera, CCD and/or CMOS.

27. The apparatus of claim 26, wherein the camera comprises an infra light emitting diode (LED) camera.

28. The apparatus of claim 20, wherein each imaging device is configured to acquire the image of the touch panel at a predetermined frequency.

29. The apparatus of claim 20, wherein the processor comprises a computer.

30. A method for optically detecting one or more touch locations in a touch panel, comprising the steps of:

(a) providing first and second imaging devices spatially mounted to the touch panel;

(b) acquiring a first image and a second image of the touch panel by the first and second imaging devices, respectively;

(c) transferring the acquired first image into a first signal array that is a function of an angle;

(d) comparing each peak signal of the first signal array with a predefined threshold;

(e) if the peak signal is greater than the predefined threshold, analyzing the peak number of the first signal array and obtaining the maximal width, Wj, and its corresponding angle, Θ

j;

(f) determining the location (Xj, Yj) of the first pointer in the touch panel in the forms of;

Xj=Rj×

cos(Θ

_j),

Yj=Rj×

sin(Θ

),

wherein Rj is a distance of the j-th pointer and the j-th imaging device and satisfies the relationship of

Wj=A_j×

Rj^Bj+C_j,

wherein A_j, B_j and C_j are constant coefficients, wherein j=1;

(g) reporting the touch position of the first pointer; and

(h) repeating steps (c)-(g) for the acquired second image, wherein j=2.

31. The method of claim 30, further comprising the step of calibrating respectively the first and second pointers to the first and second imaging devices so as to obtain the coefficients A_j, B_j and C_j.

32. The method of claim 30, wherein the first and second imaging devices are mounted to the touch panel at pre-selected first and second mounting positions, respectively, such that the first and second imaging devices have overlapping fields of view encompassing the touch panel.

33. The method of claim 32, wherein the pre-selected first and second mounting positions are located in the periphery of the touch panel.

34. The method of claim 33, further comprising the step of providing first and second light sources associated with the first and second imaging devices, respectively.

35. The method of claim 34, further comprising the step of providing a retro-reflector disposed on the periphery of the touch panel at a location that is opposite to the pre-selected first and second mounting position so as to reflect light emitted from the first and second light sources backward to the first and second image devices, respectively.

36. The method of claim 35, wherein each of the first and second imaging devices comprises a camera, CCD and/or CMOS.

37. The method of claim 36, wherein the camera comprises an infra light emitting diode (LED) camera.

38. The method of claim 30, wherein the acquiring step is performed at a predetermined frequency.