Method for determining the location of a pointer in a pointer input region, and interactive input system executing the method

• US 8,446,392 B2
• Filed: 11/16/2009
• Issued: 05/21/2013
• Est. Priority Date: 11/16/2009
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Wang, Yunqiu (Rachel), McGibney, Grant, Morrison, Gerald
• Primary Examiner(s): OLSON, JASON C
• Application Number:
  US12/619,173
• Publication Number:
  US 20110115746A1
• Time in Patent Office: 1,282 Days
• Field of Search: None
• US Class Current: 345/175
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

An interactive input system comprises a touch surface, and imaging system associated with the touch surface and processing structure. The imaging system comprises an optical sensor array that spans at least a portion of the area of the touch surface, and the processing structure communicates with the imaging system and analyzes images received by the imaging system to determine whether at least one pointer is near to the touch surface and the location of the at least one pointer in respect of the touch surface based at least in part on the edge sharpness of the at least one pointer.

Claims

1. An interactive input system comprising:

a touch surface;

an imaging system associated with the touch surface and comprising an optical sensor array that spans at least a portion of the area of the touch surface; and

processing structure communicating with the imaging system and processing images received by the imaging system to determine whether at least one pointer is near to the touch surface and a distance of the at least one pointer from the touch surface based at least in part on the edge sharpness of the at least one pointer.

2. The interactive input system of claim 1, wherein the optical sensor array is embedded along with display pixels in a display panel.

3. The interactive input system of claim 2, wherein the display panel is a liquid crystal display (LCD).

4. The interactive input system of claim 3, wherein the LCD is an active matrix LCD (AMLCD).

5. The interactive input system of claim 1, wherein the processing structure determines whether the at least one pointer is within an input region of the interactive input system based at least in part on the edge sharpness of the at least one pointer.

6. The interactive input system of claim 5, wherein the processing structure determines whether the at least one pointer in the input region is in contact with the touch surface.

7. The interactive input system of claim 1, wherein the processing structure determines edge sharpness of the at least one pointer by generating histograms based on the received images and analyzing high frequency content in the histograms.

8. The interactive input system of claim 7, wherein the high frequency content is analyzed in power spectrums that are generated from the histograms.

9. An interactive input system comprising:

a pointer input region comprising a touch surface;

an imaging system associated with the touch surface and comprising an optical sensor array that spans at least a portion of the area of the touch surface; and

processing structure processing images received by the imaging system to determine whether at least one pointer is within the pointer input region and a distance of the at least one pointer from the touch surface within the pointer input region based at least in part on the edge sharpness of the at least one pointer.

10. A method of determining the location of at least one pointer in a pointer input region of an interactive input system comprising a touch surface, the method comprising:

receiving images from an optical sensor array that is associated with and spans at least a portion of the area of the touch surface;

determining whether at least one pointer is within the pointer input region; and

in the event that at least one pointer is within the pointer input region, determining a distance of the at least one pointer from the touch surface within the pointer input region based at least in part on the edge sharpness of the at least one pointer.

11. The method of claim 10, wherein determining the distance of the pointer within the pointer input region comprises determining whether the pointer is in contact with the touch surface based at least in part on the edge sharpness of the at least one pointer.

12. The method of claim 10, further comprising tracking the at least one pointer across a sequence of received images and determining based on the tracking whether the at least one object is approaching or retracting from the touch surface.

13. The method of claim 12, wherein the at least one pointer is approaching the touch surface in the event that edge sharpness of the object is determined to be increasing across the sequence of received images.

14. The method of claim 12, wherein the at least one pointer is retracting from the touch surface in the event that edge sharpness of the object is determined to be decreasing across the sequence of received images.

15. The method of claim 10, wherein determining whether at least one pointer is within the pointer input region comprises removing background features, and determining whether substantial high frequency content remains in the image.

16. The method of claim 15, wherein in the event that no substantial high frequency content remains, determining that there is no pointer in the pointer input region.

17. The method of claim 15, comprising:

in the event that substantial high frequency content remains, determining from the high frequency content whether a pointer has touched the touch surface or is hovering within the pointer input region above the touch surface.

18. The method of claim 10, wherein edge sharpness of the at least one pointer is determined by analyzing the high frequency content in a power spectrum based on a histogram generated from the images.

19. The method of claim 10, wherein edge sharpness of the at least one pointer is determined by analyzing the edge energy of an edge map based on a wavelet decomposition of the images.

20. A method of determining the location of at least one pointer in a pointer input region of an interactive input system comprising a touch surface, the method comprising:

receiving an image from an optical sensor array that is associated with and spans at least a portion of the area of the touch surface; and

determining the location of the pointer within the pointer input region based at least in part on the relative position of at least two shadows of the pointer in the image;

wherein determining the location of the pointer within the pointer input region comprises determining whether the pointer is in contact with the touch surface by determining an intersection point between the at least two shadows, the pointer being determined not to be contact with the touch surface when there is no intersection point generated between the at least two shadows.

21. The method of claim 20, wherein the pointer is determined to be in contact with the touch surface when there is an intersection point generated between the at least two shadows of the pointer.

22. A computer readable medium having stored thereon a computer program for determining the location of at least one pointer in a pointer input region of an interactive input system comprising a touch surface, the computer program comprising computer readable instructions, which when executed by a processor causes the processor to implement the steps of:

receiving images from an optical sensor array that is associated with and spans at least a portion of the area of the touch surface;

determining whether at least one pointer is within the pointer input region; and

in the event that at least one pointer is within the pointer input region, determining a distance of the at least one pointer from the touch surface within the pointer input region based at least in part on the edge sharpness of the at least one pointer.

23. A computer readable medium having stored thereon a computer program for determining the location of at least one pointer in a pointer input region of an interactive input system comprising a touch surface, the computer program comprising computer readable instructions, which when executed by a processor causes the processor to implement the steps of:

receiving an image from an optical sensor array that is associated with and spans at least a portion of the area of the touch surface; and

determining the location of the pointer within the pointer input region based at least in part on the relative position of at least two shadows of the pointer in the image;

wherein determining the location of the pointer within the pointer input region comprises determining whether the pointer is in contact with the touch surface by determining an intersection point between the at least two shadows, the pointer being determined not to be contact with the touch surface when there is no intersection point generated between the at least two shadows.

24. The computer readable medium of claim 23, wherein the pointer is determined to be in contact with the touch surface when there is an intersection point generated between the at least two shadows of the pointer.