Method for generally continuously calibrating an interactive input system

• US 9,360,966 B2
• Filed: 03/15/2013
• Issued: 06/07/2016
• Est. Priority Date: 03/30/2012
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Holmgren, David, McReynolds, Daniel, McGibney, Grant
• Primary Examiner(s): GIESY, ADAM
• Application Number:
  US13/834,358
• Publication Number:
  US 20130257822A1
• Time in Patent Office: 1,180 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421

Abstract

A method for generally continuously calibrating an interactive input system, the interactive input system comprising at least two imaging devices having fields of view encompassing a region of interest, at least one of the imaging devices calibrated using a projection matrix having an associated quality metric, the method comprises estimating new values for parameters of the projection matrix based on a plurality of computed locations of at least one pointer brought into proximity with the region of interest; calculating a new quality metric using the new parameter values; and if the new quality metric is more accurate than the existing quality metric, updating the projection matrix using the new parameter values.

Claims

1. A method for generally continuously calibrating an interactive input system, the interactive input system comprising at least two imaging devices having fields of view encompassing a region of interest, at least one of said imaging devices calibrated using a projection matrix having an associated quality metric, the method comprising:

storing a plurality of computed locations generated in response to each pointer brought into said region of interest;

when said plurality of computed locations satisfy at least one condition, estimating new values for parameters of the projection matrix based on a plurality of computed locations of at least one pointer brought into proximity with the region of interest;

calculating a new quality metric using the new parameter values; and

if the new quality metric is more accurate than the existing quality metric, updating the projection matrix using the new parameter values.

2. The method of claim 1 wherein the at least one condition is satisfied when the number of stored computed locations is greater than a threshold.

3. The method of claim 1 wherein the at least one condition is satisfied when a threshold number of computed locations generally over the entire region of interest have been stored.

4. The method of claim 3 wherein the region of interest is subdivided into a plurality of bins, during said storing each computed location being stored in a respective bin, said at least one condition being satisfied when the total number of bins having at least a threshold number of computed locations therein is greater than the threshold.

5. The method of claim 3 wherein the region of interest is subdivided into a plurality of bins, during said storing each computed location being stored in a respective bin, said at least one condition being satisfied when the percentage of non-empty bins is greater than the threshold.

6. The method of claim 1 wherein the at least one condition is satisfied in response to user instruction to perform calibration.

7. The method of claim 1 wherein the region of interest is subdivided into a plurality of bins, during said storing each computed location being stored in a respective bin, said at least one condition being based on statistical criteria of the computed locations stored in at least one of the bins.

8. The method of claim 7 wherein the statistical criteria comprises an average number of bins having at least a threshold number of computed locations stored therein.

9. The method of claim 7 wherein the statistical criteria comprises a median number of bins having at least a threshold number of computed locations stored therein.

10. The method of claim 1 wherein the quality metric is an overlap metric.

11. The method of claim 10 further comprising determining an area of a polygon formed by the intersection of observed lines of sight of the at least one pointer as identified by each of the at least two imaging devices, and determining a ratio of the area to a maximum theoretical area to calculate the overlap metric.

12. The method of claim 11 wherein said maximum theoretical area is determined by:

determining a width of the at least one pointer using the observed lines of sight;

calculating a centroid of an area formed by the intersection of the observed lines of sight of the at least one pointer;

back-projecting the centroid to a respective focal plane associated with each of the at least two imaging devices;

calculating theoretical edges of the at least one pointer using the width of the at least one pointer; and

calculating the theoretical area of a polygon formed by the theoretical edges.

13. The method of claim 1 wherein the quality metric is a concurrency-based metric.

14. The method of claim 13 further comprising determining a direct line of sight of each of the at least two imaging devices to the at least one pointer and calculating an orthogonal distance from each of the direct lines of sight of each of the at least two imaging devices to a computed location of the at least one pointer and computing a cost function based on the orthogonal distances to calculate the overlap metric.

15. The method of claim 14, wherein the cost function comprises summing the orthogonal distances to calculate the overlap metric.

16. The method of claim 14 wherein said updating reduces the cost function.

17. The method of claim 1 wherein each computed location is stored only if said computed location satisfies at least one qualification criteria.

18. The method of claim 17 wherein said at least one qualification criteria requires said computed location to correspond to a single pointer brought into proximity with said region of interest.

19. The method of claim 17 wherein said at least one qualification criteria requires the computed location to be within the fields of view of the at least two imaging devices.

20. The method of claim 17 wherein said at least one qualification criteria requires a width of the at least one pointer associated with said computed location to be below a width threshold.

21. The method of claim 17 wherein said at least one qualification criteria requires a velocity of the at least one pointer associated with said computed location to be below a velocity threshold.

35. A non-transitory computer readable medium embodying a computer program for execution by a computing device to perform the method according to claim 1.

36. An interactive input system comprising:

at least two imaging devices configured to capture images of a region of interest from different vantages, at least one of the imaging devices calibrated using a projection matrix having a quality metric; and

processing structure configured to process captured images to compute locations of pointers brought into proximity of said region of interest and to calibrate the interactive input system according to the method of claim 1.

22. A method of calibrating an interactive input system comprising:

during normal operation of said interactive input system, storing a plurality of computed locations generated in response to pointer interaction with an interactive surface; and

when the computed locations satisfy at least one condition, calibrating the interactive input system using the computed locations,

wherein the interactive surface is subdivided into a plurality of bins, during said storing said computed locations being stored in respective bins.

23. The method of claim 22 wherein the at least one condition is satisfied when the number of stored computed locations is greater than a threshold.

24. The method of claim 22 wherein the at least one condition is satisfied when a threshold number of computed locations generally over the entire interactive surface have been stored.

25. The method of claim 24 wherein said at least one condition is satisfied when the total number of bins having at least a threshold number of computed locations therein is greater than the threshold.

26. The method of claim 24 wherein said at least one condition is satisfied when the percentage of non-empty bins is greater than the threshold.

27. The method of claim 22 wherein the at least one condition is satisfied in response to user instruction to perform calibration.

28. The method of claim 22 wherein said at least one condition is based on statistical criteria of the computed locations stored in at least one of the bins.

29. The method of claim 28 wherein the statistical criteria comprises an average number of bins having at least a threshold number of computed locations stored therein.

30. The method of claim 29 wherein the statistical criteria comprises a median number of bins having at least a threshold number of computed locations stored therein.

31. The method of claim 22 wherein each computed location is stored only when the computed location satisfies at least one qualification criteria.

32. The method of claim 31 wherein said at least one qualification criteria requires said computed location to correspond to a single pointer brought into proximity with said interactive surface.

33. The method of claim 31 wherein said at least one qualification criteria requires a width of the at least one pointer associated with said computed location to be below a width threshold.

34. The method of claim 31 wherein said at least one qualification criteria requires a velocity of the at least one pointer associated with said computed location to be below a velocity threshold.

37. An interactive input system comprising:

an interactive board configured to generate output in response to pointer interaction therewith; and

a processor device communicating with the interactive board, said processor device, during operation of said interactive input system, storing a plurality of computed locations generated in response to pointer interaction with said interactive board, and when the computed locations satisfy at least one condition, calibrating the interactive input system using the computed locations, wherein the interactive board is subdivided into a plurality of bins and said processor device is configured to store the computed locations in respective bins.

38. The interactive input system of claim 37 wherein the at least one condition is satisfied when the number of stored computed locations is greater than a threshold.

39. The interactive input system of claim 37 wherein the at least one condition is satisfied when a threshold number of computed locations generally over the entire interactive board have been stored.

40. The interactive input system of claim 39 wherein said at least one condition is satisfied when the total number of bins having at least a threshold number of computed locations therein is greater than the threshold.

41. The interactive input system of claim 39 wherein said at least one condition is satisfied when the percentage of non-empty bins is greater than the threshold.

42. The interactive input system of claim 37 wherein the at least one condition is satisfied in response to user instruction to perform calibration.

43. The interactive input system of claim 37 wherein said at least one condition is based on statistical criteria of the computed locations stored in at least one of the bins.

44. The interactive input system of claim 43 wherein the statistical criteria comprises an average number of bins having at least a threshold number of computed locations stored therein.

45. The interactive input system of claim 43 wherein the statistical criteria comprises a median number of bins having at least a threshold number of computed locations stored therein.

46. The interactive input system of claim 37 wherein each computed location is stored only when the computed location satisfies at least one qualification criteria.

47. The interactive input system of claim 46 wherein said at least one qualification criteria requires said computed location to correspond to a single pointer brought into proximity with said interactive board.

48. The interactive input system of claim 46 wherein said at least one qualification criteria requires a width of the at least one pointer associated with said computed location to be below a width threshold.

49. The interactive input system of claim 46 wherein said at least one qualification criteria requires a velocity of the at least one pointer associated with said computed location to be below a velocity threshold.