INTERACTIVE INPUT SYSTEM AND METHOD

• US 20120250936A1
• Filed: 03/31/2011
• Published: 10/04/2012
• Est. Priority Date: 03/31/2011
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: HOLMGREN, DAVID
• Granted Patent: US 8,600,107 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/042 by opto-electronic means

Abstract

A method of determining locations of at least two pointers in a captured image frame comprises generating a vertical intensity profile (VIP) from the captured image frame, the VIP comprising peaks generally corresponding to the at least two pointers; determining if the peaks are closely spaced and, if the peaks are closely spaced, fitting a curve to the VIP; analyzing the fitted curve to determine peak locations of the fitted curve; and registering the peak locations as the pointer locations.

Claims

1. A method of determining locations of at least two pointers in a captured image frame, the method comprising:

generating a vertical intensity profile (VIP) from the captured image frame, the VIP comprising peaks generally corresponding to the at least two pointers;

determining if the peaks are closely spaced and, if the peaks are closely spaced;

fitting a curve to the VIP;

analyzing the fitted curve to determine peak locations of the fitted curve; and

registering the peak locations as the pointer locations.

2. The method of claim 1, wherein if the peaks are determined not to be closely spaced, the method further comprising:

analyzing the VIP to determine the peak locations; and

registering the peak locations as the pointer locations.

3. The method of claim 1, wherein the fitting comprises:

calculating a nonlinear least squares fit for at least one model, each model comprising at least two peaks, each peak having at least one of a respective peak location, a respective peak half-width and a respective peak amplitude.

4. The method of claim 3, wherein the nonlinear least squares fit comprises any one of a conjugate gradient algorithm, a Levenberg-Marquardt algorithm, and a nonlinear simplex algorithm.

5. The method of claim 3, wherein said at least one model comprises a plurality of models, each model in said plurality comprising a different number of peaks.

6. The method of claim 5, wherein the fitting further comprises:

calculating a goodness-of-fit value for each model;

calculating an Akaike Information Criterion (AIC) value for each model; and

determining a final model by comparing the goodness-of-fit values and the AIC values, the final model being said fitted curve.

7. The method of claim 6, wherein the final model determined is the model having at least one of a lowest goodness-of-fit value and a lowest AIC value.

8. The method of claim 7, further comprising:

calculating a value of fit residuals for each model,

wherein the AIC value for each model is calculated based on the value of the fit residuals.

9. The method of claim 3, wherein the at least one model is based on a point-by-point maximum of the VIP, the point-by-point maximum given by:

max([f(x_o, w, σ

), g(x_o, w, σ

), h(x_o, w, σ

), . . . ])

where f(x, w, σ

), g(x, w, σ

) and h(x, w, σ

) each represent an individual VIP function corresponding to a respective VIP peak, and where x_o is the peak location and w is the half-width of each individual VIP function, and σ

is instrumental profile width.

10. The method of claim 9, wherein each VIP peak is proportional to an error function erf(x) given by:

11. The method of claim 1, further comprising, prior to said determining:

comparing the VIP to a threshold; and

identifying the peaks in the VIP based on the comparing.

12. An interactive input system, comprising:

at least one imaging assembly capturing image frames of a region of interest; and

processing structure in communication with the at least one imaging assembly, the processing structure being configured to;

generate a vertical intensity profile (VIP) from a captured image frame, the VIP comprising peaks generally corresponding to locations of at least two pointers in the captured image frame; and

determine if the peaks are closely spaced, and if the peaks are closely spaced to;

fit a curve to the VIP;

analyze the fitted curve to determine peak locations of the fitted curve;

register the peak locations as the pointer locations.

13. The system of claim 12, wherein the at least one imaging assembly comprises two or more imaging assemblies, the processing structure being further configured to carry out said generating and said determining for a respective image frame captured by each imaging assembly, and to:

calculate the positions of the at least two pointers by triangulation based on the pointer locations.

14. The system of claim 13, wherein if the peaks are determined not to be closely spaced, the processing structure is further configured to:

analyze the VIP to determine the peak locations; and

register the peak locations as the pointer locations.

15. The system of claim 13, wherein, during the fitting, the processing structure is further configured to:

calculate a nonlinear least squares fit for at least one model, each model comprising at least two peaks, each peak having at least one of a respective peak location, a respective peak half-width and a respective peak amplitude.

16. The system of claim 15, wherein the nonlinear least squares fit comprises any one of a conjugate gradient algorithm, a Levenberg-Marquardt algorithm, and a nonlinear simplex algorithm.

17. The system of claim 15, wherein said at least one model comprises a plurality of models, each model in said plurality comprising a different number of peaks.

18. The system of claim 17, wherein, during the fitting, the processing structure is further configured to:

calculate a goodness-of-fit value for each model;

calculate an Akaike Information Criterion (AIC) value for each model; and

determine a final model by comparing the goodness-of-fit values and the AIC values, the final model being the fitted curve.

19. The system of claim 18, wherein the final model determined is the model having at least one of a lowest goodness-of-fit value and a lowest AIC value.

20. The system of claim 19, wherein the processing structure is further configured to:

calculate a value of fit residuals for each model,

wherein the AIC value for each model is calculated based on the value of the fit residuals.

21. The system of claim 15, wherein the at least one model is based on a point-by-point maximum of the VIP, the point-by-point maximum given by:

max([f(x_o, w, σ

), g(x_o, w, σ

), h(x_o, w, σ

), . . . ])

where f(x, w, σ

), g(x, w, σ

) and h(x, w, σ

) each represent an individual VIP function corresponding to a respective VIP peak, and where x_o is the peak location and w is the half-width of each individual VIP function, and a is instrumental profile width.

22. The system of claim 21, wherein each VIP peak is proportional to an error function erf(x) given by:

23. The system of claim 13, wherein the processing structure is further configured to, prior to the determining:

compare the VIP to a threshold; and

identify the peaks in the VIP based on the comparing.

24. A non-transitory computer readable medium having embodied thereon a computer program for determining locations of at least two pointers in a captured image frame, the computer program comprising:

program code for generating a vertical intensity profile (VIP) from the captured image frame, the VIP comprising peaks generally corresponding to the at least two pointers; and

program code for determining if the peaks are closely spaced and, if the peaks are closely spaced;

program code for fitting a curve to the VIP;

program code for analyzing the fitted curve to determine peak locations of the fitted curve; and

program code for registering the peak locations as the pointer locations.