Method and apparatus for calibrating a computer-generated projected image

• US 6,292,171 B1
• Filed: 03/31/1999
• Issued: 09/18/2001
• Est. Priority Date: 03/31/1999
• Status: Expired due to Term

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Fu, Bin, Lin, Shang-Hung
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Osorio, Ricardo
• Application Number:
  US09/283,093
• Time in Patent Office: 902 Days
• Field of Search: 345/156, 345/158, 345/163, 345/145, 702/95, 348/141, 353/121, 353/122
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

An apparatus and method for calibrating a computer-generated projected image to the displayed image viewed on the computer screen. Four or more calibration spots, at least three of which are collinear, arrayed in a predetermined pattern in both the displayed and the projected images, are optically imaged and electronically discriminated in the projected image, their coordinates ascertained and related to the predetermined pattern so as to derive transformation coefficients used in the process of converting a location on the projected image to the corresponding location in the displayed image.

Claims

1. A method for correlating the projection coordinates Q(x_Q,y_Q) of image elements projected onto a surface to the display coordinates P(x_P,y_P) of the corresponding image elements as displayed on a computer screen, said method comprising the steps of:

generating a set of n calibration spots disposed in a nonlinear pattern within the displayed image, where n≧

4, the predetermined coordinates of said calibration spots denoted by P_i(x_P,y_P), where 1≦

i≦

n, each said calibration spot having a brightness greater than a predetermined threshold level;

projecting the displayed image and said calibration spots onto the projection surface so as to form a calibration image thereon, said calibration image comprising n bright clusters corresponding to said n calibration spots;

determining the projection coordinate of the mean position Q_i(x_Q,y_Q) of each of said n bright clusters; and

,

deriving transformation coefficient matrices A and B by solving the set of vector equations given by;

2. The method of claim 1 further comprising the steps of:

imaging and filtering said calibration image so as to sense only filtered image elements having a brightness greater than said predetermined threshold level; and

,

grouping adjacent said sensed filtered image elements into a plurality of said bright clusters, each said bright cluster having a corresponding height and width.

3. The method of claim 2 further comprising the step of spatially filtering said plurality of bright clusters so as to sense only bright clusters having a height at least as great as a predetermined value (h₁) prior to said step of determining the projection coordinate.

4. The method of claim 2 further comprising the step of spatially filtering said plurality of bright clusters so as to sense only bright clusters having a width at least as great as a predetermined value (w₁) prior to said step of determining the projection coordinate.

5. The method of claim 2 further comprising the step of counting said bright clusters, wherein

if more than n said bright clusters are counted, selecting a threshold level higher than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, and counting said bright clusters, and

if fewer than n said bright clusters are counted, selecting a threshold level lower than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, and counting said bright clusters.

6. The method of claim 2 wherein at least three of said calibration spots are collinear.

7. The method of claim 6 wherein a central one of said at least three collinear calibration spots is spaced a distance of one unit from one said collinear calibration spot and a distance of two units from another said collinear calibration spot.

8. The method of claim 7 wherein at least one said calibration spot is spaced a distance of two units from the line defined by said three collinear calibration spots.

9. The method of claim 1 further comprising the step of generating a second set of n calibration spots disposed in a nonlinear pattern within the displayed image, each said calibration spot in said second set having a brightness greater than said predetermined threshold level.

10. A method for correlating the projection coordinates Q(x_Q,y_Q) of image elements projected onto a surface to the display coordinates P(x_P,y_P) of the corresponding image elements as displayed on a computer screen, said method comprising the steps of:

generating a set of n calibration spots disposed in a nonlinear pattern within the displayed image, where n≧

4, the predetermined coordinates of said calibration spots denoted by P_i(x_P,y_P), where 1≦

i≦

n, each said calibration spot having a predetermined height and a predetermined width;

projecting the displayed image and said calibration spots onto the projection surface so as to form a calibration image thereon;

imaging and filtering said calibration image so as to sense only filtered image elements having a brightness greater than a predetermined threshold level;

grouping adjacent said filtered image elements into a plurality of bright clusters, each said bright cluster having a corresponding height and width;

spatially filtering said plurality of bright clusters so as to sense only bright clusters having a height at least as great as a predetermined value (h₁) and having a width at least as great as a predetermined value (w₁);

counting said spatially filtered bright clusters, wherein

if more than n said spatially filtered bright clusters are counted, selecting a threshold level higher than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, spatially filtering said bright clusters, and counting said spatially filtered bright clusters, and

if fewer than n said filtered bright clusters are counted, selecting a threshold level lower than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, spatially filtering said bright clusters, and counting said spatially filtered bright clusters;

determining the projection coordinate of the mean position Q_i(x_Q,y_Q) of each of said n spatially filtered bright clusters; and

,

deriving transformation coefficient matrices A and B by solving the set of vector equations given by;

11. The method of claim 10 wherein each said calibration spot comprises a brightness greater than said predetermined threshold level.

12. The method of claim 10 wherein at least three of said calibration spots are collinear.

13. The method of claim 12 wherein a central one of said at least three collinear calibration spots is spaced a distance of one unit from one said collinear calibration spot and a distance of two units from another said collinear calibration spot.

14. The method of claim 13 wherein at least one said calibration spot is spaced a distance of two units from the line defined by said three collinear calibration spots.

15. The method of claim 10 further comprising the step of generating a second set of n calibration spots disposed in a nonlinear pattern within the displayed image, each said calibration spot in said second set having a brightness greater than said predetermined threshold level.

16. A calibration apparatus, suitable for correlating the projection coordinates Q(x_Q,y_Q) of an image projected onto a surface to the display coordinates P(x_P,y_P) of the corresponding image and included calibration spots as displayed on a computer screen, the image comprising n calibration spots disposed in a nonlinear pattern within the projected image, where n≧

4, said calibration apparatus comprising;

means for imaging and filtering said calibration image so as to sense only the n projected calibration spots;

means for determining the projection coordinates of the mean position Q_i(x_Q,y_Q) for each of said calibration spots, where 1≦

i≦

n;

means for deriving conversion matrices A and B by solving the set of vector equations given by;

17. The apparatus of claim 16 wherein said projected calibration spots comprise a brightness greater than a predetermined threshold level.

18. The apparatus of claim 16 wherein said projected calibration spots comprise a width at least as great as a predetermined value (w₁).

19. The apparatus of claim 16 wherein said projected calibration spots comprise a height at least as great as a predetermined value (h₁).

20. The apparatus of claim 16 wherein said means for imaging and filtering comprises a digital camera.

21. A medium readable by a machine embodying a program of instructions executable by said machine to perform a method for correlating the projection coordinates Q(x_Q,y_Q) of image elements projected onto a surface to the display coordinates P(x_P,y_P) of the corresponding image elements as displayed on a computer screen, said method comprising the steps of:

generating a set of n calibration spots disposed in a nonlinear pattern within the displayed image, where n≧

4, the predetermined coordinates of said calibration spots denoted by P_i(x_P,y_P), where 1≦

i≦

n, each said calibration spot having a brightness greater than a predetermined threshold level;

projecting the displayed image and said calibration spots onto the projection surface so as to form a calibration image thereon, said calibration image comprising n bright clusters corresponding to said n calibration spots;

determining the projection coordinate of the mean position Q_i(x_Q,y_Q) of each of said n bright clusters; and

,

deriving transformation coefficient matrices A and B by solving the set of vector equations given by;

22. The medium of claim 21 wherein the method further comprises the steps of:

imaging and filtering said calibration image so as to sense only filtered image elements having a brightness greater than said predetermined threshold level; and

,

grouping adjacent said sensed filtered image elements into a plurality of said bright clusters, each said bright cluster having a corresponding height and width.

23. The medium of claim 22 wherein the method further comprises the step of spatially filtering said plurality of bright clusters so as to sense only bright clusters having a height at least as great as a predetermined value (h₁) prior to said step of determining the projection coordinate.

24. The medium of claim 22 wherein the method further comprises the step of spatially filtering said plurality of bright clusters so as to sense only bright clusters having a width at least as great as a predetermined value (w₁) prior to said step of determining the projection coordinate.

25. The medium of claim 22 wherein the method further comprises the step of counting said bright clusters, wherein

if more than n said bright clusters are counted, selecting a threshold level higher than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, and counting said bright clusters, and

if fewer than n said bright clusters are counted, selecting a threshold level lower than said predetermined threshold level and repeating said steps of filtering said calibration image, grouping said filtered image elements, and counting said bright clusters.

26. The medium of claim 22 wherein at least three of said calibration spots are collinear.

27. The medium of claim 26 wherein a central one of said at least three collinear calibration spots is spaced a distance of one unit from one said collinear calibration spot and a distance of two units from another said collinear calibration spot.

28. The medium of claim 27 wherein at least one said calibration spot is spaced a distance of two units from the line defined by said three collinear calibration spots.

29. The medium of claim 21 wherein the method further comprises the step of generating a second set of n calibration spots disposed in a nonlinear pattern within the displayed image, each said calibration spot in said second set having a brightness greater than said predetermined threshold level.