Projection display system with pressure sensing at screen, and computer assisted alignment implemented by applying pressure at displayed calibration marks

• US 7,289,113 B2
• Filed: 04/27/2004
• Issued: 10/30/2007
• Est. Priority Date: 10/21/1991
• Status: Expired due to Fees

• Current Assignee: Smart Technologies Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Martin, David A.
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): Nguyen; Kevin M.
• Application Number:
  US10/832,281
• Publication Number:
  US 20040263488A1
• Time in Patent Office: 1,281 Days
• Field of Search: 345/173, 345/178, 178/18.03
• US Class Current: 345/178
• CPC Class Codes: G03B 21/132 Overhead projectors, i.e. capable of projecting hand-writing or drawing during action epidiascopic projectors G03B21/08
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status

Abstract

An interactive display system comprising a touch sensitive display surface for sensing pressure applied thereto and in response generating control signals indicating locations of the applied pressure, a personal computer for receiving the control signals and in response generating graphic images, and an LCD panel in combination with an overhead projector for receiving and projecting the graphic images onto the touch sensitive display surface at the indicated locations. The LCD panel and overhead projector may be provided an integral unit.

Claims

1. An interactive display system, comprising:

a) a touch-sensitive display screen for sensing pressure applied thereto and in response generating control signals indicating locations of said applied pressure,

b) structure configured to receive said control signals and in response generate graphic images to be projected onto said touch sensitive display screen at said locations,

c) a computer for executing one or more applications programs in a multi-tasking environment and in response generating screen video displays, said computer being connected to said touch-sensitive display screen,

d) a driver in said computer for receiving said control signals and in response generating a command to a selected one of said applications programs for updating said screen video displays in accordance with said applied pressure to said touch-sensitive display screen,

e) a projector connected to said one or more computers for receiving and projecting said screen video displays onto said display screen, and

f) structure for modifying location data in said command to thereby align said screen video displays with the location of said pressure applied to said display screen, wherein said command includes data for identifying horizontal and vertical coordinates of the location of said pressure applied to said display screen, and wherein said structure for modifying comprises a software routine for generating via said projector a plurality of alignment images onto said display screen at predetermined locations, detecting user applied pressure on said display screen at the respective locations of said images, and in response calibrating said horizontal and vertical coordinates to compensate for keystoning caused by planar misalignment between said projector and said display screen.

2. An interactive display system, comprising:

a) a touch-sensitive display screen for detecting pressure applied thereto and in response generating control signals indicating locations of the applied pressure,

b) a computer for executing one or more application programs in a multi-tasking environment and in response generating screen video displays, said computer being coupled to said touch-sensitive display screen,

c) a driver in said computer, for receiving said control signals from said touch sensitive display screen and in response generating a command to a selected one of said application programs updating said screen video displays in accordance with the pressure applied to said touch-sensitive display screen,

d) a projector coupled to said computer for receiving and projecting said screen video displays onto said touch-sensitive display screen, and

e) alignment structure, in said computer, to adjust location data in said command to thereby align said screen video displays with the location of said pressure applied to said touch-sensitive display screen, wherein the command includes data for identifying coordinates of the location of the pressure applied to said touch-sensitive display screen, and wherein said alignment structure includes a software routine for (i) projecting via said projector a plurality of predetermined images onto said touch-sensitive display screen, (ii) detecting user applied pressure at the respective locations of said predetermined images, and (iii) in response calibrating said coordinates to compensate for keystoning caused by planar misalignment between said projector and said touch-sensitive display screen.

3. An interactive display apparatus, comprising:

a touch-sensitive display screen providing a display surface for projection of a display image thereon and capable of generating, in response to pressure applied to the display surface, a location indication representing the location on the display surface where the pressure is applied; and

an alignment routine configured to;

(1) cause at least four alignment marks to be displayed via the display image;

(2) receive for each one of the alignment marks a respective location indication representing a location on the display surface where pressure is applied to the display surface proximate that alignment mark;

(3) use the respective location indications corresponding to the at least four alignment marks to generate a mapping between locations on the display surface and locations within the display image,

wherein the mapping compensates for keystoning of the display image caused by non-orthogonal projection of the display image onto the display surface; and

(4) use the mapping to correct coordinates of a subsequently-received location indication to a location within the display image where the subsequently-received location indication would be if the projected display image were rectangular.

4. The interactive display apparatus of claim 3, wherein the mapping generated by the alignment routine compensates for keystoning of the display image without physical adjustment of the touch-sensitive display screen.

5. The interactive display apparatus of claim 3, wherein the alignment routine is configured to cause exactly four alignment marks to be displayed via the display image.

6. The interactive display apparatus of claim 3, wherein the at least four alignment marks are displayed sequentially.

7. The interactive display apparatus of claim 6, wherein each alignment mark is displayed proximate a corner of the display image.

8. The interactive display apparatus of claim 3, wherein the at least four alignment marks are displayed within the display image.

9. The interactive display apparatus of claim 3, wherein the mapping is stored.

10. The interactive display apparatus of claim 3, wherein the alignment routine is configured to use a previously-stored mapping to compensate for keystoning in response to user input.

11. The interactive display apparatus of claim 3, wherein the alignment routine is executed during initialization of the touch-sensitive display screen.

12. The interactive display apparatus of claim 3, wherein the alignment routine is configured to be executed in response to user input.

13. The interactive display apparatus of claim 3 in combination with a projector configured to project images onto the display surface of the touch-sensitive display screen.

14. The interactive display apparatus of claim 3 in combination with a computer in communication with the touch-sensitive display screen.

15. The combination of claim 14, wherein the computer is configured to execute an application program in a windowed operating system environment, and

wherein the application program generates a display image for projection onto the display surface of the touch-sensitive display screen.

16. The combination of claim 14, wherein the computer is configured to pass the location indications received from the touch-sensitive display screen to the application program.

17. A method of interacting with a touch-sensitive display screen, the touch-sensitive display screen providing a display surface for projection of a display image thereon, the method comprising the steps of:

(a) generating, in response to pressure applied to the display surface, a location indication representing the location on the display surface where the pressure is applied;

(b) causing at least four alignment marks to be displayed via the display image;

(c) receiving for each one of the alignment marks a respective location indication representing a location on the display surface where pressure is applied to the display surface proximate that alignment mark;

(d) generating a mapping between locations on the display surface and locations within the display image, using the respective location indications corresponding to the at least four alignment marks,

wherein the mapping compensates for keystoning of the display image caused by non-orthogonal projection of the display image onto the display surface; and

(e) using the mapping to correct coordinates of a subsequently-received location indication to a location within the display image where the subsequently-received location indication would be if the projected display image were rectangular.

18. The method of claim 17, wherein the mapping generated by step (d) compensates for keystoning of the display image without physical adjustment of the touch-sensitive display screen.

19. The method of claim 17, wherein exactly four alignment marks are caused to be displayed via the display image in step (b).

20. The method of claim 17, wherein each alignment mark is displayed proximate a corner of the display image.

21. The method of claim 17, wherein the at least four alignment marks are displayed within the display image.

22. The method of claim 17, further comprising the step of:

storing the mapping.

23. The method of claim 17, further comprising the step of:

using a previously-stored mapping to compensate for keystoning in response to user input.

24. The method of claim 17, wherein at least steps (b)–

(d) are executed during initialization of the touch-sensitive display screen.

25. The method of claim 17, further comprising the step of:

executing steps (b)–

(d) in response to user input.

26. The method of claim 17, further comprising the step of:

projecting images onto the display surface of the touch-sensitive display screen.

27. The method of claim 17, further comprising the steps of:

executing an application program in a windowed operating system environment; and

generating a display image by the application program for projection onto the display surface of the touch-sensitive display screen.

28. The method of claim 27, further comprising the step of:

passing the location indications received from the touch-sensitive display screen to the application program.

29. An interactive display system, comprising:

a display screen,

wherein the display screen provides a display surface for projection of a display image thereon, and

wherein the display screen is capable of sensing pressure applied to the display surface, and, in response, generating a location indication representing the location on the display surface where the pressure is applied; and

a computer-readable medium containing a computer program for performing an alignment routine,

wherein the computer program performs the steps of;

(a) causing at least four alignment marks to be displayed via the display image;

(b) receiving for each one of the alignment marks a respective location indication representing a location on the display surface where pressure is applied to the display surface proximate that alignment mark;

(c) generating a mapping between locations on the display surface and locations within the display image, using the respective location indications corresponding to the at least four alignment marks,

wherein the mapping compensates for keystoning of the display image caused by non-orthogonal projection of the display image onto the display surface; and

(d) using the mapping to correct coordinates of a subsequently-received location indication to a location within the display image where the subsequently-received location indication would be if the projected display image were rectangular.