Visible pointer tracking with separately detectable pointer tracking signal

• US 20040169639A1
• Filed: 02/28/2003
• Published: 09/02/2004
• Est. Priority Date: 02/28/2003
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Weng, Jian-gang, Pate, Michael A.
• Application Number:
  US10/376,828
• Publication Number:
  US 20040169639A1
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G02B 27/20 for imaging minute objects, e.g. light-pointer
• CPC Class Codes: G06F 3/0386 for light pen

Abstract

The invention concerns pointer tracking using a signal possessing an optical characteristic that is separately detectable from a projected display. An area of the projected display is sensed. Sensing is conducted with filtering for the separately detected optical characteristic.

Claims

1. A pointer device, comprising:

a visible spectrum source to produce visible emissions;

a non-visible spectrum source to produce emissions outside the visible spectrum;

optics for outputting, in alignment, said visible emissions and said emissions outside the visible spectrum.

2. The device according to claim 1, wherein said optics bore sight said visible emissions with said emissions outside the visible spectrum.

3. A pointer tracking system comprising:

a pointer device according to claim 1, further comprising;

an image sensor having a sensing range encompassing said emissions outside the visible spectrum.

4. The pointer tracking system according to claim 3, wherein said sensing range further encompasses said visible emissions.

5. The pointer tracking system according to claim 4, wherein said image sensor comprises a CCD sensor.

6. The pointer tracking system according to claim 4, further comprising a filter for filtering the visible spectrum.

7. The pointer tracking system according to claim 6, wherein said filter is selectively activated to alternately filter and not filter the visible spectrum.

8. A display system including the pointer tracking system of claim 3, further comprising a display engine for projecting images onto a surface.

9. The display system according to claim 8, further comprising:

a lens shared by said image sensor and said display engine;

a beam splitter that directs incoming images from said lens to said image sensor and transmits outgoing images from said display engine to said lens.

10. The display system according to claim 9, wherein said filter is applied between said beam splitter and said filter has a duty cycle to alternate images received by said image sensor between the visible spectrum and outside the visible spectrum.

11. The pointer device according to claim 1, further comprising a modulator to modulate said non-visible spectrum source.

12. The pointer device according to claim 11, further comprising:

a first operator interface for activating said visible spectrum source and said non-visible spectrum source.

13. The pointer device according to claim 12, further comprising a second operator interface for controlling said modulator.

14. The pointer device according to claim 13, wherein said first and second operator interfaces are buttons arranged similarly to right and left buttons of a computer mouse.

15. A display system comprising:

a pointer device according to claim 1, the display system further comprising;

display engine for projecting display images onto a surface;

an image sensor capable of imaging an area of display of said display engine and sensing the visible spectrum and said emissions outside the visible spectrum;

a filter disposed between said area of said display and said image sensor to selectively distinguish between the visible spectrum and said emissions outside the visible spectrum;

a memory for storing images received by said image sensor; and

a controller for controlling displays by said display engine and images stored by said memory in view of emissions of said non-visible spectrum source.

16. The display system according to claim 15, wherein said controller stores unmodulated emissions from said non-visible spectrum source as data with images of projected display images and interprets modulated emissions from said non-visible spectrum source as commands for controlling said display engine.

17. The display system according to claim 16, wherein said data comprises overlay slides of slides projected as display images by said display engine, and said overlay slides include pointer information based upon said unmodulated emissions from said non-visible spectrum source.

18. The display system according to claim 16, wherein said commands cause said controller to modify said display images.

19. The display system according to claim 15, wherein said controller monitors images sensed by said image sensor and determines whether emissions of said non-visible spectrum source trace an interpretable pattern.

20. The display system according to claim 19, wherein said controller modifies the projected display in response to an interpretable pattern that it detects.

21. The display system according to claim 15, further comprising:

a lens shared by said image sensor and said display engine;

a beam splitter that directs incoming images from said lens to said image sensor and transmits outgoing images from said display engine to said lens.

22. The display system according to claim 21, wherein said filter is applied between said beam splitter and said image sensor has a duty cycle to alternate images received by said image sensor between the visible spectrum and outside the visible spectrum.

23. The display system according to claim 15, further comprising:

a projection lens used by said display engine; and

an imaging lens used by said imaging sensor, said imaging lens having a field of view substantially identical to that of said projection lens.

24. The display system according to claim 23, wherein:

said controller performs a calibration procedure to set said imaging lens to said field of view substantially identical to that of said projection lens.

25. The display system according to claim 24, wherein said calibration procedure comprises displaying a test pattern using said display engine and scaling a field of view of said imaging lens according to said test pattern.

26. The display system according to claim 15, wherein the pointer device further comprises a signal transmitter to provide a signal to indicate activation of said visible and non-visible spectrum sources, the display system including a detector to detect said signal, said controller activating said image sensor in response to said signal.

27. A pointer device, comprising:

a first visible wavelength source to produce emissions in a first range of wavelengths in the visible spectrum;

a second wavelength source to produce emission in a second range of wavelengths different than said first range of wavelengths; and

optics to align and output emissions from said first visible wavelength source and said second wavelength source.

28. A display system comprising:

a pointer device according to claim 27, the display system further comprising;

display engine for projecting a display onto a surface;

an image sensor capable of imaging an area of display of said display engine and capable of sensing emissions in said second range of wavelengths.

29. The display system according to claim 28, further comprising a memory to store images sensed by said image sensor.

30. The display system according to claim 28, further comprising:

a lens shared by said image sensor and said display engine;

a beam splitter that directs incoming images from said lens to said image sensor and transmits outgoing images from said display engine and to said lens.

31. The display system according to claim 30, further comprising a filter applied between said beam splitter and said image sensor having a duty cycle to alternate images received by said image sensor between the first and second range of wavelengths.

32. The pointing device of claim 27, further comprising a modulator for modulating said second wavelength source.

33. A method of detecting a pointer signal used with a projected display, the method comprising steps of:

providing a pointer tracking signal possessing an optical characteristic that is separately detectable from the projected display; and

sensing an area of the projected display while filtering for said optical characteristic.

34. The method of detecting according to claim 33, wherein said filtering is conducted via an inherent characteristic of an image sensor used to conduct said step of sensing.

35. The method of detecting according to claim 33, wherein said filtering is conducted via a filter disposed between the display and an image sensor used to conduct said step of sensing.

36. A method of detecting a pointer signal used with a projected display, the method comprising steps of:

providing a pointer tracking signal distinguished from the projected display by an optical characteristic unmistakable as an element of the projected display;

sensing an area of the projected display while filtering for said optical characteristic unmistakable as an element of the projected display.

37. The method according to claim 36, wherein said optical characteristic unmistakable as an element of the projected display comprises a wavelength outside of a range of wavelengths utilized by said projected display.

38. The method according to claim 37, wherein said wavelength outside a range of wavelengths utilized by said projected display comprises a wavelength outside the visible spectrum.

39. The method according to claim 38, wherein said wavelength outside a range of wavelengths utilized by said projected display is in the range of ˜

980 nm -˜

100 nm.

40. The method according to claim 36, wherein said optical characteristic unmistakable as an element of the projected display comprises an intensity outside a range of intensities utilized by said projected display.

41. The method according to claim 36, wherein said optical characteristic unmistakable as an element of the projected display comprises a modulation frequency outside a range of modulation frequencies utilized by said projected display.

42. The method according to claim 36, further comprising steps of providing and sensing a control signal distinguished from the projected display by an optical characteristic unmistakable as an element of the projected display and distinguished from said pointer tracking signal.

43. A method of controlling the projected display of claim 42, further comprising steps of:

projecting the projected display onto a surface;

interpreting said control signal; and

modifying the projected display in accordance with said control signal.

44. The method according to claim 42, wherein said control signal is modulated to be distinguished from said pointer tracking signal.

45. The method according to claim 44, wherein said optical characteristic unmistakable as an element of the projected display comprises a wavelength outside of a range of wavelengths utilized by said projected display.

46. The method according to claim 44, wherein said optical characteristic unmistakable as an element of the projected display comprises an intensity outside a range of intensities utilized by said projected display.

47. The method according to claim 44, wherein said optical characteristic unmistakable as an element of the projected display comprises a modulation frequency outside a range of modulation frequencies utilized by said projected display.

48. The method according to claim 44, wherein both said pointer tracking signal and said control signal are invisible, one of said pointer tracking signal and said control signal is modulated, and the other of said pointer tracking signal and said control signal is continuous.

49. The method according to claim 44, wherein both said pointer tracking signal and said control signal are invisible and modulated at different frequencies.

50. A method of controlling the projected display of claim 36, further comprising steps of:

projecting the projected display onto a surface;

determining whether said pointer tracking signal sensed in said step of sensing traces an interpretable pattern; and

modifying the projected display in response to an interpretable pattern determined in said step of determining.

51. The method according to claim 50, wherein said steps of determining comprises correlating the interpretable pattern with a predefined command and executing the predefined command.

52. The method of detecting according to claim 36, wherein said filtering is conducted via an inherent characteristic of an image sensor used to conduct said step of sensing.

53. The method of detecting according to claim 36, wherein said filtering is conducted via a filter disposed between the display and an image sensor used to conduct said step of sensing.

54. A pointer device, comprising:

means for projecting a visible pointer; and

means for projecting, with the visible pointer, a pointer tracking signal that is separately detectable by an image sensor.

55. A pointer tracking system, the system comprising:

a pointer device according to claim 54, and further comprising,

means for detecting said pointer tracking signal separately from said visible pointer signal and visible images.

56. The pointer device of claim 54, wherein the pointer tracking signal is outside the visible spectrum.