Interactive input system and pen tool therefor

• US 9,292,109 B2
• Filed: 09/24/2012
• Issued: 03/22/2016
• Est. Priority Date: 09/22/2011
• Status: Active Grant

• Current Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Smart Technologies ULC (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Thompson, Sean, McGibney, Grant, Morrison, Gerald D.
• Primary Examiner(s): Wang, Quan-Zhen
• Assistant Examiner(s): Zheng, Xuemei
• Application Number:
  US13/625,668
• Publication Number:
  US 20130100022A1
• Time in Patent Office: 1,275 Days
• Field of Search: 345/156, 345/157, 345/175, 345/179
• US Class Current: 1/1
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen

Abstract

A pen tool for use with a machine vision interactive input system comprises an elongate body, a tip on the body and a variable reflector disposed on the body. The variable reflector comprises a reflecting portion and an attenuating portion configured to control the amount of illumination reflected by the reflecting portion.

Claims

1. A pen tool for use with a machine vision interactive input system comprising:

an elongate body;

a tip adjacent one end of the body;

a variable reflector disposed on the body, the variable reflector comprising a reflecting portion and an attenuating portion, the attenuating portion being fixedly disposed on the reflecting portion and being configured to controllably scatter light to control the amount of illumination impinging on the reflecting portion;

a switch adjacent said tip and configured to actuate when said tip is brought into contact with a surface, wherein said switch comprises an actuator protruding from the tip; and

a controller accommodated by the body, said controller being configured;

to condition electrically the attenuating portion between differing levels of transparency while said switch is actuated; and

to switch the attenuating portion between two or more differing levels of transparency in response to said actuator being pushed into said tip as a result of contact between said tip and said surface.

2. The pen tool of claim 1, wherein the variable reflector is positioned adjacent the tip.

3. The pen tool of claim 1, wherein the attenuating portion comprises a liquid crystal device.

4. The pen tool of claim 3, wherein the liquid crystal device comprises a polymer dispersed liquid crystal film positioned in an annular region between coaxial electrodes.

5. The pen tool of claim 1, wherein the transparency of the attenuating portion is proportional to an applied voltage.

6. The pen tool of claim 1, wherein the variable reflector further comprises a protective outer portion.

7. The pen tool of claim 1, wherein said switch comprises an actuator protruding from the tip, the controller being configured to switch the attenuating portion between two or more differing levels of transparency in response to said actuator being pushed into said tip as a result of contact between said tip and said surface.

8. The pen tool of claim 7, further comprising a switch arrangement on said body in communication with the controller for selecting the differing levels of transparency.

9. The pen tool of claim 8 wherein said switch arrangement comprises a plurality of switch positions, each switch position being associated with a different pattern of transparency levels.

10. The pen tool of claim 1, wherein the reflecting portion comprises a retro-reflective material.

11. The pen tool of claim 10, wherein the attenuating portion covers only a portion of the retro-reflective material.

12. The pen tool of claim 1 wherein said variable reflector is a layered structure adjacent said tip comprising an inner reflective layer over which an attenuating layer is disposed.

13. The pen tool of claim 12 wherein said attenuating layer either fully or partially covers said reflective layer.

14. The pen tool of claim 13 wherein said reflective layer is formed of retro-reflecting material.

15. The pen tool of claim 1, further comprising a switch arrangement on said body in communication with the controller for selecting the differing levels of transparency.

16. The pen tool of claim 1, wherein controlling the amount of illumination impinging on the reflecting portion alters the transparency of the attenuating portion.

17. An interactive input system comprising:

at least one imaging assembly having a field of view aimed into a region of interest and configured to capture image frames;

at least one illumination source configured to emit illumination into said region of interest;

at least one pointer, the pointer comprising;

an actuatable tip comprising a reflecting portion and an attenuating portion, the attenuating portion being fixedly disposed on the reflecting portion, the attenuating portion of the tip being modulated between differing levels of transparency when the pointer is in contact with a surface within the region of interest with sufficient force to actuate the tip;

a switch adjacent said tip and configured to actuate when said tip is brought into contact with a surface in said region of interest, wherein said switch comprises an actuator protruding from the tip; and

a controller accommodated by a body of the pointer, said controller configured;

to condition electrically the attenuating portion between differing levels of transparency while said switch is actuated; and

to switch the attenuating portion between two or more differing levels of transparency in response to said actuator being pushed into said tip as a result of contact between said tip and said surface; and

processing structure in communication with the at least one imaging assembly, when the pointer exists in captured image frames, said processing structure configured to demodulate the captured image frames to determine frequency components thereof and examine the frequency components to determine at least one attribute of said pointer, the frequency components being representative of illumination reflected by said pointer.

18. The interactive input system of claim 17, wherein during demodulating the processing structure is configured to apply a transform to the captured image frames.

19. The interactive input system of claim 17, wherein the illumination is infrared illumination.

20. The interactive input system of claim 17, wherein the attribute comprises at least one of pointer input colour, pointer input line thickness and pointer functionality.

21. The interactive input system of claim 20, wherein the pointer functionality is one of right mouse click, left mouse click, and eraser.

22. The interactive input system of claim 17, wherein the at least one imaging assembly is configured to capture a sequence of image frames, each sequence comprising one image frame captured when the at least one illumination source is in an off state and a plurality of image frames captured when the at least one illumination source is in an on state.

23. The interactive input system of claim 22, wherein said processing structure is configured to subtract the image frame captured when the at least one illumination source is in the off state from at least one image frame captured when the at least one illumination source is in the on state to form a difference image frame, and determine a location of the pointer in the difference image frame.

24. The interactive input system of claim 23, wherein said processing structure is further configured to define an analysis region associated with the pointer location, and apply the analysis region to the captured image frames for carrying out the examining.

25. The interactive input system of claim 17, wherein each imaging assembly comprises at least two light sensors having generally identical views of the region of interest and configured to capture the image frames, the at least two light sensors having exposure periods that are generally staggered.

26. The interactive input system of claim 17, further comprising a bezel at least partially surrounding the region of interest and having a surface in the field of view of said at least one imaging assembly.

27. A method of inputting information into an interactive input system comprising:

emitting illumination into a region of interest from at least one illumination source;

modulating the reflectivity of an actuatable tip of a pointer within the region of interest between differing levels of reflectivity while the pointer is in contact with a surface within the region of interest with sufficient force to actuate the tip, the tip comprising;

a reflecting portion;

an attenuating portion, the attenuating portion being fixedly disposed on the reflecting portion;

a switch adjacent said tip and configured to actuate when said tip is brought into contact with a surface in the region of interest, wherein said switch comprises an actuator protruding from the tip; and

a controller accommodated by the body, said controller being configured;

to condition electrically the attenuating portion between differing levels of transparency while said switch is actuated; and

to switch the attenuating portion between two or more differing levels of transparency in response to said actuator being pushed into said tip as a result of contact between said tip and said surface;

capturing image frames of the region of interest; and

when the pointer exists in captured image frames, demodulating the captured image frames to determine frequency components thereof and examining the frequency components to determine at least one attribute of the pointer, the frequency components being representative of illumination reflected by said pointer.

28. The method of claim 27, wherein the at least one illumination source is cycled between on and off states.

29. The method of claim 28, wherein the captured image frames comprise image frames captured during the on and off states of the at least one illumination source.

30. The method of claim 29, further comprising:

generating a difference image frame by subtracting an image frame captured in the off state from an image frame captured in the on state;

determining a location of the pointer in the difference image frame; and

defining an analysis region associated with the pointer location, wherein the examining is carried out within the analysis region applied to the captured image frames.

31. The method of claim 27, wherein the attribute is selected from the group consisting of pointer input colour, pointer input line thickness and pointer functionality.

32. The method of claim 31, wherein the pointer functionality one of right mouse click, left mouse click, and eraser.