Visual input pointing device for interactive display system

• US 7,683,881 B2
• Filed: 05/24/2004
• Issued: 03/23/2010
• Est. Priority Date: 05/24/2004
• Status: Expired due to Fees

• Current Assignee: Keytec BV
• Original Assignee: Keytec BV
• Inventors: Sun, Brian Y., Chen, Jung Yu
• Primary Examiner(s): Hjerpe; Richard
• Assistant Examiner(s): Nguyen; Jennifer T
• Application Number:
  US10/852,303
• Publication Number:
  US 20050260986A1
• Time in Patent Office: 2,129 Days
• Field of Search: 345158-159, 345/157, 345/456, 345/169, 348/744, 348/807, 348/745
• US Class Current: 345/156
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: H04N 9/3179 Video signal processing therefor

Abstract

An interactive presentation system uses a presentation computer, a computer-controlled image projector and a projection screen, in which control of the presentation computer is accomplished by using a wireless optical pointer that projects an encoded control cursor onto the projection screen. The projected screen images are monitored by a video camera, and the control cursor is scanned, detected and decoded for emulating various keyboard commands and/or pointing device (mouse, touch pad, track ball) position-dependent cursor operations. The control cursor is reliably detected and its coordinate location is accurately determined on the basis of one or more primary image attributes, for example image intensity and image repetition rate, both of which are independent of monitoring angles and pointing device projection angles, and one or more secondary image attributes, for example image size, color and pattern. Neither of the primary attributes can be masked or obscured by the presence of background screen images or objects. Although the secondary attributes of the control cursor may be identical with the attributes of background images, reliable decoding of a computer command is assured since analysis and decoding of the secondary attributes are conditionally performed only after the control cursor image has been detected and captured (stored in memory for determination of coordinate location) on the basis of one or more of the independent attributes.

Claims

1. A computer presentation system for generating commands for remotely controlling a presentation computer based on a plurality of user selectable properties of an optical cursor generated by a hand-held pointer and projected onto a screen displaying output images projected onto the screen from the presentation computer, comprising in combination:

an optical projector coupled to the presentation computer for projecting images output from the computer onto the screen;

an optical pointer for projecting an image of a control cursor characterized by a primary image attribute, the primary image attribute being a predetermined image repetition rate and independent of control cursor projection angle limitations as well as presentation background image limitations, and the control cursor being characterized by one or more secondary image attributes, each secondary image attribute being encoded with a command corresponding to a specific computer operation, and the image properties of the primary image attribute and secondary image attributes are mutually exclusive with respect to each other;

a camera for capturing images projected onto the screen; and

an image processor connected in communication with the camera for processing the captured images to (a) detect the control cursor on the basis of the primary image attribute of the control cursor, (b) determine the position of the control cursor relative to output from the presentation computer, and (c) generate a command signal for output to the presentation computer based on one or more of the secondary image attributes, subject to the condition that the presence of the primary image attribute is detected in the image of the control cursor.

2. A computer presentation system as set forth in claim 1, wherein the control cursor is characterized by one or more secondary image attributes selected from the group consisting of image color, image size and image pattern.

3. A computer presentation system as set forth in claim 1, wherein the image processor includes control logic means for generating a command signal for output to the presentation computer based on one or more of the secondary image attributes only if the presence of the primary image attribute is detected in the control cursor.

4. A computer presentation system as set forth in claim 1, wherein the image processor includes control logic means for generating a command signal for output to the presentation computer based on a combination of the primary image attribute and one or more of the secondary image attributes.

5. A computer presentation system as set forth in claim 1, wherein the image processor includes pixel intensity differential means for detecting the presence of the primary image attribute of the control cursor image.

6. A computer presentation system as set forth in claim 1, wherein the image processor includes recognition software for decoding one or more of the secondary image attributes of the control cursor image.

7. A computer presentation system as set forth in claim 1, wherein the optical pointer comprises a hand-held pointer having a polychromatic light source operable for projecting a control cursor in the form of a light beam having the predetermined image repetition rate as the primary image attribute, and one or more user selectable image colors, sizes, or patterns as its secondary image attributes.

8. A computer presentation system as set forth in claim 7, wherein the optical pointer includes a rotary template having a set of apertures formed therein, the apertures having geometrical profiles through which polychromatic light can be directed for providing the secondary image attributes of shape, size, geometrical profile and pattern.

9. A computer presentation system as set forth in claim 7, wherein the optical pointer includes a rotary carousel having a set of color filters carried thereon, wherein the secondary image attribute of color is provided by projecting the polychromatic light beam through a selected one of the filters.

10. A method for remotely controlling a presentation computer that is coupled to an associated presentation screen for displaying output from the presentation computer and having an internal cursor generated by the presentation computer, the method comprising:

producing a control cursor image characterized by a primary image attribute, the primary image attribute being a predetermined image repetition rate and independent of control cursor projection angle limitations as well as presentation background image limitations, and the control cursor being characterized by one or more secondary image attributes, each secondary image attribute corresponding to a specific computer operation, and wherein the image properties of the primary image attribute and secondary image attributes are mutually exclusive with respect to each other;

detecting the primary image attribute of the control cursor and determining the position of the control cursor relative to output from the presentation computer;

detecting one or more of the secondary image attributes of the control cursor;

generating a command signal for output to the presentation computer based on one or more of the secondary image attributes; and

inputting the command signal to the presentation computer, subject to the condition that the presence of the primary image attribute is detected in the image of the control cursor.

11. The method of claim 10, including the step:

generating a command signal for output to the presentation computer based on the primary image attribute and one or more of the secondary image attributes.

12. The method of claim 10, comprising the steps:

capturing an image of the presentation screen and the control cursor with a camera;

processing the captured image to detect the presence of the primary image attribute in the image of the control cursor; and

processing the image of the control cursor to decode one or more of the secondary attributes and generating a command signal for output to the presentation computer based on one or more of the secondary image attributes, subject to the condition that the presence of the primary image attribute is detected in the image of the control cursor.

13. The method of claim 10, comprising the steps:

capturing an image of the presentation screen and the control cursor with a camera;

processing the captured image to detect the presence of the primary attribute in the image of the control cursor; and

processing the image of the control cursor to decode one or more of the secondary image attributes and generating a command signal for output to the presentation computer based on a combination of the primary image attribute and one or more of the secondary image attributes, subject to the condition that the presence of the attribute is detected in the image of the control cursor.

14. The method of claim 10 wherein the step of producing a control cursor comprises the step:

conforming the control cursor to one or more secondary image attributes selected from the group consisting of control image color, control image size and control image profile, shape or pattern.

15. The method of claim 14, wherein the control cursor is produced by an optical pointer that includes a rotary template having a set of apertures formed therein, the apertures having predetermined geometrical profiles, and the step of conforming the control cursor comprises projecting a beam of light through a selected one of the apertures to provide the secondary image attributes of shape, size, geometrical profile and pattern.

16. The method of claim 14, wherein the control cursor is produced by an optical pointer that includes a rotary carousel having a set of color filters disposed therein, and the step of conforming the control cursor comprises projecting a beam of light through a selected one of the color filters to provide the secondary image attribute of color.

17. A method for generating presentation computer commands based on cursor position and image attributes of a control cursor, the method comprising:

displaying output from a presentation computer on a presentation screen;

producing a control cursor having a primary image attribute and one or more secondary image attributes, wherein the primary image attribute and secondary image attributes are mutually exclusive with respect to each other, respectively, and the secondary attributes each being encoded to correspond to a specific computer operation, the primary image attribute being a predetermined image repetition rate;

displaying the control cursor on the presentation screen;

capturing an image of the screen display;

detecting the primary image attribute of the control cursor and determining the position of the control cursor relative to output from the presentation computer; and

processing the image of the control cursor to decode at least one of the secondary attributes subject to the condition that the presence of the primary image attribute is detected in the image of the control cursor; and

generating a command signal based on the position of the control cursor and the at least one secondary image attribute for output to the presentation computer for causing the internal cursor to move to the control cursor position.