Method for remote computer operation via a wireless optical device

• US 6,704,000 B2
• Filed: 11/15/2001
• Issued: 03/09/2004
• Est. Priority Date: 11/15/2000
• Status: Expired due to Fees

• Current Assignee: Blue IRIS Technologies
• Original Assignee: Blue IRIS Technologies
• Inventors: Carpenter, Jeffrey Scott
• Primary Examiner(s): WU, XIAO MIN
• Application Number:
  US10/002,052
• Publication Number:
  US 20020089489A1
• Time in Patent Office: 845 Days
• Field of Search: 345/156, 345/157, 345/158, 345/163, 345/168, 345/169, 348/744, 348/745, 348/746, 348/747
• US Class Current: 345/158
• CPC Class Codes: G06F 3/0386 for light pen

Abstract

A method for remote operation of a computer having a cursor, via a wireless optical device, comprising projecting a computer output display onto a projection surface via a projecting means, generating an optical point at a desired cursor position on the projected image via the wireless optical device, capturing the image and optical point and transmitting this data to the computer, positioning the cursor on the projected image within a predefined distance of the position of the optical point, measuring a dwell time and executing a computer command when the dwell time exceeds a predefined length of time. The invention may also comprise the step of performing a calibration process to correct imperfections that can occur in the captured or projected image.

Claims

1. A method for remote operation of a computer having a cursor, via a wireless optical device, comprising:

a. projecting an image onto a projection surface via a projecting means, the projected image comprising an output display of the computer and the output display showing the cursor;

b. generating an optical point at a desired cursor position on the projected image via the wireless optical device;

c. capturing a captured image via an image sensing device, the captured image comprising the projected image and the optical point;

d. transmitting the captured image to the computer;

positioning the cursor on the projected image within a predefined distance of the desired cursor position;

f. measuring a dwell time, the dwell time comprising a time period during which the optical point is positioned within a predefined distance of the desired cursor position; and

g. automatically executing at least one computer command when the dwell time exceeds a predefined time length, the at least one computer command comprising a command selected from the group consisting of a single left-mouse-click a double left-mouse-click, a right-mouse-click, a mouse command or a keyboard command.

2. The method of claim 1, wherein the predefined time length is selectable by a user.

3. The method of claim 1, further comprising, after the step of projecting an image and before the step of generating an optical point at a desired cursor position, performing a calibration process.

4. The method of claim 3, wherein performing the calibration process comprises the steps:

i) generating the optical point via the wireless optical device, within a predefined distance about each of at least four single points on the projected image, during a calibration period, each calibration period comprising a predefined calibration time;

ii) capturing a captured image via the image sensing device during each calibration period, the captured image comprising the projected image and optical point;

iii) detecting the optical point at a calibration position, during each calibration period, each calibration position comprising a coordinate of the captured image;

iv) calculating a plurality of control positions equal in number to the plurality of calibration positions, each control position comprising a coordinate of the output display;

v) submitting each control position and each calibration position to a matrix creation means; and

vi) calculating via the matrix creation means at least one matrix, each matrix capable of solving for at least eight degrees of freedom.

5. The method of claim 4, further comprising, after the step of transmitting the captured image to the computer and before the step of positioning the cursor, the step of translating each point in the captured image to a point in the projected image, via the at least one matrix.

6. The method of claim 5, wherein the plurality of control positions comprises four corners of the projected image.

7. The method of claim 5, wherein the plurality of control positions comprises four corners of the projected image, four points midway between each pair of corners of the projected image, and a center point of the projected image.

8. The method of claim 5, wherein a number of control positions and the position of each control position are selectable by a user.

9. The method of claim 1, wherein a center point of the projection surface occupies a plane;

and

the image sensing device is positioned to face the plane from an angle between thirty and ninety degrees, the angle measured in at least one direction relative to the plane.

10. The method of claim 9, further comprising, after the step of projecting an image and before the step of generating an optical point:

at a desired cursor position, performing a calibration process.

11. The method of claim 10, wherein performing the calibration process comprises the steps:

i) generating the optical point via the wireless optical device, within a predefined distance about each of at least four single points on the projected image, during a calibration period, each calibration period comprising a predefined calibration tune;

ii) capturing a captured image via the image sensing device during each calibration period, the captured image comprising the projected image and optical point;

iii) detecting the optical point at a calibration position, during each calibration period, each calibration position comprising a coordinate of the captured image;

iv) calculating a plurality of control positions equal in number to the plurality of calibration positions, each control position comprising a coordinate of the output display;

v) submitting each control position and each calibration position to a matrix creation means; and

vi) calculating via the matrix creation means at least one matrix, each matrix capable of solving for at least eight degrees of freedom.

12. The method of claim 11, further comprising, after the step of transmitting the captured image to the computer and before the step of positioning the cursor, the step of translating each point in the captured image to a point in the projected image, via the at least one matrix.

13. The method of claim 12, wherein the plurality of control positions comprises four corners of the projected image.

14. The method of claim 12, wherein the plurality of control positions comprises four corners of the projected image, four points midway between each pair of corners of the projected image, and a center point of the projected image.

15.The method of claim 12, wherein a number of control positions and the position of each control position are selectable by a user.

15. The method of claim 1, wherein the cursor comprises a mouse pointer.

16. A method for remote operation of a computer having a cursor, via a wireless optical device, comprising:

a. projecting an image onto a projection surface via a projecting means, the projected image comprising an output display of the computer and the output display showing the cursor;

b. performing a calibration process, comprising

i) generating the optical point via the wireless optical device, within a predefined distance about each of at least four single points on the projected image, during a calibration period, each calibration period comprising a predefined calibration time;

ii) capturing a set-up captured image via an image sensing device during each calibration period, the set-up captured image comprising the projected image and the optical point;

iii) detecting the optical point at a calibration position, during each calibration period, each calibration position comprising a coordinate of the captured image;

iv) calculating a plurality of control positions equal in number to the plurality of calibration positions, each control position comprising a coordinate of the output display;

v) submitting each control position and each calibration position to a matrix creation means; and

vi) calculating via the matrix creation means at least one matrix, each matrix capable of solving for at least eight degrees of freedom;

c. generating an optical point at a desired cursor position on the projected image via the wireless optical device;

d. capturing a run-time captured image via the image sensing device, the captured image comprising the projected image and the optical point;

e. transmitting the nm-time captured image to the computer;

f. translating each point in the run-time captured image to a point in the projected image, via the at least one matrix;

g. positioning the cursor on the projected image within a predefined distance of the position of the optical point;

h. measuring a dwell time, the dwell time comprising a time period during which the optical point is positioned within a predefined distance of the desired cursor position; and

i. executing a computer command when the dwell time exceeds a predefined time length.

17. The method of claim 17, wherein the predefined time length is selectable by a user.

18. The method of claim 17, wherein the plurality of control positions comprises four corners of the projected image.

19. The method of claim 17, wherein the plurality of control positions comprises four corners of the projected image, four points midway between each pair of corners of the projected image, and a center point of the projected image.

20. The method of claim 17, wherein a number of control positions and the position of each control position are selectable by a user.

22. The method of claim 17, wherein the cursor comprises a mouse pointer.

23. The method of claim 17, wherein the at least one computer command comprises a command selected from the group consisting of a single left-mouse-click, a double left-mouse-click, a right-mouse-click, a mouse command, or a keyboard command.

21. The method of claim 21, wherein

a center point of the projection surface occupies a plane;

and

the image sensing device is positioned to face the plane from an angle between thirty and ninety degrees, the angle measured in at least one direction relative to the plane.

24. A computer readable storage medium having stored data representing functions executable by a computer to execute commands and position a cursor of the computer, based on an optical point generated onto a projected image by a wireless optical device, the functions comprising:

measuring a dwell time, the dwell time comprising a rime period during which the optical point is positioned within a predefined distance of a single point on the projected image; and

automatically executing a computer command when the dwell time exceeds a predefined time length, the at least one computer command comprising a command selected from the group consisting of a single left-mouse-click, a double left-mouse-click, a right-mouse-dick, a mouse command, or a keyboard command.

25. A computer readable storage medium having stored data representing functions executable by a computer to execute commands and position a cursor of the computer, based on an optical point generated onto a projected image by a wireless optical device, the functions comprising:

performing a calibration process comprising

i) a user selecting a number of control positions, and a position for each control position;

ii) the user generating the optical point via the wireless optical device, within a predefined distance about each of at least four single points on the projected image, during a calibration period, each calibration period comprising a predefined calibration time;

iii) capturing a captured image via an image sensing device during each calibration period, the captured image comprising the projected image and optical point;

iv) detecting the optical point at a calibration position, during each calibration period, each calibration position comprising a coordinate of the captured image;

v) calculating a plurality of control positions equal in number to the plurality of calibration positions, each control position comprising a coordinate of the output display;

vi) submitting each control position and each calibration position to a matrix creation means; and

vii) calculating via the matrix creation means at least one matrix, each matrix capable of solving for at least eight degrees of freedom;

measuring a dwell time, the dwell time comprising a time period during which the optical point is positioned within a predefined distance of a single point on the projected image; and

executing a computer command when the dwell time exceeds a predefined time length, the time length selectable by a user.