Method for interacting a pointing device with a target point arranged on a projection screen of a virtual desktop and pointing device therefore

• US 10,678,346 B2
• Filed: 04/25/2019
• Issued: 06/09/2020
• Est. Priority Date: 04/30/2018
• Status: Active Grant

• Current Assignee: Oliver Horst Rode
• Original Assignee: Oliver Horst Rode
• Inventors: Rode, Oliver Horst
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US16/394,696
• Publication Number:
  US 20190332192A1
• Time in Patent Office: 411 Days
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A pointing device interacts with a target point arranged on a projection surface of a virtual desktop and a pointing device. A spatial coordinate of a target point may be determined by means of an image processing system from a two-dimensional optical code applied to a carrier plane associated with the pointing device, and may be transmitted as a control variable to a control unit of the projection surface. A spatial position of a normal vector perpendicular to the center of gravity of the surface of the code may be determined. The normal vector may be aligned with the target point by shifting and tilting the carrier plane. A rotational movement of the carrier plane about an axis of rotation perpendicular to the carrier plane may be detected, and an activation signal of the pointing device may be generated as a function of a detected rotational movement.

Claims

1. A method interacting a pointing device with a target point located on a projection surface of a virtual desktop, the method comprising:

determining a spatial position of a normal vector perpendicular to a centroid of an area of a two-dimensional optical code applied to a plane of a carrier medium;

aligning the normal vector to the target point by shifting and tilting the plane;

detecting a rotational movement of the plane about an axis of rotation perpendicular to the plane;

generating a first activation signal of the pointing device from the detected rotational movement; and

transmitting the first activation signal as a control variable to a control unit controlling the projection surface.

2. The method of claim 1, wherein the control variable is used by the control unit to perform at least one of the following:

mark a target point on the projection surface;

open a context menu logically linked to the target point; and

launch an application logically linked to the target point.

3. The method according to claim 1, further comprising:

sensing a direction of the rotational movement of the plane about the axis of rotation perpendicular to the plane; and

generating one or more second activation signals of the pointing device from the sensed direction of movement.

4. The method according to claim 3, further comprising:

transmitting the one or more second activation signals as one or more control variables to the control unit.

5. The method of claim 1, wherein a camera detects the rotational movement.

6. A pointing device for interacting with a target point located on a projection surface of a virtual desktop, the system comprising:

an image processing device that determines a spatial position of a normal vector perpendicular to a centroid of an area of a two-dimensional optical code applied to a plane of a carrier medium, aligns the normal vector to the target point by shifting and tilting the plane, and detects a rotational movement of the plane about an axis of rotation perpendicular to the plane, and

one or more control components that generate a first activation signal of the pointing device from the detected rotational movement, and control transmitting the first activation signal as a control variable to a control unit controlling the projection surface.

7. The pointing device of claim 6, wherein the control variable is used by the control unit to perform at least one of the following:

mark a target point on the projection surface;

open a context menu logically linked to the target point; and

launch an application logically linked to the target point.

8. The pointing device according to claim 6, wherein the image processing device senses a direction of the rotational movement of the plane about the axis of rotation perpendicular to the plane, and

wherein the one or more control components generate one or more second activation signals of the pointing device from the sensed direction of movement.

9. The pointing device according to claim 8, wherein the one or more control components control transmitting the one or more second activation signals as one or more control variables to the control unit.

10. The pointing device of claim 6, wherein the image processing device includes a camera that detects the rotational movement.