Method and system for interacting with a display
First Claim
1. A system for interacting with displays and all devices that use such displays comprised of a. a display, b. a sensor or camera, c. a pointing device that can be registered by the sensor or camera, d. a method for detecting the pointing device, e. a method for establishing the mapping between the position of the pointing device and a corresponding location on the display.
1 Assignment
0 Petitions
Accused Products
Abstract
A novel visual method and system for interacting with displays and all devices that use such displays. The system has three hardware elements, which are a display, a light sensor or camera that can register the display image and the pointing device or its effect on the display, and a pointing device that can be registered by or produces recognizable characteristics that can be registered by the light sensor or camera. The system uses a set of methods as follows: a method for detecting the display, and the pointing device on or in relation to the display, a method for establishing the correspondence between the position of the pointing device in relation to the display as it is registered by the light sensor or camera and its position in relation to the computer or display device space, a method for correcting the offsets between the position of the pointing device or effect thereof on the display as observed by the user or by the light sensor or camera, and the position of the pointer on the computer or device display space, a method for selecting or highlighting a specific item or icon on the display, a method for activating a specific process, program, or menu item represented on the display, and a method for writing, scribing, drawing, highlighting, annotating, or otherwise producing marks on the display.
-
Citations
28 Claims
-
1. A system for interacting with displays and all devices that use such displays comprised of
a. a display, b. a sensor or camera, c. a pointing device that can be registered by the sensor or camera, d. a method for detecting the pointing device, e. a method for establishing the mapping between the position of the pointing device and a corresponding location on the display.
-
11. A method for detecting the pointing device comprising
a. retrieval of data or image from a sensor or camera, and b. analysis of the data or image from the sensor or camera to locate the pointing device in the data, or locating at least a set of the picture elements in the image that comprise the rendition of the pointing device.
-
17. A method for establishing the mapping between the set of positions that a pointing device can take and the set of corresponding locations on the display comprising:
-
a. defining the range of positions that the pointing device can assume, b. defining the boundaries of the range of positions that the pointing device can take with geometric representations, c. transforming the geometric representation of the arrangement of regions on the display so that it fits optimally into the boundaries of the range of positions that the pointing device can take. - View Dependent Claims (18, 19, 20, 21)
-
-
22. A method for detecting the display comprising
a. retrieval of data or image from a sensor or camera, and b. analysis of the data or image from the sensor or camera to locate the display in the data, or locating at least a set of the picture elements in the image that comprise the rendition of the display in the image.
Specification