VideoHarp
First Claim
1. A gesture sensing device for controlling the motion of mechanical objects or the generation of music or light comprising:
- a physical instrument and a gesture mapping means, the physical instrument comprising;
a plurality of gesture sensing surfaces joined along an edge;
a light source located along the joined edge which illuminates an area above each gesture sensing surface;
a reflective means for each gesture sensing surface located at an edge opposite the light source; and
a sensor aligned with the light source via the reflective means such that the sensor detects a pattern of light and shadow falling on it as a result of a plurality of light occluding objects being placed in a gesture sensing plane in close proximity to the gesture sensing surfaces and wherein the pattern of light is used by the gesture mapping means to generate a plurality of output signals for controlling the motion of mechanical objects or the generation of music or light.
1 Assignment
0 Petitions
Accused Products
Abstract
The VideoHarp is an optical-scanning device for sensing and tracking the movement of multiple fingers which is then used to control the generation of light or sound or to control the motion of other physical objects. Preferably, the VideoHarp detects the images of a performer'"'"'s fingertips using a single sensor. From these images, the movement of each fingertip is tracked and this information is translated into a standard output, which is preferably used to control a device which generates sound or light. The translation of the finger motion into control signals is programmable, enabling the VideoHarp to be played using a variety of different types of motions and gestures. For example, the VideoHarp may be played with harp-like or keyboard like gestures, by bowing or drumming motions, or even by gestures and motions with no analogue in existing instrument techniques.
263 Citations
13 Claims
-
1. A gesture sensing device for controlling the motion of mechanical objects or the generation of music or light comprising:
- a physical instrument and a gesture mapping means, the physical instrument comprising;
a plurality of gesture sensing surfaces joined along an edge;
a light source located along the joined edge which illuminates an area above each gesture sensing surface;
a reflective means for each gesture sensing surface located at an edge opposite the light source; and
a sensor aligned with the light source via the reflective means such that the sensor detects a pattern of light and shadow falling on it as a result of a plurality of light occluding objects being placed in a gesture sensing plane in close proximity to the gesture sensing surfaces and wherein the pattern of light is used by the gesture mapping means to generate a plurality of output signals for controlling the motion of mechanical objects or the generation of music or light. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
- a physical instrument and a gesture mapping means, the physical instrument comprising;
Specification