Architecture for controlling a computer using hand gestures
First Claim
1. A system that facilitates a user interface, comprising:
- memory;
a tracking component configured to detect a first object within a scene and tracks the first object, detection of the first object based at least in part upon image comparison of a plurality of images relative to a course mapping of the images;
a seeding component configured to iteratively seed the tracking component with a set of object hypotheses based at least in part upon a presence of the first object and the image comparison; and
a filtering component configured to selectively remove a first object hypothesis from consideration based at least in part on a determination that the first object hypothesis has moved within a threshold distance of an other object hypothesis, the filtering component further configured to remove a second object hypothesis from consideration based at least in part on a motion threshold associated with an average movement over a window of time, wherein the second object hypothesis is removed from consideration when a duration of a pause in motion associated with the second object hypothesis exceeds an average time parameter.
1 Assignment
0 Petitions
Accused Products
Abstract
Architecture for implementing a perceptual user interface. The architecture comprises alternative modalities for controlling computer application programs and manipulating on-screen objects through hand gestures or a combination of hand gestures and verbal commands. The perceptual user interface system includes a tracking component that detects object characteristics of at least one of a plurality of objects within a scene, and tracks the respective object. Detection of object characteristics is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images. A seeding component iteratively seeds the tracking component with object hypotheses based upon the presence of the object characteristics and the image comparison. A filtering component selectively removes the tracked object from the object hypotheses and/or at least one object hypothesis from the set of object hypotheses based upon predetermined removal criteria.
297 Citations
15 Claims
-
1. A system that facilitates a user interface, comprising:
-
memory; a tracking component configured to detect a first object within a scene and tracks the first object, detection of the first object based at least in part upon image comparison of a plurality of images relative to a course mapping of the images; a seeding component configured to iteratively seed the tracking component with a set of object hypotheses based at least in part upon a presence of the first object and the image comparison; and a filtering component configured to selectively remove a first object hypothesis from consideration based at least in part on a determination that the first object hypothesis has moved within a threshold distance of an other object hypothesis, the filtering component further configured to remove a second object hypothesis from consideration based at least in part on a motion threshold associated with an average movement over a window of time, wherein the second object hypothesis is removed from consideration when a duration of a pause in motion associated with the second object hypothesis exceeds an average time parameter. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer readable storage medium that is not a signal and that stores instructions for performing a method to facilitate a user interface, the method comprising:
-
detecting a first object within a scene, wherein detection of the first object is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images; tracking the first object; seeding a set of object hypotheses based at least in part upon a presence of the first object and the image comparison; filtering the set of object hypotheses to remove a first object hypothesis from consideration based at least in part on a determination that the first object hypothesis has moved within a threshold distance of an other object hypothesis; and filtering the set of object hypotheses to remove a second object hypothesis from consideration based at least in part on a motion threshold associated with an average movement over a window of time, wherein the second object hypothesis is removed from consideration when a duration of a pause in motion associated with the second object hypothesis exceeds an average time parameter. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A method to facilitate a user interface, the method comprising:
-
detecting a first object within a scene, wherein detection of the first object is based at least in part upon image comparison of a plurality of images relative to a course mapping of the images; tracking the first object; seeding a set of object hypotheses based at least in part upon a presence of the first object and the image comparison; filtering the set of object hypotheses to remove a first object hypothesis from consideration based at least in part on a determination that the first object hypothesis has moved within a threshold distance of an other object hypothesis; and filtering the set of object hypotheses to remove a second object hypothesis from consideration based at least in part on a motion threshold associated with an average movement over a window of time, wherein the second object hypothesis is removed from consideration when a duration of a pause in motion associated with the second object hypothesis exceeds an average time parameter. - View Dependent Claims (12, 13, 14, 15)
-
Specification