BOUNDING BOX GESTURE RECOGNITION ON A TOUCH DETECTING INTERACTIVE DISPLAY
First Claim
1. In an interactive display, a method for identifying a specific user gesture comprising the steps of:
- displaying imagery on an imaging surface;
detecting a plurality of contact locations at which at least one user contacts a touch sensor to control said display;
responsive to a determination that a deformation of a bounding box enclosing at least two of said plurality of contacts locations exceeds a predetermined deformation threshold and responsive to a determination that a motion of said bounding box is less than a predetermined motion threshold, identifying said specific user gesture as a rotate gesture;
associating said specific user gesture with a display command; and
executing said display command to alter the display of said imagery.
4 Assignments
0 Petitions
Accused Products
Abstract
The invention provides a method and apparatus for identifying gestures performed by a user to control an interactive display. The gestures are identified based on a bounding box enclosing the points at which a user contacts a touch sensor corresponding with the display surface. The invention thus permits the use of inexpensive and highly reliable grid-based touch sensors that provide a bounding box to describe contact information. In identifying the gestures, the position, motion, shape, and deformation of the bounding box may all be considered. In particular, the center, width, height, aspect ratio, length of the diagonal, and orientation of the diagonal of the bounding box may be determined. A stretch factor, defined as the maximum of the ratio of the height of the bounding box to the width of the bounding box and the ratio of the width of the bounding box to the height of the bounding box, may also be computed. Finally, gestures may be identified based on the changes in time of these characteristics and quantities.
89 Citations
26 Claims
-
1. In an interactive display, a method for identifying a specific user gesture comprising the steps of:
-
displaying imagery on an imaging surface; detecting a plurality of contact locations at which at least one user contacts a touch sensor to control said display; responsive to a determination that a deformation of a bounding box enclosing at least two of said plurality of contacts locations exceeds a predetermined deformation threshold and responsive to a determination that a motion of said bounding box is less than a predetermined motion threshold, identifying said specific user gesture as a rotate gesture; associating said specific user gesture with a display command; and executing said display command to alter the display of said imagery. - View Dependent Claims (2, 3, 4)
-
-
5. In an interactive display, a method for identifying a specific user gesture comprising the steps of:
-
displaying imagery on an imaging surface; detecting a plurality of contact locations at which at least one user contacts a touch sensor to control said display; responsive to a determination that a stretch factor of a bounding box surrounding at least two of said contact locations exceeds a predetermined stretch threshold and responsive to a determination that said stretch factor is either increasing or decreasing, identifying said specific user gesture as a zoom gesture; associating said specific user gesture with a display command; and executing said display command to alter the display of said imagery. - View Dependent Claims (6, 7, 8)
-
-
9. In an interactive display, a method for identifying a specific user gesture comprising the steps of:
-
displaying imagery on an imaging surface; detecting a plurality of contact locations at which at least one user contacts a touch sensor to control said display; responsive to a determination that a motion of a bounding box enclosing at least two of said plurality of contact locations exceeds said predetermined motion threshold and that deformation of said bounding box is less than said predetermined deformation threshold, identifying said specific user gesture as a pan gesture; associating said specific user gesture with a display command; and executing said display command to alter the display of said imagery. - View Dependent Claims (10, 11, 12)
-
-
13. In an interactive display, a method for identifying a specific user gesture comprising the steps of:
-
displaying imagery on an imaging surface; detecting a plurality of contact locations at which at least one user contacts a touch sensor to control said display; responsive to a determination that a deformation of a bounding box enclosing at least two of said plurality of contacts locations exceeds a predetermined deformation threshold and responsive to a determination that a motion of said bounding box is less than a predetermined motion threshold, identifying said specific user gesture as a rotate gesture; responsive to a determination that a motion of said bounding box exceeds said predetermined motion threshold and that deformation of said bounding box is less than said predetermined deformation threshold, identifying said specific user gesture as a pan gesture; responsive to a determination that a stretch factor of said bounding box exceeds a predetermined stretch threshold and responsive to a determination that said stretch factor is either increasing or decreasing, identifying said specific user gesture as a zoom gesture; associating said specific user gesture with a display command; and executing said display command to alter the display of said imagery.
-
-
14. An interactive display comprising:
-
means for displaying imagery on an imaging surface; a touch sensor corresponding to said imaging surface; means for detecting a plurality of contact locations at which at least one user contacts said touch sensor to control said display; means for identifying a zoom gesture, comprising; means for determining if a stretch factor of a bounding box surrounding at least two of said contact locations is greater than a predetermined stretch threshold; and means for determining if said stretch factor is either increasing or decreasing; means for associating said zoom gesture with a corresponding display command; and means for executing said display command to alter the display of said imagery. - View Dependent Claims (15, 16)
-
-
17. An interactive display comprising:
-
means for displaying imagery on an imaging surface; a touch sensor corresponding to said imaging surface; means for detecting a plurality of contact locations at which at least one user contacts said touch sensor to control said display; means for identifying a rotate gesture, comprising; means for determining if a deformation of a bounding box surrounding at least two of said contact locations is greater than a predetermined deformation threshold; and means for determining if said motion of said bounding box is less than a predetermined threshold; means for associating said rotate gesture with a corresponding display command; and means for executing said display command to alter the display of said imagery. - View Dependent Claims (18, 19)
-
-
20. An interactive display comprising:
-
means for displaying imagery on an imaging surface; a touch sensor corresponding to said imaging surface; means for detecting a plurality of contact locations at which at least one user contacts said touch sensor to control said display; means for identifying a pan gesture, comprising; means for determining if a motion of a bounding box surrounding at least two of said contact locations is greater than a predetermined motion threshold; and means for determining if a deformation of said bounding box is less than a predetermined deformation threshold; means for associating said pan gesture with a corresponding display command; and means for executing said display command to alter the display of said imagery. - View Dependent Claims (21, 22)
-
-
23. An interactive display comprising:
-
means for displaying imagery on an imaging surface; a touch sensor corresponding to said imaging surface; means for detecting a plurality of contact locations at which at least one user contacts said touch sensor to control said display; means for identifying a specific user gesture based on a bounding box surrounding at least two of said contact locations comprising; means for identifying a pan gesture; means for identifying a zoom gesture; and means for identifying a rotate gesture; means for associating said specific user gesture with a corresponding display command; and means for executing said display command to alter the display of said imagery. - View Dependent Claims (24, 25, 26)
-
Specification