Method and apparatus continuing action of user gestures performed upon a touch sensitive interactive display in simulation of inertia

• US 8,665,239 B2
• Filed: 11/27/2012
• Issued: 03/04/2014
• Est. Priority Date: 08/06/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hillis, W. Daniel, Ferren, Bran
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US13/686,692
• Publication Number:
  US 20130082967A1
• Time in Patent Office: 462 Days
• Field of Search: 345156-158, 345173-179, 178 1801- 1804, 178 1901- 1903, 715/863
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method and apparatus for identifying user gestures to control an interactive display identifies gestures based on a bounding box enclosing points at which a user contacts a touch sensor corresponding with the display surface and permits use of inexpensive and highly reliable grid-based touch sensors that provide a bounding box to describe contact information. In identifying gestures, position, motion, shape, and deformation of the bounding box may be considered. Center, width, height, aspect ratio, length and orientation of the bounding box diagonal may be determined. A stretch factor, defined as the maximum of the ratio of the height of the bounding box to the width of the bounding box and the ratio of the width of the bounding box to the height of the bounding box, may also be computed. Gestures may be identified based on the changes in time of these characteristics and quantities.

Claims

1. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the method comprising the tasks of:

in the digital data storage, storing a record defining a collection of multiple user gestures, each user gesture executable by touching the display, and further storing for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display;

for each of one or more touches experienced by the display surface, the processor determining the magnitude of the touch upon the display surface;

based on one or more prescribed properties of the one or more touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations; and

where the tasks are further performed according to any or both of;

(1) the identification of the executed user gesture is performed based on properties including the determined magnitude of the one or more touches;

(2) as to the manner in which the subject matter presented by the display is modified according to the identified one or more operations, said manner is further responsive to the determined magnitude of the one or more touches.

2. The method of claim 1, wherein said magnitude comprises any of:

a current length,

a current area,

a current intensity,

a current force,

a length history,

an area history,

an intensity history, and

a force history.

3. At least one non-transitory computer-readable storage medium containing a program of machine-readable instructions executable by a digital data processing machine to perform tasks for operating an interactive display system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, where the digital data storage contains a record defining a collection of one or more user gestures, each user gesture executable by touching the display, and where the digital data storage further contains for each user gesture an assignment of one or more prescribed operations of modifying subject matter presented by the display, where the tasks comprise:

for each of one or more touches experienced by the display surface, the processor determining the magnitude of the touch upon the display surface;

based on one or more prescribed properties of the one or more touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations; and

where the tasks are further performed according to any or both of;

(1) the identification of the executed user gesture is performed based on properties including the determined magnitude of the one or more touches;

(2) as to the manner in which the subject matter presented by the display is modified according to the identified one or more operations, said manner is further responsive to the determined magnitude of the one or more touches.

4. The method of claim 3, wherein said magnitude comprises any of:

a current length,

a current area,

a current intensity,

a current force,

a length history,

an area history,

an intensity history, and

a force history.