METHOD AND APPARATUS CONTINUING ACTION OF USER GESTURES PERFORMED UPON A TOUCH SENSITIVE INTERACTIVE DISPLAY IN SIMULATION OF INERTIA

• US 20100318904A1
• Filed: 08/24/2010
• Published: 12/16/2010
• Est. Priority Date: 08/06/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: TOUCHTABLE, INC.
• Inventors: HILLIS, W. Daniel, Ferren, Bran
• Granted Patent: US 8,188,985 B2
• Time in Patent Office: Days
• US Class Current: 715/701
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method and apparatus for operating a multi-user interactive display system including a display having a touch-sensitive display surface. A position is detected of each contact site at which the display surface experiences external physical contact. Each contact site'"'"'s position history is utilized to compute velocity data for the respective contact site. At least one of the following is utilized to identify occurrence of one or more user gestures from a predetermined set of user gestures: the position history, the velocity data. Each user gesture corresponds to at least one predetermined action for updating imagery presented by the display as a whole. Action is commenced corresponding to the identified gesture. Responsive to a user gesture terminating with a nonzero velocity across the display surface, action is corresponding to the gesture is continued so as to simulate inertia imparted by said gesture.

Claims

1. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the method comprising the tasks of:

in the digital data storage, storing a record defining a collection of multiple user gestures executable by touching the display and for each user gesture storing an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display;

for each touch experienced by the display surface, the processor tracking a position history of the touch;

based on data including the position history of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the at least one prescribed operation assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified operation;

the processor using the position history to compute a final velocity for the executed gesture; and

responsive to the executed user gesture ending with a final velocity exceeding a prescribed minimum velocity across the display surface, the processor causing the display to continue the identified operation to visually simulate inertia of the executed user gesture.

6. The invention of claim 1 or 2 or 3, further comprising:

responsive to the executed user gesture ending with a final velocity not exceeding the prescribed minimum velocity across the display surface, the processor causing the display to cease the identified operation.

7. The invention of claim 1 or 2 or 3, where:

the tasks further comprise sensing a force exerted by one or more of the touches experienced by the display surface; and

the task of identifying at least one user gesture executed by the one or more touches is based on data including the position history of the one or more touches and the sensed force of the one or more touches.

8. The invention of claim 1 or 2 or 3, where:

the tasks further comprise sensing a force exerted by one or more of the touches experienced by the display surface;

the task of causing the display to begin modifying the subject matter presented by the display according to the identified operation comprises conducting the identified operations at speeds proportional to the sensed force.

9. The invention of claim 1 or 2 or 3, further responsive to a user gesture ending with a final velocity exceeding the prescribed minimum velocity, causing the display to slow the modification of subject matter presented by the display according to the identified operation, where the slowing occurs at a predetermined rate so as to simulate friction.

10. The invention of claim 1 or 2 or 3, the tasks further comprising:

responsive to the display surface experiencing a new touch while a previously identified operation is being continued to visually simulate inertia, slowing the modification of subject matter presented by the display according to the previously identified operation, where the slowing occurs at a predetermined rate so as to simulate friction.

11. The invention of claim 1 or 2 or 3, the tasks further comprising:

responsive to the display surface experiencing a new touch while a previously identified operation is being continued to visually simulate inertia, slowing the modification of subject matter presented by the display according to the previously identified operation, where the slowing occurs at a rate proportional to force exerted by the new touch.

12. The invention of claim 1 or 2 or 3, the tasks further comprising:

responsive to the display surface experiencing a new touch while a previously identified operation is being continued to visually simulate inertia, slowing the modification of subject matter presented by the display according to the previously identified operation, where the slowing occurs at a rate proportional to surface area of the new touch.

13. The invention of claim 1 or 2 or 3, the tasks further comprising:

responsive to the display surface experiencing a new touch while a previously identified operation is being continued to visually simulate inertia, the processor causing the display to cease the previously identified operation.

14. The invention of claim 1 or 2 or 3, where the prescribed minimum velocity is zero or a different predetermined finite amount.

15. The invention of claim 1 or 2 or 3, where:

the prescribed user gestures include a LAZY SUSAN user gesture comprising at least one point of user contact with the display surface traversing one of the following patterns;

an arc, a substantially straight line;

the prescribed operation associated with the LAZY SUSAN user gesture comprises rotating, as a whole, subject matter presented by the display about a predetermined point.

16. The invention of claim 1 or 2 or 3, where:

the prescribed user gestures include a PAN gesture comprising movement of at least one point of user contact with the display surface across at least a portion of the display surface;

the prescribed operation associated with the PAN gesture comprises translating, as a whole, subject matter presented by the display in a direction of the movement.

17. The invention of claim 1 or 2 or 3, where:

the prescribed user gestures include a ZOOM gesture comprising initiation of two points of user contact with the display surface and then an increase in distance between the points of user contact;

the prescribed operation associated with the ZOOM gesture comprises enlarging, as a whole, subject matter presented by the display.

18. The invention of claim 1 or 2 or 3, where:

the prescribed user gestures include a ROTATE gesture comprising an occurrence of two points of user contact with the display surface and then rotation of the points of user contact about a center of rotation;

the prescribed operation associated with the ROTATE gesture comprises rotating, as a whole, contents of the display about the center of rotation.

2. At least one non-transitory computer-readable storage medium containing a program of machine-readable instructions executable by a digital data processing machine to perform tasks for operating an interactive display system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, where the digital data storage contains a record defining a collection of multiple user gestures executable by touching the display and where the digital data storage further contains for each user gesture an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display, where the tasks comprise:

for each touch experienced by the display surface, the processor tracking a position history of the touch;

based on input including the position history of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the at least one prescribed operation assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified operation;

the processor using the position history to compute a final velocity for the executed gesture; and

responsive to the executed user gesture ending with a final velocity exceeding a prescribed minimum velocity across the display surface, the processor causing the display to continue the identified operation to visually simulate inertia of the executed user gesture.

3. Circuitry of multiple interconnected electrically conductive elements configured to perform tasks for operating an interactive display system including a processor coupled to a digital data storage and a display having a touch-sensitive display surface, where the digital data storage contains a record defining a collection of multiple user gestures executable by touching the display and where the digital data storage further contains for each user gesture an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display, the tasks comprising:

in the digital data storage, storing a record defining a collection of multiple user gestures executable by touching the display and for each user gesture storing an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display;

for each touch experienced by the display surface, the processor tracking a position history of the touch;

based on data including the position history of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the at least one prescribed operation assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified operation;

the processor using the position history to compute a final velocity for the executed gesture; and

responsive to the executed user gesture ending with a final velocity exceeding a prescribed minimum velocity across the display surface, the processor causing the display to continue the identified operation to visually simulate inertia of the executed user gesture.

4. An interactive display system, comprising:

a display having a touch-sensitive display surface;

digital data storage containing a record defining a collection of multiple user gestures executable by touching the display and for each user gesture an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display; and

a processor coupled to the display and the digital data storage, the processor programmed to perform tasks comprising;

for each touch experienced by the display surface, the processor tracking a position history of the touch;

based on data including the position history of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the at least one prescribed operation assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified operation;

the processor using the position history to compute a final velocity for the executed gesture; and

responsive to the executed user gesture ending with a final velocity exceeding a prescribed minimum velocity across the display surface, the processor causing the display to continue the identified operation to visually simulate inertia of the executed user gesture.

5. An interactive display system, comprising:

a display including a touch-sensitive display surface;

storage means for storing a record defining a collection of multiple user gestures executable by touching the display and for each user gesture storing an assignment of at least one of multiple prescribed operations of modifying subject matter presented by the display; and

processing means for performing tasks comprising;

for each touch experienced by the display surface, the processor tracking a position history of the touch;

based on data including the position history of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches;

the processor identifying the at least one prescribed operation assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified operation;

the processor using the position history to compute a final velocity for the executed gesture; and

responsive to the executed user gesture ending with a final velocity exceeding a prescribed minimum velocity across the display surface, the processor causing the display to continue the identified operation to visually simulate inertia of the executed user gesture.