TOUCH DETECTING INTERACTIVE DISPLAY BACKGROUND
First Claim
1. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the display surface including a material layer with at least one optical property that changes responsive to pressure applied to the material layer, the method comprising the tasks of:
- in the digital data storage, storing a record defining a collection of multiple user gestures, each gesture executable by touching the display, and further storing for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display;
the processor performing visual analysis of the material layer;
for each of one or more touches experienced by the display surface, the processor using input including at least the visual analysis to track a position history of the touch;
the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches, the identifying being performed based at least in part upon the position history of the one or more of the touches experienced by the display surface; and
the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations.
4 Assignments
0 Petitions
Accused Products
Abstract
The invention provides an interactive display that is controlled by user gestures identified on a touch detecting display surface. In the preferred embodiment of the invention, imagery is projected onto a horizontal projection surface from a projector located above the projection surface. The locations where a user contacts the projection surface are detected using a set of infrared emitters and receivers arrayed around the perimeter of the projection surface. For each contact location, a computer software application stores a history of contact position information and, from the position history, determines a velocity for each contact location. Based upon the position history and the velocity information, gestures are identified. The identified gestures are associated with display commands that are executed to update the displayed imagery accordingly. Thus, the invention enables users to control the display through direct physical interaction with the imagery.
-
Citations
15 Claims
-
1. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the display surface including a material layer with at least one optical property that changes responsive to pressure applied to the material layer, the method comprising the tasks of:
-
in the digital data storage, storing a record defining a collection of multiple user gestures, each gesture executable by touching the display, and further storing for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display; the processor performing visual analysis of the material layer; for each of one or more touches experienced by the display surface, the processor using input including at least the visual analysis to track a position history of the touch; the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches, the identifying being performed based at least in part upon the position history of the one or more of the touches experienced by the display surface; and the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations. - View Dependent Claims (10, 11, 12, 13)
-
-
2. At least one non-transitory computer-readable storage medium containing a program of machine-readable instructions executable by a digital data processing machine to perform tasks for operating an interactive display system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the display surface including a material layer with at least one optical property that changes responsive to pressure applied to the material layer, where the digital data storage contains a record defining a collection of multiple user gestures, each user gesture executable by touching the display, and where the digital data storage further contains for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display, where the tasks comprise:
-
the processor performing visual analysis of the material layer; for each of one or more touches experienced by the display surface, the processor using input including at least the visual analysis to track a position history of the touch; the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches, the identifying being performed based at least in part upon the position history of the one or more of the touches experienced by the display surface; and the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations.
-
-
3. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the method comprising the tasks of:
-
in the digital data storage, storing a record defining a collection of multiple user gestures, each user gesture executable by touching the display, and further storing for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display; for each of one or more touches experienced by the display surface, the processor determining a force exerted by the touch upon the display surface; based on one or more prescribed properties of the one or more touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches; the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations; and where the tasks are further performed according to any or both of; (1) the identification of the executed user gesture is performed based on properties including the determined force of the one or more touches; (2) as to the manner in which the subject matter presented by the display is modified according to the identified one or more operations, said manner is further responsive to the determined force of the one or more touches. - View Dependent Claims (5, 6, 7)
-
-
4. At least one non-transitory computer-readable storage medium containing a program of machine-readable instructions executable by a digital data processing machine to perform tasks for operating an interactive display system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, where the digital data storage contains a record defining a collection of one or more user gestures, each user gesture executable by touching the display, and where the digital data storage further contains for each user gesture an assignment of one or more prescribed operations of modifying subject matter presented by the display, where the tasks comprise:
-
for each of one or more touches experienced by the display surface, the processor determining a force exerted by the touch upon the display surface; based on one or more prescribed properties of the one or more touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches; the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to modify the subject matter presented by the display according to the identified one or more operations; and where the tasks are further performed according to any or both of; (1) the identification of the executed user gesture is performed based on properties including the determined force of the one or more touches; (2) as to the manner in which the subject matter presented by the display is modified according to the identified one or more operations, said manner is further responsive to the determined force of the one or more touches.
-
-
8. A computer implemented method performed in a system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, the method comprising the tasks of:
-
in the digital data storage, storing a record defining a collection of one or more user gestures, each user gesture executable by touching the display, and further storing for each user gesture an assignment of one or more prescribed operations of modifying subject matter presented by the display; the processor causing the display to present subject matter including a representation of at least one control interface or menu positioned proximate to and oriented towards a first location on a periphery of the display surface; for each touch experienced by the display surface, the processor determining a position of the touch; based on data including the determined position or a history of the determined position of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches; the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified one or more operations; where the at least one executed user gesture includes a first gesture, and the identified one or more prescribed operations includes a first operation assigned to the first gesture, and where the first operation causes the display to effect a movement and reorientation of the control interface or menu proximate to and oriented towards a second location on the periphery of the display surface, the second location being different than the first location. - View Dependent Claims (14, 15)
-
-
9. At least one non-transitory computer-readable storage medium containing a program of machine-readable instructions executable by a digital data processing machine to perform tasks for operating an interactive display system including a processor coupled to digital data storage and a display having a touch-sensitive display surface, where the digital data storage contains a record defining a collection of multiple user gestures, each user gesture executable by touching the display;
- and where the digital data storage further contains for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display, where the tasks comprise;
the processor causing the display to present subject matter including a representation of at least one control interface or menu positioned proximate to and oriented towards a first location on a periphery of the display surface; for each touch experienced by the display surface, the processor determining a position of the touch; based on data including the determined position or a history of the determined position of one or more of the touches experienced by the display surface, the processor identifying from the collection of user gestures at least one user gesture executed by the one or more touches; the processor identifying the one or more prescribed operations assigned to the executed user gesture, and causing the display to begin modifying the subject matter presented by the display according to the identified one or more operations; where the at least one executed user gesture includes a first gesture, and the identified one or more prescribed operations includes a first operation assigned to the first gesture, and where the first operation causes the display to effect a movement and reorientation of the control interface or menu proximate to and oriented towards a second location on the periphery of the display surface, the second location being different than the first location.
- and where the digital data storage further contains for each user gesture an assignment of one or more of multiple prescribed operations of modifying subject matter presented by the display, where the tasks comprise;
Specification