Allocating control among inputs concurrently engaging an object displayed on a multi-touch device
First Claim
Patent Images
1. A computer-implemented method for allocating control to a user input device when multiple user input devices are engaging an object displayed on a multi-touch display device, the method comprising:
- displaying an object on a display component of a multi-touch display device;
determining that a first user input device is engaging a surface of the multi-touch display device;
as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device;
determining that a second user input device is engaging the surface of the multi-touch display device;
as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device;
determining that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object;
as a consequence of having determined that the first user input device and the second user input device concurrently are engaging positions on the surface of the multi-touch display device that correspond to points within the displayed object, determining to allocate control of the displayed object to the first user input device but not the second user input device;
after allocating control of the displayed object to the first user input device and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device and tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, determining that the first user input device moved to a third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device while the second user input device concurrently moved to a fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device; and
as a consequence of having determined that the first user input device moved to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the first user input device, translating the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device, wherein the translation of the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device is not influenced by the determined movement of the second user input device to the fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device,wherein determining to allocate control of the displayed object to the first user input device but not the second user input device includes;
sensing a relative amount of pressure with which the first user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object;
sensing a relative amount of pressure with which the second user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displaced object;
comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device;
based on results of comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device, determining that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; and
allocating control of the displayed object to the first user input device but not the second user input device as a consequence of having determined that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device.
3 Assignments
0 Petitions
Accused Products
Abstract
A multi-touch display device is configured to enable control of a displayed object by less than all of the input mechanisms determined to be engaging the displayed object at the same time.
135 Citations
11 Claims
-
1. A computer-implemented method for allocating control to a user input device when multiple user input devices are engaging an object displayed on a multi-touch display device, the method comprising:
-
displaying an object on a display component of a multi-touch display device; determining that a first user input device is engaging a surface of the multi-touch display device; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device; determining that a second user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device; determining that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object; as a consequence of having determined that the first user input device and the second user input device concurrently are engaging positions on the surface of the multi-touch display device that correspond to points within the displayed object, determining to allocate control of the displayed object to the first user input device but not the second user input device; after allocating control of the displayed object to the first user input device and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device and tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, determining that the first user input device moved to a third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device while the second user input device concurrently moved to a fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device; and as a consequence of having determined that the first user input device moved to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the first user input device, translating the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device, wherein the translation of the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device is not influenced by the determined movement of the second user input device to the fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device, wherein determining to allocate control of the displayed object to the first user input device but not the second user input device includes; sensing a relative amount of pressure with which the first user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object; sensing a relative amount of pressure with which the second user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displaced object; comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; based on results of comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device, determining that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; and allocating control of the displayed object to the first user input device but not the second user input device as a consequence of having determined that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device. - View Dependent Claims (2, 3, 4)
-
-
5. A computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to:
-
display an object on a display component of a multi-touch display device; determine that a first user input device is engaging a surface of the multi-touch display device; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, track movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device; determine that a second user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, track movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device; determine that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object; as a consequence of having determined that the first user input device and the second user input device concurrently are engaging positions on the surface of the multi-touch display device that correspond to points within the displayed object, determine to allocate control of the displayed object to the first user input device but not the second user input device; after allocating control of the displayed object to the first user input device and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device and tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, determine that the first user input device moved to a third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device while the second user input device concurrently moved to a fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device; and as a consequence of having determined that the first user input device moved to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the first user input device, translate the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device, wherein the translation of the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device is not influenced by the determined movement of the second user input device to the fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device, wherein the instructions that, when executed by a processor, cause the processor to allocate control of the displayed object to the first user input device but not the second user input device include instructions that, when executed by a processor, cause the processor to; sense a relative amount of pressure with which the first user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object; sense a relative amount of pressure with which the second user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object; compare the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; based on results of comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device, determine that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; and allocate control of the displayed object to the first user input device but not the second user input device as a consequence of having determined that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device. - View Dependent Claims (6, 7)
-
-
8. A multi-touch display device comprising:
-
a display component configured to render a visual output display; a touch-sensitive sensing system configured to determine that one or more user input devices are engaging a surface of the multi-touch display device; and a computing system configured to; display an object on the display component of a multi-touch display device; determine that a first user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, track movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device; determine that a second user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, track movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device; determine that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object; as a consequence of having determined that the first user input device and the second user input device concurrently are engaging positions on the surface of the multi-touch display device that correspond to points within the displayed object, determine to allocate control of the displayed object to the first user input device but not the second user input device; after allocating control of the displayed object to the first user input device and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device and tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, determine that the first user input device moved to a third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device while the second user input device concurrently moved to a fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device; and as a consequence of having determined that the first user input device moved to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the first user input device, translate the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device, wherein the translation of the displayed object about the display component of the multi-touch display device as a function of the determined movement of the first user input device to the third position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device is not influenced by the determined movement of the second user input device to the fourth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device, wherein the computing system configured to allocate control of the displayed object to the first user input device but not the second user input device includes a computing system configured to; sense a relative amount of pressure with which the first user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object; sense a relative amount of pressure with which the second user input device is engaging the surface of the multi-touch display device while the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object and the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displaced object; compare the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; based on results of comparing the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device to the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device, determine that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device; and allocate control of the displayed object to the first user input device but not the second user input device as a consequence of having determined that the relative amount of pressure with which the first user input device is sensed to be engaging the surface of the multi-touch display device is greater than the relative amount of pressure with which the second user input device is sensed to be engaging the surface of the multi-touch display device. - View Dependent Claims (9)
-
-
10. A computer-implemented method for allocating control to user input devices when multiple user input devices are engaging an object displayed on a multi-touch display device, the method comprising:
-
displaying an object on a display component of a multi-touch display device; determining that a first user input device is engaging a surface of the multi-touch display device; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device; determining that a second user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device; determining that a third user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the third user input device is engaging the surface of the multi-touch display device, tracking movements of the third user input device while the third user input device continues to engage the surface of the multi-touch display device; determining that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object and while the third user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a third position that corresponds to a third point within the displayed object; determining that the first user input device first engaged the first position on the surface of the multi-touch display device that corresponds to the first point within the displayed object at a first point in time; determining that the second user input device first engaged the second position on the surface of the multi-touch display device that corresponds to the second point within the displayed object at a second point in time; determining that the third user input device first engaged the third position on the surface of the multi-touch display device that corresponds to the third point within the displayed object at a third point in time; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device at the first position that corresponds to the first point within the displayed object while the second user input device concurrently is engaging the surface of the multi-touch display device at the second position that corresponds to the second point within the displayed object and while the third user input device concurrently is engaging the surface of the multi-touch display device at the third position that corresponds to the third point within the displayed object; determining that the second point in time at which the second user input device first engaged the second position on the surface of the multi-touch display device and the third point in time at which the third user input device first engaged the third position on the surface of the multi-touch display occurred within a predefined time period of one another, determining that the first point in time at which the first user input device first engaged the first position on the surface of the multi-touch display device did not occur within the predefined period of time of the second point in time at which the second user input device first engaged the second position on the surface of the multi-touch display device or the third point in time at which the third user input device first engaged the third position on the surface of the multi-touch display, and as a consequence of having determined that the second point in time at which the second user input device first engaged the second position on the surface of the multi-touch display device and the third point in time at which the third user input device first engaged the third position on the surface of the multi-touch display occurred within the predefined period time of one another and as a consequence of having determined that the first point in time at which the first user input device first engaged the first position on the surface of the multi-touch display device did not occur within the predefined period of time of the second point in time at which the second user input device first engaged the second position on the surface of the multi-touch display device or the third point in time at which the third user input device first engaged the third position on the surface of the multi-touch display, determining to allocate control of the displayed object to the second user input device and the third user input device but not the first user input device, wherein control of the displayed object is allocated to the second user input device and the third user input device as a single unit; after allocating control of the displayed object to the second and third user input devices as a single unit and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, and tracking movements of the third user input device while the third user input device continues to engage the surface of the multi-touch display device, determining that the first user input device moved to a fourth position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device while the second user input device concurrently moved to a fifth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device and while the third user input device concurrently moved to a sixth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device; and as a consequence of having determined that the second user input device moved to the fifth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device and the third user input device moved to the sixth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the second user input device and the third user input device as a single unit, translating the displayed object about the display component of the multi-touch display device as a function of the determined movement of the second user input device to the fifth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device and the determined movement of the third user input device to the sixth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device, wherein the translation of the displayed object about the display component of the multi-touch display device as a function of the determined movement of the second user input device to the fifth position on the surface of the multi-touch display device from the second position on the surface of the multi-touch display device and the determined movement of the third user input device to the sixth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device is not influenced by the determined movement of the first user input device to the fourth position on the surface of the multi-touch display device from the first position on the surface of the multi-touch display device.
-
-
11. A computer-implemented method for allocating control among user input devices when multiple user input devices are engaging an object displayed on a multi-touch display device, the method comprising:
-
displaying an object on a display component of a multi-touch display device; determining that a first user input device is engaging a surface of the multi-touch display device; as a consequence of having determined that the first user input device is engaging the surface of the multi-touch display device, tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device; determining that a second user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the second user input device is engaging the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device; determining that a third user input device is engaging the surface of the multi-touch display device; as a consequence of having determined that the third user input device is engaging the surface of the multi-touch display device, tracking movements of the third user input device while the third user input device continues to engage the surface of the multi-touch display device; determining that the first user input device determined to be engaging the surface of the multi-touch display device is engaging the surface of the multi-touch display device at a first position that corresponds to a first point within the displayed object while the second user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a second position that corresponds to a second point within the displayed object and while the third user input device determined to be engaging the surface of the multi-touch display device concurrently is engaging the surface of the multi-touch display device at a third position that corresponds to a third point within the displayed object; as a consequence of having determined that the first user input device, the second user input device, and the third user input device concurrently are engaging positions on the surface of the multi-touch display device that correspond to points within the displayed object, determining to allocate control of the displayed object to the first user input device and the second user input device but not the third user input device; after allocating control of the displayed object to the first user input device and the second user input device and as a consequence of tracking movements of the first user input device while the first user input device continues to engage the surface of the multi-touch display device, tracking movements of the second user input device while the second user input device continues to engage the surface of the multi-touch display device, and tracking movements of the third user input device while the third user input device continues to engage the surface of the multi-touch display device, determining that at least one of the first user input device and the second user input device moved relative to the other of the first user input device and the second user input device on the surface of the multi-touch display device while the third user input device concurrently moved to a fourth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device; as a consequence of having allocated control of the displayed object to the first user input device and the second user input device, transforming the displayed object on the display component of the multi-touch display device as a function of the determined relative movement of the first and second user input devices, wherein the transformation of the displayed object on the display component of the multi-touch display device as a function of the determined relative movement of the first and second user input devices is not influenced by the determined movement of the third user input device to the fourth position on the surface of the multi-touch display device from the third position on the surface of the multi-touch display device; after transforming the displayed object on the display component of the multi-touch display device as a function of the determined relative movement of the first and second user input devices, determining that the third user input device moved to a fifth position on the surface of the multi-touch display device from the fourth position on the surface of the multi-touch display device while the first user input device and the second user input devices remained in fixed positions on the surface of the multi-touch display device; and in response to having determined that the third user input device moved to a fifth position on the surface of the multi-touch display device from the fourth position on the surface of the multi-touch display device while the first user input device and the second user input devices remained in fixed positions on the surface of the multi-touch display device and as a consequence of having allocated control of the displayed object to the first user input device and the second user input device but not the third user input device, preserving the position, orientation, and scale of the displayed object on the display component of the multi-touch display device.
-
Specification