Multitouch data fusion
First Claim
Patent Images
1. A data processing system, comprising:
- a first sensing device configured for receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data;
one or more second sensing devices configured for providing secondary data; and
a processor coupled to the first sensing device and the one or more second sensing devices, the processor capable of combining both the first gesture data and the secondary data to perform one or more operations on an electronic device,wherein the secondary data includes gaze recognition data, and the processor is further capable ofprocessing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen, andwhen the gaze is directed to the object, processing the first gesture data in accordance with the gaze recognition data to perform the one or more operations on the electronic device, the one or more operations related to the object at which the gaze is directed.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for performing multi-touch (MT) data fusion is disclosed in which multiple touch inputs occurring at about the same time are received to generating first touch data. Secondary sense data can then be combined with the first touch data to perform operations on an electronic device. The first touch data and the secondary sense data can be time-aligned and interpreted in a time-coherent manner. The first touch data can be refined in accordance with the secondary sense data, or alternatively, the secondary sense data can be interpreted in accordance with the first touch data. Additionally, the first touch data and the secondary sense data can be combined to create a new command.
-
Citations
51 Claims
-
1. A data processing system, comprising:
-
a first sensing device configured for receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data; one or more second sensing devices configured for providing secondary data; and a processor coupled to the first sensing device and the one or more second sensing devices, the processor capable of combining both the first gesture data and the secondary data to perform one or more operations on an electronic device, wherein the secondary data includes gaze recognition data, and the processor is further capable of processing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen, and when the gaze is directed to the object, processing the first gesture data in accordance with the gaze recognition data to perform the one or more operations on the electronic device, the one or more operations related to the object at which the gaze is directed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A method for performing data processing, comprising:
-
receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data; providing secondary sense data, the secondary sense data including gaze recognition data; processing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen; and when the gaze is directed to the object, combining both the first gesture data and the secondary sense data by processing the first gesture data in accordance with the gaze recognition data to perform one or more operations on the electronic device, the one or more operations related to the object at which the gaze is directed. - View Dependent Claims (19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A non-transitory computer-readable medium comprising program code for performing data processing, the program code for causing performance of a method comprising:
-
receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data; providing secondary sense data, the secondary sense data including gaze recognition data; processing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen; and when the gaze is directed to the object, combining both the first gesture data and the secondary sense data by processing the first gesture data in accordance with the gaze recognition data to perform one or more operations on an electronic device, the one or more operations related to the object at which the gaze is directed. - View Dependent Claims (35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49)
-
-
50. A mobile telephone including a data processing system, the data processing system comprising:
-
a first sensing device configured for receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data; one or more second sensing devices configured for providing secondary data, the secondary data including gaze recognition data; and a processor coupled to the first sensing device and the one or more second sensing devices, the processor capable of combining both the first gesture data and the secondary data to perform one or more operations on an electronic device; wherein the secondary data includes gaze recognition data, and the processor is further capable of processing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen, and when the gaze is directed to the object, processing the first gesture data in accordance with the gaze recognition data to perform the one or more operations on the electronic device, the one or more operations related to the object at which the gaze is directed.
-
-
51. A digital audio player including a data processing system, the data processing system comprising:
-
a first sensing device configured for receiving a multi-finger gesture input indicative of multiple touch inputs occurring at about the same time and generating first gesture data; one or more second sensing devices configured for providing secondary data, the secondary data including gaze recognition data; and a processor coupled to the first sensing device and the one or more second sensing devices, the processor capable of combining both the first gesture data and the secondary data to perform one or more operations on an electronic device; wherein the secondary data includes gaze recognition data, and the processor is further capable of processing the gaze recognition data to determine when a gaze is directed to an object displayed on a screen, and when the gaze is directed to the object, processing the first gesture data in accordance with the gaze recognition data to perform the one or more operations on the electronic device, the one or more operations related to the object at which the gaze is directed.
-
Specification