Hybrid systems and methods for low-latency user input processing and feedback
First Claim
Patent Images
1. A system for processing user input, comprising:
- display comprising a visualization of a user interface;
user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input;
input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit signals corresponding to the received signals;
first graphical processing and output system comprising software running in a software stack, the first graphical processing and output system adapted to receive at least some of the emitted signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to the at least some of the emitted signals;
second graphical processing and output system implemented at least partially in hardware, the second graphical processing and output system adapted to substantially simultaneously receive the at least some of the emitted signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the emitted signals;
wherein, with respect to the response to the at least some of the emitted signals, the second graphical processing and output system is adapted to output the generated low-latency data with low latency relative to the output of the high-latency data by the first graphical processing and output system; and
the display being configured to display at least some of the low-latency data and at least some of the high-latency data on the visualization of the user interface.
8 Assignments
0 Petitions
Accused Products
Abstract
A system for processing user input includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals in response to user inputs, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output.
24 Citations
226 Claims
-
1. A system for processing user input, comprising:
-
display comprising a visualization of a user interface; user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input; input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit signals corresponding to the received signals; first graphical processing and output system comprising software running in a software stack, the first graphical processing and output system adapted to receive at least some of the emitted signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to the at least some of the emitted signals; second graphical processing and output system implemented at least partially in hardware, the second graphical processing and output system adapted to substantially simultaneously receive the at least some of the emitted signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the emitted signals; wherein, with respect to the response to the at least some of the emitted signals, the second graphical processing and output system is adapted to output the generated low-latency data with low latency relative to the output of the high-latency data by the first graphical processing and output system; and the display being configured to display at least some of the low-latency data and at least some of the high-latency data on the visualization of the user interface. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40)
-
-
41. A system for processing user input, comprising:
-
display comprising a visualization of a user interface; user input device adapted to output signals corresponding to user input; input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit a stream of signals corresponding to at least some of the received signals; first graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to at least some of the signals in the at least a portion of the stream of signals received by the first graphical processing and output system; second graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the signals in the at least a portion of the stream of signals received by the second graphical processing and output system, the second graphical processing and output system being configured to output the generated low-latency data with low latency relative to the output of the high-latency data by the first output graphical processing and output system; and the display being configured to merge at least some of the low-latency data and at least some of the high-latency data onto the visualization of the user interface. - View Dependent Claims (42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71)
-
-
72. A system for processing user input, comprising:
-
input device; input processing unit; high-latency subsystem; low-latency subsystem implemented at least partially in hardware; input processing unit software for generating signals in response to user inputs; and
, output device;wherein the low-latency subsystem receives the signals and generates at least one low-latency output with low latency relative to the high-latency subsystem and the high-latency subsystem processes at least some of the signals and generates at least one high-latency output with high latency relative to the low-latency subsystem; wherein the input device, the input processing unit, the high-latency subsystem, the low-latency subsystem, the input processing unit software and the output device being arranged such that; the low-latency processing subsystem operates independently of and parallel to the high-latency processing subsystem; and at least some of the user input signals are processed by both the low-latency subsystem and the high-latency subsystem, the low-latency subsystem outputting to the output device a response to a given user input signal with low-latency and the high-latency subsystem outputting to the output device a response to the given user input signal with high-latency. - View Dependent Claims (73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102)
-
-
103. A system for processing user input, comprising:
-
input device; input processing unit; high-latency subsystem comprising software running in a software stack; low-latency subsystem; input processing unit software adapted to generate signals in response to user inputs; and
,output device; wherein the low-latency subsystem processes the signals with low latency relative to the high-latency subsystem and the high-latency subsystem processes the user input events with high latency relative to the low-latency subsystem; wherein the low-latency subsystem receives the signals and generates at least one low-latency output with low latency relative to the high-latency subsystem and the high-latency subsystem processes at least some of the signals and generates at least one high-latency output with high latency relative to the low-latency subsystem; wherein the input device, the input processing unit, the high-latency subsystem, the low-latency processing subsystem, the input processing unit software and the output device being arranged such that; the low-latency processing subsystem operates independently of and parallel to the high-latency processing subsystem; and at least some of the user input signals are processed by both the low-latency subsystem and the high-latency subsystem, the low-latency subsystem outputting to the output device a response to a given user input signal with low-latency and the high-latency subsystem outputting to the output device a response to the given user input signal with high-latency. - View Dependent Claims (104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133)
-
-
134. A system for processing user input, comprising:
-
input subsystem including an input device, the subsystem adapted to output signals in response to a plurality of user inputs to the input device, the signals comprising information concerning the input; low-latency subsystem adapted to receive the signals and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a high-latency subsystem; the high-latency subsystem adapted to receive the at least one of the signals, and to generate a high-latency response in response to one or more of the at least one of the signals; and
,output device operatively connected to the low-latency subsystem and the high-latency subsystem, the output device configured to blend the low-latency response and the high latency response; wherein the low-latency subsystem generates the low-latency response with low latency relative to the high-latency subsystem and the high-latency subsystem generates the high-latency response with high latency relative to the low-latency subsystem. - View Dependent Claims (135, 136, 137, 138, 139, 140, 141, 142, 143, 144, 145, 146, 147, 148, 149, 150, 151, 152, 153, 154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164)
-
-
165. A system for processing user input with low latency, comprising:
-
an input device; an input processing unit; a high-latency subsystem; a low-latency subsystem; input processing unit software adapted to generate signals in response to user inputs; and
,output device; wherein the low-latency subsystem processes a plurality of signals with low latency relative to the high-latency subsystem and the high-latency subsystem processes a plurality of the signals with high latency relative to the low-latency subsystem; wherein the input device, the input processing unit, the high-latency subsystem, the low-latency processing subsystem, the input processing unit software and the output device being arranged such that; at least some of the signals are processed in parallel by said low-latency subsystem and said high-latency subsystem, the low-latency subsystem creating a programmable response for output on the output device with low-latency and the high-latency subsystem creating a response for output on the output device with high-latency; and the output device outputting the response from the low-latency subsystem and the response from the high-latency subsystem when the responses are output thereto. - View Dependent Claims (166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185, 186, 187, 188, 189, 190, 191, 192, 193, 194, 195)
-
-
196. A system for processing user input with low latency, comprising:
-
an input device; output device; an input processing unit; input processing unit software adapted to generate signals in response to user inputs; a high-latency response subsystem adapted to create a high-latency response to at least some of the signals; a low-latency response subsystem implemented at least partially in hardware, the low-latency response subsystem adapted to create a low-latency response to at least some of the signals, the low-latency response subsystem comprising one or more parameters affecting the low-latency response; wherein the low-latency response is not of higher latency than the high-latency response, and the high-latency response is not of lower latency than the low-latency response with respect to common signals; wherein the input device, output device, the input processing unit, input processing unit software, the high-latency response subsystem and the low-latency response subsystem are arranged such that; the user input signals are processed in parallel by said low-latency subsystem and said high-latency subsystem; the output device outputs the low-latency response and the high-latency response; and wherein application software can alter the one or more parameters affecting the low-latency response. - View Dependent Claims (197, 198, 199, 200, 201, 202, 203, 204, 205, 206, 207, 208, 209, 210, 211, 212, 213, 214, 215, 216, 217, 218, 219, 220, 221, 222, 223, 224, 225, 226)
-
Specification