Reducing control response latency with defined cross-control behavior
First Claim
Patent Images
1. A system for processing user input, comprising:
- display comprising a visualization of a user interface;
user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input;
input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit signals corresponding to the received signals;
first graphical processing and output system comprising software running in a software stack, the first graphical processing and output system adapted to receive at least some of the emitted signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to the at least some of the emitted signals;
second graphical processing and output system implemented at least partially in hardware, the second graphical processing and output system adapted to substantially simultaneously receive at least some of the emitted signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the emitted signals;
wherein the at least some of the emitted signals received by the second graphical processing and output system comprise an identification of a cross-control behavior, the second graphical processing and output system comprises hardware configured to implement the cross-control behavior, and the generated low-latency data comprises data reflecting the cross-control behavior;
wherein, with respect to the response to the at least some of the emitted signals, the second graphical processing and output system is adapted to output the generated low-latency data with low latency relative to the output of the high-latency data by the first graphical processing and output system; and
the display being configured to display at least some of the low-latency data and at least some of the high-latency data on the visualization of the user interface.
5 Assignments
0 Petitions
Accused Products
Abstract
A system for processing user input with reduced control response latency includes an input device, an input processing unit, a high-latency subsystem, a low-latency subsystem, input processing unit software for generating signals, and an output device. The low-latency subsystem receives the signals and generates low-latency output and the high-latency subsystem processes the signals and generates high-latency output. In an embodiment, the signals comprise an identification of a defined cross-control behavior.
24 Citations
98 Claims
-
1. A system for processing user input, comprising:
-
display comprising a visualization of a user interface; user input device comprising at least one selected from the group consisting of touch input and pen input, the user input device adapted to output signals corresponding to user input; input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit signals corresponding to the received signals; first graphical processing and output system comprising software running in a software stack, the first graphical processing and output system adapted to receive at least some of the emitted signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to the at least some of the emitted signals; second graphical processing and output system implemented at least partially in hardware, the second graphical processing and output system adapted to substantially simultaneously receive at least some of the emitted signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the emitted signals; wherein the at least some of the emitted signals received by the second graphical processing and output system comprise an identification of a cross-control behavior, the second graphical processing and output system comprises hardware configured to implement the cross-control behavior, and the generated low-latency data comprises data reflecting the cross-control behavior; wherein, with respect to the response to the at least some of the emitted signals, the second graphical processing and output system is adapted to output the generated low-latency data with low latency relative to the output of the high-latency data by the first graphical processing and output system; and the display being configured to display at least some of the low-latency data and at least some of the high-latency data on the visualization of the user interface. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A system for processing user input, comprising:
-
display comprising a visualization of a user interface; user input device adapted to output signals corresponding to user input; input processing system operatively connected to the user input device, the input processing system adapted to receive the signals corresponding to user input and to emit a stream of signals corresponding to at least some of the received signals; first graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate high-latency data that can affect the visualization of the user interface on the display and to output the high-latency data for use by the display in response to at least some of the signals in the at least a portion of the stream of signals received by the first graphical processing and output system; second graphical processing and output system adapted to receive at least a portion of the stream of signals and to generate low-latency data that can affect the visualization of the user interface on the display and to output the generated low-latency data for use by the display in response to the at least some of the signals in the at least a portion of the stream of signals received by the second graphical processing and output system, the second graphical processing and output system being configured to output the generated low-latency data with low latency relative to the output of the high-latency data by the first output graphical processing and output system; wherein the at least a portion of the stream of signals received by the second graphical processing and output system comprise an identification of a cross-control behavior and the generated low-latency data comprises data reflecting the cross-control behavior; and the display being configured to merge at least some of the low-latency data and at least some of the high-latency data onto the visualization of the user interface. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39)
-
-
40. A system for processing user input, comprising:
-
input subsystem including an input device, the subsystem adapted to output signals in response to a plurality of user inputs to the input device, the signals comprising information concerning the input; low-latency subsystem adapted to receive the signals and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a high-latency subsystem; wherein the signals received by the low-latency subsystem comprise an identification of a cross-control behavior and the generated low-latency response comprises data reflecting the cross-control behavior; the high-latency subsystem adapted to receive the at least one of the signals, and to generate a high-latency response in response to one or more of the at least one of the signals; and
,wherein the low-latency subsystem generates the low-latency response with low latency relative to the high-latency subsystem and the high-latency subsystem generates the high-latency response with high latency relative to the low-latency subsystem.
-
-
41. A system for processing user input, comprising:
-
input subsystem including an input device, the subsystem adapted to output signals in response to a plurality of user inputs to the input device, the signals comprising information concerning the input; low-latency subsystem adapted to receive the signals and to generate a low-latency response in response to one or more of the signals, and to send at least one of the signals to a high-latency subsystem; wherein the signals received by the low-latency subsystem comprise an input which triggers a cross-control behavior, the low-latency subsystem makes an identification of the cross-control behavior, and the low-latency subsystem generates a low-latency response reflecting the cross-control behavior; the high-latency subsystem adapted to receive the at least one of the signals, and to generate a high-latency response in response to one or more of the at least one of the signals; wherein the low-latency subsystem generates the low-latency response with low latency relative to the high-latency subsystem and the high-latency subsystem generates the high-latency response with high latency relative to the low-latency subsystem. - View Dependent Claims (42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59)
-
-
60. A system for processing user input with low latency, comprising:
-
an input device; an input processing unit; a high-latency subsystem; a low-latency subsystem; input processing unit software adapted to generate signals in response to user inputs; and
,output device; wherein the low-latency subsystem processes a plurality of the signals with low latency relative to the high-latency subsystem and the high-latency subsystem processes a plurality of the signals with high latency relative to the low-latency subsystem; wherein the input device, the input processing unit, the high-latency subsystem, the low-latency processing subsystem, the input processing unit software and the output device being arranged such that; at least some of the signals are processed in parallel by said low-latency subsystem and said high-latency subsystem, the low-latency subsystem creating a programmable response for output on the output device with low-latency and the high-latency subsystem creating a response for output on the output device with high-latency; wherein the plurality of the signals processed by the low-latency subsystem comprise an input from the user, in response to which the low-latency subsystem makes an identification of a cross-control behavior, and the programmable response comprises data reflecting the cross-control behavior; and the output device outputting one or both of the response from the low-latency subsystem and the response from the high-latency subsystem when the responses are output thereto. - View Dependent Claims (61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78)
-
-
79. A system for processing user input with low latency, comprising:
-
an input device; output device; an input processing unit; input processing unit software adapted to generate signals in response to user inputs; a high-latency response subsystem adapted to create a high-latency response to at least some of the signals; a low-latency response subsystem implemented at least partially in hardware, the low-latency response subsystem adapted to create a low-latency response to at least some of the signals, the low-latency response subsystem comprising one or more parameters affecting the low-latency response; wherein the at least some of the signals comprise an identification of a cross-control behavior, the low-latency response subsystem comprises hardware configured to implement the cross-control behavior, and the low-latency response comprises data reflecting the cross-control behavior; wherein the low-latency response is not of higher latency than the high-latency response, and the high-latency response is not of lower latency than the low-latency response with respect to common signals; wherein the input device, output device, the input processing unit, input processing unit software, the high-latency response subsystem and the low-latency response subsystem are arranged such that; the output device outputs the low-latency response and the high-latency response; and wherein application software can alter the one or more parameters affecting the low-latency response. - View Dependent Claims (80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98)
-
Specification