Recognition and processing of gestures in a graphical user interface using machine learning
First Claim
1. A computer-implemented method comprising:
- displaying a continuous content stream of individually actionable content items;
automatically recognizing, while the continuous content stream is being displayed, a mode change from a control mode to a signal mode by receiving a touch input and determining whether a start of the touch input is within a predetermined distance from a starting point predefined for a display view;
in response to the mode change, using a neural network to generate output data indicating a gesture classification for the touch input, wherein the touch input is received in relation to a particular actionable content item that is in a visible portion of the continuous content stream;
performing, according to the output data, an action for the particular actionable content item, the action comprising causing to render a graphical icon corresponding to the touch input in the continuous content stream at a location associated with the particular actionable content item;
wherein the method is performed by one or more computing devices.
2 Assignments
0 Petitions
Accused Products
Abstract
In an embodiment, a computer-implemented method comprises: displaying a continuous content stream of individually actionable content items; automatically recognizing, while the continuous content stream is being displayed, a mode change from a control mode to a signal mode; receiving a touch input after the mode change is recognized and, in response, using a neural network to generate output data indicating a gesture classification for the touch input, wherein the touch input is received in relation to a particular actionable content item that is in a visible portion of the continuous content stream; performing, according to the output data, an action for the particular actionable content item; wherein the method is performed by one or more computing devices.
9 Citations
16 Claims
-
1. A computer-implemented method comprising:
-
displaying a continuous content stream of individually actionable content items; automatically recognizing, while the continuous content stream is being displayed, a mode change from a control mode to a signal mode by receiving a touch input and determining whether a start of the touch input is within a predetermined distance from a starting point predefined for a display view; in response to the mode change, using a neural network to generate output data indicating a gesture classification for the touch input, wherein the touch input is received in relation to a particular actionable content item that is in a visible portion of the continuous content stream; performing, according to the output data, an action for the particular actionable content item, the action comprising causing to render a graphical icon corresponding to the touch input in the continuous content stream at a location associated with the particular actionable content item; wherein the method is performed by one or more computing devices. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-implemented system comprising:
-
a mobile device comprising a touchscreen and a first non-transitory data storage medium storing a first set of instructions which, when executed by the mobile device, cause; displaying, on the touchscreen, a continuous content stream of individually actionable content items; automatically recognizing, while the continuous content stream is being displayed on the touchscreen, a mode change from a control mode to a signal mode, by receiving a touch input and determining whether a start of the touch input is within a predetermined distance from a starting point predefined for a display view; in response to the mode change, using a neural network to generate output data indicating a gesture classification for the touch input, wherein the touch input is received in relation to a particular actionable content item that is in a visible portion of the continuous content stream; a server device comprising a second non-transitory data storage medium storing a second set of instructions which, when executed by the server device, cause; performing, according to the output data, an action for the particular actionable content item, the action comprising causing to render, on the touchscreen, a graphical icon corresponding to the touch input in the continuous content stream at a location associated with the particular actionable content item. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
Specification