Tri-state gesture-equipped touch screen system, method, and computer program product

• US 10,156,921 B1
• Filed: 04/19/2018
• Issued: 12/18/2018
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): XAVIER, ANTONIO J
• Application Number:
  US15/957,165
• Time in Patent Office: 243 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

Apparatuses and a computer-readable media are provided to: display an object and at least a portion of an interface in a same virtual display layer; detect a single static gesture being applied to the touch screen on the object; in the event that a magnitude of the pressure of the single static gesture being applied to the touch screen on the object is less than a first magnitude threshold, perform an operation; in the event that the magnitude of the pressure of the single static gesture being applied to the touch screen on the object is greater than the first magnitude threshold and is less than a second magnitude threshold, blur, as a function of an increase in the magnitude of the pressure of the single static gesture being applied to the touch screen on the object, the at least portion of the interface, and display the at least portion of the interface and the object in different virtual display layers; and in the event that the magnitude of the pressure of the single static gesture being applied to the touch screen on the object is greater than the second magnitude threshold, vibrate the apparatus and perform another operation.

Claims

1. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display, via the touch screen, an object and at least a portion of an interface in a same virtual display layer;

detect a single static gesture being applied to the touch screen on the object;

when a magnitude of a pressure of the single static gesture being detected on the touch screen on the object is less than a first magnitude threshold, perform an operation;

when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the first magnitude threshold and is less than a second magnitude threshold, blur, as a function of an increase in the magnitude of the pressure of the single static gesture being detected on the touch screen on the object, the at least portion of the interface, and display the at least portion of the interface and the object in different virtual display layers; and

when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the second magnitude threshold, perform another operation and output feedback that is perceptible by touch.

2. The apparatus of claim 1, wherein the apparatus is configured such that, when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is less than the first magnitude threshold, the operation is performed after a cessation of the single static gesture is detected.

3. The apparatus of claim 1, wherein the apparatus is configured such that, when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the second magnitude threshold, the another operation is performed before a cessation of the single static gesture is detected.

4. The apparatus of claim 1, wherein the apparatus is configured such that the operation and the another operation are not performed if a cessation of the single static gesture is detected after the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the first magnitude threshold and is less than the second magnitude threshold.

5. The apparatus of claim 1, wherein the apparatus is configured such that the operation is not performed if a cessation of the single static gesture is detected after the magnitude of the pressure of the single static gesture being detected on the touch screen on the object drops below the first magnitude threshold after surpassing the first magnitude threshold.

6. The apparatus of claim 1, wherein the apparatus is configured such that the blurring is a cue to a user regarding the magnitude of the pressure of the single static gesture.

7. The apparatus of claim 1, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the another operation via the object.

8. The apparatus of claim 1, wherein the apparatus is configured such that the blurring emphasizes an accessibility of the another operation via the object by way of an increase in the magnitude of the pressure detected on the touch screen on the object so as to be greater than the second magnitude threshold.

9. The apparatus of claim 1, wherein the apparatus is configured such that, when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the first magnitude threshold and is less than the second magnitude threshold, the blur is decreased as a function of a decrease in the magnitude of the pressure of the single static gesture being detected on the touch screen on the object.

10. The apparatus of claim 1, wherein the apparatus is configured such that at least a portion of a duration of the blur involves a continuous blur function that is a continuous function of the increase in the magnitude of the pressure of the single static gesture being detected on the touch screen on the object.

11. The apparatus of claim 1, wherein the apparatus is configured such that at least a portion of the blur involves a continuous blur function that is a continuous function of the increase in the magnitude of the pressure of the single static gesture being detected on the touch screen on the object, only when the magnitude of the pressure of the single static gesture being detected on the touch screen on the object remains less than the second magnitude threshold.

12. The apparatus of claim 1, wherein the apparatus is configured such that the single static gesture is a continuous gesture.

13. The apparatus of claim 1, wherein the apparatus is configured such that the single static gesture varies only in pressure.

14. The apparatus of claim 1, wherein the apparatus is configured such that the blur of the at least portion of the interface, indicates a movement between a first virtual layer including the at least portion of the interface and a second virtual layer including the object.

15. The apparatus of claim 1, wherein the apparatus is configured such that the blur of the at least portion of the interface, indicates a movement of the object between a first virtual layer including the at least portion of the interface and a second virtual layer including the object.

16. The apparatus of claim 1, wherein the apparatus is configured such that the gesture includes a press.

17. The apparatus of claim 1, wherein the apparatus is configured such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the apparatus;

said touch screen is on a back face of the apparatus;

said one or more processors is in direct communication with the at least one non-transitory memory, the touch screen, and the vibrator;

said one or more processors is in indirect communication with the at least one non-transitory memory, the touch screen, and the vibrator;

said one or more processors is in communication, via at least one bus, with the at least one non-transitory memory, the touch screen, and the vibrator;

said feedback includes at least one of;

a vibration, a force feedback, a tactile output, a weight feedback, a mechanical output, or a mass feedback;

said vibrator includes at least one of;

a transducer, a motor, or an actuator;

each instance of said display is carried out by the touch screen;

said blurring is carried out by the touch screen;

said detection is carried out by the touch screen;

said detection is carried out by the one or more processors;

said detection is carried out by the touch screen in cooperation with the one or more processors;

said detection is carried out by the touch screen in cooperation with the one or more processors by the processor receiving a signal generated by the touchscreen in response to the single static gesture;

each instance of the performing is carried out by the touch screen;

each instance of the performing is carried out by the one or more processors;

each instance of the performing is carried out by the touch screen in cooperation with the one or more processors;

said single static gesture includes at least one of a touch gesture and/or a press gesture;

said single static gesture includes a combination of a touch gesture component and a press gesture component;

said single static gesture is a first gesture component of an overall gesture that includes another gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a dynamic gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a slide gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a motion component;

said single static gesture is a gesture component of another gesture;

said single static gesture is not a gesture component of another gesture;

said single static gesture is detected on a single contact point on the object;

said single static gesture includes a single press on the object that varies only in pressure;

said single static gesture includes a single-finger contact on the object that varies only in pressure;

said single static gesture does not include multiple intermittent contacts with the touch screen;

said single static gesture does not include contact with the touch screen involving multiple fingers;

said single static gesture varies only in pressure;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes a cessation of the pressure;

said single static gesture includes a first gesture component that remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes an inception of a second gesture component;

said single static gesture includes a first gesture component that remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes an inception of a second gesture component that includes a dynamic gesture component;

each instance of said when includes at least one point of time when the magnitude of the pressure meets the corresponding magnitude threshold;

each instance of said when includes at least one point in time after the magnitude of the pressure changes to the corresponding magnitude threshold;

each instance of said when includes when the magnitude of the pressure initially meets the corresponding magnitude threshold;

each instance of said when includes an entire duration when the magnitude of the pressure meets the corresponding magnitude threshold;

each instance of said when includes only a portion of a duration when the magnitude of the pressure meets the corresponding magnitude threshold;

each instance of said when includes when the magnitude of the pressure changes to the corresponding magnitude threshold;

each instance of said when includes after the magnitude of the pressure changes to the corresponding magnitude threshold;

each instance of said when includes only a portion of a duration;

each instance of said when includes while;

in a usage scenario where the magnitude of the pressure of the single static gesture surpasses the first magnitude threshold and then surpasses the second magnitude threshold, the single static gesture remains in contact with the touch screen from an inception thereof and while the magnitude of the pressure of the single static gesture surpasses the first magnitude threshold and then surpasses the second magnitude threshold;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said touch screen is a two-dimensional layered user interface;

said touch screen is a single layer user interface that simulates a three-dimensional layered user interface through use of virtual display layers;

said interface includes a software interface;

said interface includes a graphical user interface;

said at least one non-transitory memory includes a single memory for storing the instructions and the plurality of applications;

said at least one non-transitory memory includes a first memory for storing the instructions and a second memory for storing the plurality of applications;

said blur results from a three-dimensional depth cue;

said blur indicates a movement through different layers;

said blur includes an obscuring;

said blur results in a vague presentation;

said blur results in an indistinct appearance;

said pressure being applied to the touch screen on the object is detected, by being detected on a selection boundary that, at least in part, overlaps the object;

said another operation is performed simultaneously with the output of the feedback;

said another operation is performed at least partly simultaneously with the output of the feedback;

said another operation is performed before or after the output of the feedback;

said feedback results from the apparatus being vibrated utilizing the vibrator;

said feedback results from the apparatus being vibrated only once;

said feedback results from the apparatus being vibrated at least once;

said feedback results from the apparatus being vibrated for a predetermined period of time;

said feedback is performed by the vibrator;

said feedback includes one or more vibrations;

said feedback includes tactile feedback;

said vibrator includes one or more transducers;

said operation includes a function;

said operation includes a display function;

said operation is the same as the another operation;

said operation is different from the another operation;

one of the different virtual display layers in which the object is located, is a clipboard layer;

said single static gesture does not involve movement across an interaction surface of the touch screen;

said single static gesture does not involve movement in proximity to an interaction surface of the touch screen;

said at least portion of the interface remains blurred in the event that the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the second magnitude threshold;

said at least portion of the interface is no longer blurred in the event that the magnitude of the pressure of the single static gesture being detected on the touch screen on the object is greater than the second magnitude threshold;

said display of the at least portion of the interface and the object in the different virtual display layers is a result of the blurring;

said at least portion of the interface includes another object;

said object includes an icon and the at least portion of the interface includes another icon;

said object includes at least a portion of a message and the at least portion of the interface includes at least a portion of one or more other messages;

said object includes first text and the at least portion of the interface includes second text;

said object includes a hyperlink and the at least portion of the interface includes surrounding text;

said object includes an image and the at least portion of the interface includes one or more other images;

said performance of the operation is associated with the magnitude of the pressure being less than the first magnitude threshold, by a user;

said performance of the operation is associated with the magnitude of the pressure being less than the first magnitude threshold, by a developer;

said performance of the operation is associated with the magnitude of the pressure being less than the first magnitude threshold, via system learning;

said performance of the another operation is associated with the magnitude of the pressure being greater than the second magnitude threshold, by a user;

said performance of the another operation is associated with the magnitude of the pressure being greater than the second magnitude threshold, by a developer;

or

said performance of the another operation is associated with the magnitude of the pressure being greater than the second magnitude threshold, via system learning.

18. A non-transitory computer-readable media storing computer instructions that, when executed by one or more processors of a mobile device, cause the mobile device to:

display, via a touch screen, an object and at least a portion of an interface in a same virtual display layer;

detect a continuous static gesture being applied to the touch screen on the object;

in the event that a magnitude of a pressure of the continuous static gesture being detected on the touch screen on the object is less than a first magnitude threshold, perform a function;

when the magnitude of the pressure of the continuous static gesture being detected on the touch screen on the object is greater than the first magnitude threshold and is less than a second magnitude threshold, display the at least portion of the interface in a first virtual display layer and the object in a second virtual display layer, and blur, as a continuous function of an increase in the magnitude of the pressure of the continuous static gesture being detected on the touch screen on the object, at least a portion of the first virtual display layer; and

in the event that the magnitude of the pressure of the continuous static gesture being detected on the touch screen on the object is greater than the second magnitude threshold, perform another function and output feedback that is perceptible by touch.

19. The non-transitory computer-readable media of claim 18, wherein the blurring is a cue to a user regarding the magnitude of the pressure of the continuous static gesture.

20. The non-transitory computer-readable media of claim 18, wherein the blurring is a cue to a user regarding an accessibility of the another function via the object.

21. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display a first object and at least one other object in a same virtual display layer;

detect a single static gesture being applied to the touch screen on the first object;

in the event that a magnitude of a pressure of the single static gesture being detected on the touch screen on the first object is less than a first magnitude threshold, perform a function;

while the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object is greater than the first magnitude threshold and is less than a second magnitude threshold, display the at least one other object in a first virtual display layer and the first object in a second virtual display layer, and blur, as a function of an increase in the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object, at least a portion of the first virtual display layer; and

in the event that the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object is greater than the second magnitude threshold, perform another function and output feedback that is perceptible by touch.

22. The apparatus of claim 21, wherein the apparatus is configured such that the blurring is a cue to a user regarding the magnitude of the pressure of the single static gesture.

23. The apparatus of claim 21, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the another function via the object.

24. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display a first object and at least one other object in a same virtual display layer;

detect at least one component of a single static gesture being applied to the touch screen on the first object;

when a first component of the single static gesture is detected where a magnitude of a pressure of the single static gesture being detected on the touch screen on the first object is less than a first magnitude threshold, perform a first function upon a cessation of the single static gesture;

when a second component of the single static gesture is detected where the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object is greater than the first magnitude threshold and is less than a second magnitude threshold, display the at least one other object in a first virtual display layer and the first object in a second virtual display layer, and blur, as a function of an increase in the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object, at least a portion of the first virtual display layer; and

when a third component of the single static gesture is detected where the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object is greater than the second magnitude threshold, perform a second function and output feedback that is perceptible by touch.

25. The apparatus of claim 24, wherein the apparatus is configured such that only the first component of the single static gesture is detected in a first use case scenario, the second component of the single static gesture is detected in a second use case scenario, and the third component of the single static gesture is detected in a third use case scenario.

26. The apparatus of claim 24, wherein the apparatus is configured such that only the first component of the single static gesture is detected in a first use case scenario;

the first and second components of the single static gesture are detected in a second use case scenario; and

the first, second, and third components of the single static gesture are detected in a third use case scenario.

27. The apparatus of claim 24, wherein the one or more processors execute the instructions to:

when the third component of the single static gesture is detected where the magnitude of the pressure of the single static gesture being detected on the touch screen on the first object is greater than the second magnitude threshold and is less than a third magnitude threshold, resize, as a function of a change in the magnitude of the pressure of the single static gesture being detected on the touch screen, at least a portion of a window; and

when a fourth component of the single static gesture is detected where the magnitude of the pressure of the single static gesture being detected on the touch screen is greater than the third magnitude threshold, perform a third function and output feedback that is perceptible by touch.

28. The apparatus of claim 27, wherein the apparatus is configured such that the blurring and the resizing are cues to a user regarding the magnitude of the pressure of the single static gesture.

29. The apparatus of claim 27, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the second function via the first object.

30. The apparatus of claim 27, wherein the apparatus is configured such that the resizing is a cue to a user regarding an accessibility of the third function.