Pressure-based interface system, method, and computer program product with virtual display layers

• US 10,209,808 B1
• Filed: 04/19/2018
• Issued: 02/19/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/957,190
• Time in Patent Office: 306 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

Apparatuses and a computer-readable media are provided to: display an object and at least a portion of an interface in a same virtual display layer; detect a single static gesture being applied to the touch screen on the object, the single static gesture varying in pressure between a plurality of discrete touch states; perform a first pressure-dependent step-wise function in response to a first change in the discrete touch states; perform a second pressure-dependent step-wise function in response to a second change in the discrete touch states; and during at least a portion of the gesture and as a function of an increase in a magnitude of the pressure of the gesture being applied to the touch screen on the object, continuously blur the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

Claims

1. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen; and

one or more processors in communication with the at least one non-transitory memory and the touch screen, wherein the one or more processors execute the instructions to cause the apparatus to;

display an object and at least a portion of an interface in a same virtual display layer;

detect a single static gesture being applied to the touch screen on the object, the single static gesture varying in pressure between a plurality of discrete touch states;

perform a first pressure-dependent step-wise function in response to a first change in the discrete touch states;

perform a second pressure-dependent step-wise function in response to a second change in the discrete touch states; and

during at least a portion of the single static gesture being detected and as a function of an increase in a magnitude of the pressure of the single static gesture being detected on the touch screen on the object, continuously blur the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

2. The apparatus of claim 1, wherein the apparatus is configured such that the at least portion of the single static gesture is after the first change in the discrete touch states and before the second change in the discrete touch states.

3. The apparatus of claim 1, wherein the apparatus is configured such that the at least portion of the single static gesture is before the first change in the discrete touch states, and the second change in the discrete touch states is after the first change in the discrete touch states.

4. The apparatus of claim 1, wherein the apparatus is configured such that the first pressure-dependent step-wise function is performed after a cessation of the single static gesture is detected.

5. The apparatus of claim 1, wherein the apparatus is configured such that the second pressure-dependent step-wise function is performed before a cessation of the single static gesture is detected.

6. The apparatus of claim 1, wherein the apparatus is configured such that the first pressure-dependent step-wise function and the second pressure-dependent step-wise function are not performed if a cessation of the single static gesture is detected during the at least portion of the single static gesture.

7. The apparatus of claim 1, wherein the apparatus is configured such that the continuous blurring is a cue to a user regarding the magnitude of the pressure of the single static gesture.

8. The apparatus of claim 1, wherein the apparatus is configured such that the continuous blurring is a cue to a user regarding access to at least one of:

the first change in the discrete touch states or the second change in the discrete touch states.

9. The apparatus of claim 1, wherein the apparatus is configured such that the continuous blurring emphasizes an accessibility, via the object, to at least one of:

the first change in the discrete touch states or the second change in the discrete touch states.

10. The apparatus of claim 1, wherein the apparatus is configured such that the continuous blurring indicates a movement between a first virtual layer including the at least portion of the interface and a second virtual layer including the object.

11. The apparatus of claim 1, wherein the apparatus is configured such that the continuous blurring indicates a movement of the object between the same virtual display layer and another virtual display layer including the object.

12. The apparatus of claim 1, wherein the apparatus is configured such that the single static gesture includes a press.

13. The apparatus of claim 1, wherein the apparatus is configured such that the single static gesture is a continuous gesture.

14. The apparatus of claim 1, wherein the apparatus is configured such that the single static gesture varies only in pressure.

15. The apparatus of claim 1, wherein the apparatus is configured such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the apparatus;

said touch screen is on a back face of the apparatus;

said one or more processors is in direct communication with the at least one non-transitory memory, and the touch screen;

said one or more processors is in indirect communication with the at least one non-transitory memory, and the touch screen;

said one or more processors is in communication, via at least one bus, with the at least one non-transitory memory, and the touch screen;

said display is carried out by the touch screen;

said detection is carried out by the touch screen;

said detection is carried out by the one or more processors;

said detection is carried out by the touch screen in cooperation with the one or more processors;

said detection is carried out by the touch screen in cooperation with the one or more processors by the processor receiving a signal generated by the touch screen in response to the single static gesture;

each instance of the performing is carried out by the touch screen;

each instance of the performing is carried out by the one or more processors;

each instance of the performing is carried out by the touch screen in cooperation with the one or more processors;

said blurring is carried out by the touch screen;

said blurring includes an obscuring;

said blurring results in a vague presentation;

said blurring results in an indistinct appearance;

said single static gesture includes at least one of a touch gesture and/or a press gesture;

said single static gesture includes a combination of a touch gesture component and a press gesture component;

said single static gesture is a first gesture component of an overall gesture that includes another gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a dynamic gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a slide gesture component;

said single static gesture is a first gesture component of an overall gesture that includes a motion component;

said single static gesture is a gesture component of another gesture;

said single static gesture is not a gesture component of another gesture;

said single static gesture is detected on a single contact point on the object;

said single static gesture includes a single press on the object that varies only in pressure;

said single static gesture includes a single-finger contact on the object that varies only in pressure;

said single static gesture does not include multiple intermittent contacts with the touch screen;

said single static gesture does not include contact with the touch screen involving multiple fingers;

said single static gesture varies only in pressure;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof;

said single static gesture remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes a cessation of the pressure;

said single static gesture includes a first gesture component that remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes an inception of a second gesture component;

said single static gesture includes a first gesture component that remains in contact with the touch screen from an inception thereof up until a completion thereof, where the completion includes an inception of a second gesture component that includes a dynamic gesture component;

said single static gesture does not involve movement across an interaction surface of the touch screen;

said single static gesture does not involve movement in proximity to an interaction surface of the touch screen;

in a usage scenario where the magnitude of the pressure of the single static gesture surpasses a first magnitude threshold and then surpasses a second magnitude threshold, the single static gesture remains in contact with the touch screen from an inception thereof and while the magnitude of the pressure of the single static gesture surpasses the first magnitude threshold and then surpasses the second magnitude threshold;

said display of the at least portion of the interface and the object in the different virtual display layers is a result of the blurring;

said at least portion of the interface includes another object;

said object includes an icon and the at least portion of the interface includes another icon;

said object includes at least a portion of a message and the at least portion of the interface includes at least a portion of one or more other messages;

said object includes first text and the at least portion of the interface includes second text;

said object includes a hyperlink and the at least portion of the interface includes surrounding text;

said object includes an image and the at least portion of the interface includes one or more other images;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said touch screen is a two-dimensional layered user interface;

said touch screen is a single layer user interface that simulates a three-dimensional layered user interface through use of virtual display layers;

said pressure on the touch screen on the object is detected, by being detected on a selection boundary that, at least in part, overlaps the object;

said discrete touch states are discrete by involving different pressure magnitude thresholds;

said discrete touch states are discrete by being separate touch states;

said discrete touch states are discrete by involving non-overlapping different pressures;

said discrete touch states are discrete by involving pressures that are different, at least in part;

said discrete touch states are discrete by involving some pressures that are different while involving other pressure that are the same;

said discrete touch states are discrete by involving pressure ranges that overlap only in part;

said discrete touch states are discrete by involving pressure ranges that do not overlap;

said discrete touch states are discrete by triggering different functions;

said first pressure-dependent step-wise function includes a display function;

said second pressure-dependent step-wise function includes a display function;

said first pressure-dependent step-wise function is the same as the second pressure-dependent step-wise function;

said first pressure-dependent step-wise function is different from the second pressure-dependent step-wise function;

one of the different virtual display layers in which the object is located, is a clipboard layer;

one of the different virtual display layers in which the at least portion of the interface is located, is a clipboard layer;

said first pressure-dependent step-wise function is associated with the first change in the discrete touch states, by a user;

said first pressure-dependent step-wise function is associated with the first change in the discrete touch states, by a developer;

said first pressure-dependent step-wise function is associated with the first change in the discrete touch states, via system learning;

said second pressure-dependent step-wise function is associated with the second change in the discrete touch states, by a user;

said second pressure-dependent step-wise function is associated with the second change in the discrete touch states, by a developer;

said second pressure-dependent step-wise function is associated with the second change in the discrete touch states, via system learning;

said at least one non-transitory memory includes a single memory for storing the instructions and the plurality of applications;

said at least one non-transitory memory includes a first memory for storing the instructions and a second memory for storing the plurality of applications;

said interface includes a software interface;

said interface includes a graphical user interface;

said blur results from a three-dimensional depth cue;

said blur indicates a movement through different layers;

said first change includes a first change in pressure to at least one of a first sub-range of a range of measurable contact pressures, and the second change includes a second change in pressure to at least one of a second sub-range of the range of measurable contact pressures;

said first change includes a first change in pressure that exceeds a first threshold pressure within a range of measurable contact pressures, and the second change includes a second change in pressure that exceeds a second threshold pressure within the range of measurable contact pressures;

said first change includes a first change in pressure that surpasses a first threshold pressure within a range of measurable contact pressures that, when surpassed, triggers the first pressure-dependent step-wise function, and the second change includes a second change in pressure that surpasses a second threshold pressure within the range of measurable contact pressures that, when surpassed, triggers the second pressure-dependent step-wise function;

said first pressure-dependent step-wise function is step-wise by virtue of including an operation that is not continuous;

said first pressure-dependent step-wise function is step-wise by virtue of including an operation that occurs immediately in response to the first change;

said first pressure-dependent step-wise function is step-wise by including a single operation that occurs in response to the first change;

said second pressure-dependent step-wise function is step-wise by virtue of including an operation that is not continuous;

said second pressure-dependent step-wise function is step-wise by virtue of including an operation that occurs immediately in response to the second change;

said second pressure-dependent step-wise function is step-wise by including a single operation that occurs in response to the second change;

said first pressure-dependent step-wise function is pressure-dependent by being conditionally performed based on the pressure of the gesture detected on the touch screen on the object;

said second pressure-dependent step-wise function is pressure-dependent by being conditionally performed based on the pressure of the gesture detected on the touch screen on the object;

said first pressure-dependent step-wise function is pressure-dependent by being triggered based on the pressure of the gesture detected on the touch screen on the object;

said second pressure-dependent step-wise function is pressure-dependent by being triggered based on the pressure of the gesture detected on the touch screen on the object;

said first pressure-dependent step-wise function is pressure-dependent by being dependent on the pressure of the gesture detected on the touch screen on the object;

said second pressure-dependent step-wise function is pressure-dependent by being dependent on the pressure of the gesture detected on the touch screen on the object;

said continuous blurring is the function of the increase in the magnitude of the pressure of the gesture being detected on the touch screen on the object, by continuously increasing with the increase in the magnitude of the pressure of the gesture being detected on the touch screen on the object;

said blurring occurs after the first change is detected and before the second change is detected;

said blurring occurs only after the first change is detected;

said blurring remains after the second change is detected;

said first change is detected without the second change being detected in a first use scenario, and the second change is detected without the first change being detected in a second use scenario;

said first change is detected without the second change being detected in a first use scenario, and the second change and the first change are detected in a second use scenario;

or

said at least portion of the interface includes at least one other object.

16. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to cause the apparatus to;

display a first object and at least one other object in a same virtual display layer;

detect a single static gesture being applied to the touch screen on the first object, the single static gesture varying in pressure between a plurality of touch states;

perform a first pressure-dependent step-wise action in response to a first change in the touch states;

perform a second pressure-dependent step-wise action in response to a second change in the touch states; and

during at least a portion of the single static gesture between the first and second changes in the touch states and before a cessation of the single static gesture, display the first object in a first virtual display layer and the at least one other object in a second virtual display layer, and blur, as a continuous function of an increase in a magnitude of the pressure of the single static gesture being detected on the touch screen on the first object, at least a portion of the second virtual display layer.

17. The apparatus of claim 16, wherein the apparatus is configured such that the single static gesture is a continuous gesture.

18. The apparatus of claim 16, wherein the apparatus is configured such that the blurring is a cue to a user regarding the magnitude of the pressure of the single static gesture.

19. The apparatus of claim 16, wherein the apparatus is configured such that the blurring is a cue to a user regarding an accessibility of the second pressure-dependent step-wise action via the first object.

20. A non-transitory computer-readable media storing computer instructions that when executed by one or more processors of a mobile device, cause the mobile device to:

display an object and at least one other object in a same virtual display layer;

detect a gesture being applied to a touch screen on the object, the gesture including a continuous static gesture that varies in pressure; and

during at least a portion of the continuous static gesture before a cessation thereof, increase, as a function of an increase in a magnitude of the pressure of the continuous static gesture being detected on the touch screen on the object, a blurring of the at least one other object, such that the at least one other object appears to be increasing in depth as compared to the object, and the object and the at least one other object appear to be in different virtual display layers.

21. The non-transitory computer-readable media of claim 20, wherein the increase of the blurring is a cue to a user regarding the magnitude of the pressure of the continuous static gesture.

22. The non-transitory computer-readable media of claim 20, wherein the increase of the blurring is a cue to a user regarding an accessibility of a subsequent action via the object.

23. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to cause the apparatus to;

display a first object and at least one other object in a same virtual display layer;

detect a gesture being applied to the touch screen on the first object;

during at least a portion of the gesture before a completion thereof, display the first object in a first virtual display layer and the at least one other object in a second virtual display layer and increase, as a function of an increase in a magnitude of a pressure of the gesture being detected on the touch screen on the first object, a blurring of at least a portion of the second virtual display layer such that the at least portion of the second virtual display layer appears to be increasing in depth as compared to the first virtual layer; and

in response to the completion of the gesture, perform an action and provide touch-perceptible output.

24. The apparatus of claim 23, wherein the apparatus is configured such that the increase in the blurring is a cue to a user regarding the magnitude of the pressure of the gesture.

25. The apparatus of claim 23, wherein the apparatus is configured such that the increase in the blurring is a cue to a user regarding an accessibility of the action.

26. The apparatus of claim 23, wherein the apparatus is configured such that:

after the blurring is increased and during at least another portion of the gesture before the completion thereof, at least a portion of a window is resized as a function of a change in the magnitude of the pressure of the gesture being detected on the touch screen.

27. The apparatus of claim 26, wherein the apparatus is configured such that the blurring and the resizing are cues to a user regarding the magnitude of the pressure of the gesture.

28. The apparatus of claim 26, wherein the apparatus is configured such that the increase in the blurring is a cue to a user regarding an accessibility of the at least portion of the window.

29. The apparatus of claim 26, wherein the apparatus is configured such that the resizing is a cue to a user regarding an accessibility of the action.

30. The apparatus of claim 26, wherein the apparatus is configured such that the resizing is a cue to a user regarding a status of the completion of the gesture.