Pressure-based touch screen system, method, and computer program product with virtual display layers

• US 10,222,893 B1
• Filed: 04/19/2018
• Issued: 03/05/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/957,435
• Time in Patent Office: 320 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

Apparatuses and a computer-readable media are provided to: display an object and at least a portion of an interface in a same virtual display layer; detect a single static gesture being applied to the touch screen on the object, the single static gesture varying in pressure between a plurality of discrete touch states; perform a first pressure-dependent step-wise function in response to a first change in the discrete touch states; perform a second pressure-dependent step-wise function in response to a second change in the discrete touch states; and during at least a portion of the gesture and as a function of an increase in a magnitude of the pressure of the gesture being applied to the touch screen on the object, continuously blur the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

Claims

1. An electronic device, comprising:

a display;

a touch interface;

one or more sensors to detect levels of contacts with the touch interface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying an object and at least a portion of an interface in a same virtual display layer;

detecting a gesture on the object;

performing a first pressure-dependent function for a first touch state;

performing a second pressure-dependent function for a second touch state; and

during at least a portion of the gesture and as a function of a change in a pressure of the gesture on the object, blurring the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

2. The electronic device of claim 1, wherein the electronic device is configured such that the at least portion of the gesture is after the first touch state and before the second touch state.

3. The electronic device of claim 1, wherein the electronic device is configured such that the at least portion of the gesture is before the first touch state, and the second touch state is after the first touch state.

4. The electronic device of claim 1, wherein the electronic device is configured such that the first pressure-dependent function is performed after a cessation of the gesture is detected.

5. The electronic device of claim 1, wherein the electronic device is configured such that the second pressure-dependent function is performed before a cessation of the gesture is detected.

6. The electronic device of claim 1, wherein the electronic device is configured such that the first pressure-dependent function and the second pressure-dependent function are not performed if a cessation of the gesture is detected during the at least portion of the gesture.

7. The electronic device of claim 1, wherein the electronic device is configured such that the blurring is a cue to a user regarding a level of the pressure of the gesture.

8. The electronic device of claim 1, wherein the electronic device is configured such that the blurring is a cue to a user regarding access to at least one of:

the first touch state or the second touch state.

9. The electronic device of claim 1, wherein the electronic device is configured such that the gesture causes the second touch state and not the first touch state, resulting in the blurring and the second pressure-dependent function being performed.

10. The electronic device of claim 9, wherein the electronic device is configured to:

detect another gesture that causes the first touch state and not the second touch state, resulting in the first pressure-dependent function being performed without the blurring nor the second pressure-dependent function being performed.

11. The electronic device of claim 1, wherein the electronic device is configured such that the gesture causes neither the first touch state nor the second touch state resulting in the blurring without the first pressure-dependent function nor the second pressure-dependent function being performed, and another gesture is detected for causing at least one of the first touch state or the second touch state.

12. The electronic device of claim 1, wherein the electronic device is configured such that the gesture causes only the second touch state resulting in the blurring and the second pressure-dependent function being performed without the first pressure-dependent function being performed, and another gesture is detected for causing only the first touch state resulting in the first pressure-dependent function being performed without the second pressure-dependent function being performed.

13. The electronic device of claim 1, wherein the electronic device is configured to:

detect another gesture that causes the first touch state resulting in only the first pressure-dependent function being performed without the second pressure-dependent function being performed;

detect yet another gesture that causes neither the first touch state nor the second touch state resulting in the blurring without the first pressure-dependent function nor the second pressure-dependent function being performed; and

detect still yet another gesture that causes the second touch state resulting in the blurring and the second pressure-dependent function being performed without the first pressure-dependent function being performed.

14. The electronic device of claim 1, wherein the electronic device is configured such that:

the first touch state includes a cessation of the gesture and only the first touch state is detected for a first gesture to cause only the first pressure-dependent function to be performed without the second pressure-dependent function being performed;

neither the first touch state nor the second touch state are detected for a second gesture to cause the blurring without the first pressure-dependent function nor the second pressure-dependent function being performed; and

the second touch state is detected for a third gesture to cause the blurring and the second pressure-dependent function to be performed without the first pressure-dependent function being performed.

15. The electronic device of claim 1, wherein the electronic device is configured such that at least one of:

said interface includes a software interface;

said interface includes a graphical user interface;

said blur results from a three-dimensional depth cue;

said blur indicates a movement through different layers;

said first touch state includes a first sub-range of a range of measurable contact pressures, and the second touch state includes a second sub-range of the range of measurable contact pressures;

said first pressure-dependent function is a step-wise function;

said second pressure-dependent function is a step-wise function;

said blur is a function of only on the change in the pressure of the gesture being detected on the object;

said blur is a function of the change in the pressure of the gesture being detected on the object, in addition to one or more other factors;

said blur is the function of the change in the pressure of the gesture being detected on the object, by being based on the function of the change in the pressure of the gesture being detected on the object;

said gesture is detected on an entirety of the object;

said gesture is detected on at least a portion of the object;

said pressure on the object is detected, by being detected within a selection boundary that, at least in part, overlaps the object;

said first touch state includes a first threshold pressure within a range of measurable contact pressures, and the second touch state includes a second threshold pressure within the range of measurable contact pressures;

said first touch state includes a first threshold pressure within a range of measurable contact pressures that, when surpassed, triggers the first pressure-dependent function, and the second touch state includes a second threshold pressure within the range of measurable contact pressures that, when surpassed, triggers the second pressure-dependent function;

said gesture includes at least one of a touch gesture and/or a press gesture;

said gesture includes a combination of a touch gesture component and a press gesture component;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said first pressure-dependent function includes a display function;

said second pressure-dependent function includes a display function;

said first pressure-dependent function is the same as the second pressure-dependent function;

said first pressure-dependent function is different from the second pressure-dependent function;

one of the different virtual display layers in which the object is located, is a clipboard layer;

one of the different virtual display layers in which the at least portion of the interface is located, is a clipboard layer;

said gesture does not involve movement across an interaction surface of the touch interface;

said gesture does not involve movement in proximity to an interaction surface of the touch interface;

said first pressure-dependent function is pressure-dependent by being conditionally performed based on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being conditionally performed based on the pressure of the gesture on the object;

said first pressure-dependent function is pressure-dependent by being triggered based on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being triggered based on the pressure of the gesture on the object;

said first pressure-dependent function is pressure-dependent by being dependent on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being dependent on the pressure of the gesture on the object;

said first pressure-dependent function is associated with the first touch state, by a user;

said first pressure-dependent function is associated with the first touch state, by a developer;

said first pressure-dependent function is associated with the first touch state, via system learning;

said second pressure-dependent function is associated with the second touch state, by a user;

said first touch state is a surface touch state;

said second touch state is a surface touch state;

said first touch state is not a surface touch state;

said second touch state is not a surface touch state;

said blurring is the function of the change in the pressure of the gesture on the object, by conditionally blurring based on the change in the pressure of the gesture reaching a threshold pressure;

said blurring is the function of the change in the pressure of the gesture on the object, by increasing based on the change in the pressure of the gesture on the object;

said blurring occurs after the first touch state is detected and before the second touch state is detected;

said blurring occurs only after the first touch state is detected;

said blurring remains after the second touch state is detected;

said blur includes an obscuring;

said blur results in a vague presentation;

said blur results in an indistinct appearance;

said second pressure-dependent function is associated with the second touch state, by a developer;

said second pressure-dependent function is associated with the second touch state, via system learning;

said first touch state is detected without the second touch state being detected in a first use scenario, and the second touch state is detected without the first touch state being detected in a second use scenario;

or

said at least portion of the interface includes at least one other object.

16. An electronic device, comprising:

a display;

a touch interface;

one or more sensors to detect levels of contacts with the touch interface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a first object and at least one other object in a same virtual display layer;

detecting a gesture on the first object;

performing a first pressure-dependent action for a first touch state;

performing a second pressure-dependent action for a second touch state; and

during at least a portion of the gesture before the second touch state is detected, displaying the first object in a first virtual display layer and the at least one other object in a second virtual display layer, and blurring, as a function of a change in a pressure of the gesture on the first object, at least a portion of the second virtual display layer.

17. The electronic device of claim 16, wherein the electronic device is configured such that:

the first touch state includes a cessation of the gesture and only the first touch state is detected for a first gesture to cause only the first pressure-dependent action to be performed;

neither the first touch state nor the second touch state are detected for a second gesture to cause the blurring without the first pressure-dependent action nor the second pressure-dependent action being performed; and

only the second touch state is detected for a third gesture to cause the blurring and the second pressure-dependent action to be performed without the first pressure-dependent action being performed.

18. The electronic device of claim 16, wherein the electronic device is configured such that the blurring is a cue to a user regarding the pressure of the gesture.

19. The electronic device of claim 16, wherein the electronic device is configured such that the blurring is a cue to a user regarding an accessibility of the second pressure-dependent action via the first object.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display, a touch interface, and one or more sensors to detect intensity of contacts with the touch interface, cause the electronic device to:

display an object and at least one other object in a same virtual display layer;

detect a gesture on the object, the gesture including a gesture that varies in pressure; and

during at least a portion of the gesture before a cessation thereof, blur, as a function of a change in a pressure of the gesture on the object, the at least one other object, such that the at least one other object appears to be at a greater depth as compared to the object, and the object and the at least one other object appear to be in different virtual display layers.

21. The non-transitory computer readable storage medium of claim 20, wherein the instructions, which when executed by the electronic device, cause the electronic device to operate such that:

the blurring is a cue to a user regarding the change in the pressure of the gesture.

22. The non-transitory computer readable storage medium of claim 20, wherein the instructions, which when executed by the electronic device, cause the electronic device to operate such that:

the blurring is a cue to a user regarding an accessibility of a subsequent action via the object.

23. An electronic device, comprising:

a display;

a touch interface;

one or more sensors to detect levels of contacts with the touch interface;

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

displaying a first object and at least one other object in a same virtual display layer;

detecting a gesture on the first object;

during at least a portion of the gesture before a completion thereof, displaying the first object in a first virtual display layer and the at least one other object in a second virtual display layer and blurring, as a function of a change in a pressure of the gesture on the first object, at least a portion of the second virtual display layer such that the at least portion of the second virtual display layer appears to be at a greater depth as compared to the first virtual layer; and

after the completion of the gesture, performing an action.

24. The electronic device of claim 23, wherein the electronic device is configured such that the blurring is a cue to a user regarding a level of the pressure of the gesture.

25. The electronic device of claim 23, wherein the electronic device is configured such that the blurring is a cue to a user regarding an accessibility of the action.

26. The electronic device of claim 23, wherein the electronic device is configured such that:

after the blurring and during at least another portion of the gesture before the completion thereof, at least a portion of a window is resized as a function of the pressure of the gesture.

27. The electronic device of claim 26, wherein the electronic device is configured such that the blurring and the resizing are cues to a user regarding changes in the pressure of the gesture.

28. The electronic device of claim 26, wherein the electronic device is configured such that the blurring is a cue to a user regarding an accessibility of the at least portion of the window.

29. The electronic device of claim 26, wherein the electronic device is configured such that the resizing is a cue to a user regarding an accessibility of the action.

30. The electronic device of claim 26, wherein the electronic device is configured such that the resizing is a cue to a user regarding a status of the completion of the gesture.

31. A method, comprising:

at an electronic device with a touch interface and a display, wherein the electronic device includes one or more sensors to detect levels of contacts with the touch interface;

displaying an object and at least a portion of an interface in a same virtual display layer;

detecting a gesture on the object;

performing a first pressure-dependent function for a first touch state;

performing a second pressure-dependent function for a second touch state; and

during at least a portion of the gesture and as a function of a change in a pressure of the gesture on the object, blurring the at least portion of the interface such that the at least portion of the interface and the object are displayed in different virtual display layers.

32. The method of claim 31, wherein the at least portion of the gesture is after the first touch state and before the second touch state.

33. The method of claim 31, wherein the at least portion of the gesture is before the first touch state, and the second touch state is after the first touch state.

34. The method of claim 31, wherein the first pressure-dependent function is performed after a cessation of the gesture is detected.

35. The method of claim 34, wherein the second pressure-dependent function is performed before a cessation of the gesture is detected.

36. The method of claim 35, wherein the first pressure-dependent function and the second pressure-dependent function are not performed if a cessation of the gesture is detected during the at least portion of the gesture.

37. The method of claim 36, wherein the blurring is a cue to a user regarding a level of the pressure of the gesture.

38. The method of claim 36, wherein the blurring is a cue to a user regarding access to at least one of:

the first touch state or the second touch state.

39. The method of claim 38, wherein the blurring emphasizes an accessibility, via the object, to at least one of:

the first touch state or the second touch state.

40. The method of claim 39, wherein the blurring indicates a movement between a first virtual layer including the at least portion of the interface and a second virtual layer including the object.

41. The method of claim 39, wherein the blurring indicates a movement of the object between the same virtual layer and another virtual layer including the object.

42. The method of claim 31, wherein the first touch state includes a cessation of the gesture, and a first gesture is detected where only the first touch state occurs to cause only the first pressure-dependent function to be performed;

and a second gesture is detected where only the second touch state occurs to cause the blurring and the second pressure-dependent function to be performed without the first pressure-dependent function being performed.

43. The method of claim 31, and further comprising:

detecting a first gesture that causes only the first touch state resulting in only the first pressure-dependent function being performed;

detecting a second gesture that causes neither the first touch state nor the second touch state resulting in the blurring without the first pressure-dependent function nor the second pressure-dependent function being performed; and

detecting a third gesture that causes only the second touch state resulting in the blurring and the second pressure-dependent function being performed without the first pressure-dependent function being performed.

44. The method of claim 31, and further comprising:

detecting a particular gesture that causes only the second touch state resulting in the blurring and the second pressure-dependent function being performed without the first pressure-dependent function being performed.

45. The method of claim 31, wherein at least one of:

said interface includes a software interface;

said interface includes a graphical user interface;

said blur results from a three-dimensional depth cue;

said blur indicates a movement through different layers;

said first touch state includes a first sub-range of a range of measurable contact pressures, and the second touch state includes a second sub-range of the range of measurable contact pressures;

said first pressure-dependent function is a step-wise function;

said second pressure-dependent function is a step-wise function;

said first touch state includes a first threshold pressure within a range of measurable contact pressures, and the second touch state includes a second threshold pressure within the range of measurable contact pressures;

said first touch state includes a first threshold pressure within a range of measurable contact pressures that, when surpassed, triggers the first pressure-dependent function, and the second touch state includes a second threshold pressure within the range of measurable contact pressures that, when surpassed, triggers the second pressure-dependent function;

said gesture includes at least one of a touch gesture and/or a press gesture;

said gesture includes a combination of a touch gesture component and a press gesture component;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said first pressure-dependent function includes a display function;

said second pressure-dependent function includes a display function;

said first pressure-dependent function is the same as the second pressure-dependent function;

said first pressure-dependent function is different from the second pressure-dependent function;

one of the different virtual display layers in which the object is located, is a clipboard layer;

one of the different virtual display layers in which the at least portion of the interface is located, is a clipboard layer;

said gesture does not involve movement across an interaction surface of the touch interface;

said gesture does not involve movement in proximity to an interaction surface of the touch interface;

said first pressure-dependent function is pressure-dependent by being conditionally performed based on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being conditionally performed based on the pressure of the gesture on the object;

said first pressure-dependent function is pressure-dependent by being triggered based on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being triggered based on the pressure of the gesture on the object;

said first pressure-dependent function is pressure-dependent by being dependent on the pressure of the gesture on the object;

said second pressure-dependent function is pressure-dependent by being dependent on the pressure of the gesture on the object;

said first pressure-dependent function is associated with the first touch state, by a user;

said first pressure-dependent function is associated with the first touch state, by a developer;

said first pressure-dependent function is associated with the first touch state, via system learning;

said second pressure-dependent function is associated with the second touch state, by a user;

said blurring is the function of the change in the pressure of the gesture on the object, by conditionally blurring based on the change in the pressure of the gesture reaching a threshold pressure;

said blurring is the function of the change in the pressure of the gesture on the object, by increasing based on the change in the pressure of the gesture on the object;

said blurring occurs after the first touch state is detected and before the second touch state is detected;

said blurring occurs only after the first touch state is detected;

said blurring remains after the second touch state is detected;

said second pressure-dependent function is associated with the second touch state, by a developer;

said second pressure-dependent function is associated with the second touch state, via system learning;

said first touch state is detected without the second touch state being detected in a first use scenario, and the second touch state is detected without the first touch state being detected in a second use scenario;

or

said at least portion of the interface includes at least one other object.

46. A method, comprising:

at an electronic device with a touch interface and a display, wherein the electronic device includes one or more sensors to detect levels of contacts with the touch interface;

displaying a first object and at least one other object in a same virtual display layer;

detecting a gesture on the first object;

performing a first pressure-dependent action for a first touch state;

performing a second pressure-dependent action for a second touch state; and

during at least a portion of the gesture before the second touch state is detected, displaying the first object in a first virtual display layer and the at least one other object in a second virtual display layer, and blurring, as a function of a change in a pressure of the gesture on the first object, at least a portion of the second virtual display layer.

47. The method of claim 46, wherein the gesture is a continuous gesture.

48. The method of claim 46, wherein the first touch state includes a cessation of the gesture and only the first touch state is detected for a first gesture to cause only the first pressure-dependent action to be performed;

neither the first touch state nor the second touch state are detected for a second gesture to cause the blurring without the first pressure-dependent action nor the second pressure-dependent action being performed; and

only the second touch state is detected for a third gesture to cause the blurring and the second pressure-dependent action to be performed without the first pressure-dependent action being performed.

49. The method of claim 46, wherein the blurring is a cue to a user regarding an accessibility of the second pressure-dependent action via the first object.

50. A method, comprising:

at an electronic device with a touch interface and a display, wherein the electronic device includes one or more sensors to detect levels of contacts with the touch interface;

displaying an object and at least one other object in a same virtual display layer;

detecting a gesture on the object, the gesture including a gesture that varies in pressure; and

during at least a portion of the gesture before a cessation thereof, blurring, as a function of a change in a pressure of the gesture on the object, the at least one other object, such that the at least one other object appears to be at a greater depth as compared to the object, and the object and the at least one other object appear to be in different virtual display layers.

51. The method of claim 50, wherein the blurring is a cue to a user regarding the pressure of the gesture.

52. The method of claim 50, wherein the blurring is a cue to a user regarding an accessibility of a subsequent action via the object.

53. A method, comprising:

at an electronic device with a touch interface and a display, wherein the electronic device includes one or more sensors to detect levels of contacts with the touch interface;

displaying a first object and at least one other object in a same virtual display layer;

detecting a gesture on the first object;

during at least a portion of the gesture before a completion thereof, displaying the first object in a first virtual display layer and the at least one other object in a second virtual display layer and blurring, as a function of a change in a pressure of the gesture on the first object, at least a portion of the second virtual display layer such that the at least portion of the second virtual display layer appears to be at a greater depth as compared to the first virtual layer; and

after the completion of the gesture, performing an action.

54. The method of claim 53, wherein the blurring is a cue to a user regarding a level of the pressure of the gesture.

55. The method of claim 53, wherein the blurring is a cue to a user regarding an accessibility of the action.

56. The method of claim 53, wherein:

after the blurring and during at least another portion of the gesture before the completion thereof, at least a portion of a window is resized as a function of the pressure of the gesture.

57. The method of claim 56, wherein the blurring remains after the blurring.

58. The method of claim 57, wherein the blurring is a cue to a user regarding an accessibility of the at least portion of the window.

59. The method of claim 58, wherein the resizing is a cue to the user regarding an accessibility of the action.

60. The method of claim 59, wherein the change in the pressure is a continuous change, and the blurring is increased continuously as a continuous function of the continuous change in the pressure.

61. A system, comprising:

means for displaying an object; and

means for detecting a gesture on the object to perform a first function in a first touch state and perform a second function in a second touch state;

wherein the system is configured for blurring at least a portion of an interface other than the object during detection of at least a portion of the gesture, based on a change in a pressure of the gesture being detected on the object.

62. The system of claim 61, wherein the means for detecting includes a touch interface, and the means for displaying includes a display.