Pressure-sensitive touch screen system, method, and computer program product for objects

• US 10,209,809 B1
• Filed: 04/19/2018
• Issued: 02/19/2019
• Est. Priority Date: 08/05/2011
• Status: Active Grant

• Current Assignee: Smith Interface Technologies, LLC
• Original Assignee: P4tents1 LLC
• Inventors: Smith, Michael S
• Primary Examiner(s): Xavier, Antonio
• Application Number:
  US15/957,416
• Time in Patent Office: 306 Days
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/4843 : by program, e.g. task dispatcher, supervisor, operating system

Abstract

Apparatuses, methods, and a computer-readable media are provided to: display an object and another object via an interface, such that the object and the another object are located in a same virtual display layer; detect a gesture being applied to the touch screen on the object, the gesture capable of causing a plurality of touch states; prior to a first touch state of the plurality of touch states, display information associated with the object; during the first touch state of the plurality of touch states, display the object in a first virtual display layer and the another object in a second virtual display layer; during the first touch state of the plurality of touch states and based on an increase in a pressure being applied to the touch screen on the object, increase a blurring of the another object; during the first touch state of the plurality of touch states and based on a decrease in the pressure being applied to the touch screen on the object, decrease the blurring of the another object; during a second touch state of the plurality of touch states, vibrate the apparatus, during the second touch state of the plurality of touch states, display, in different virtual display layers, at least a portion of the interface that is blurred and at least a portion of a window; during the second touch state of the plurality of touch states and based on another increase in the pressure being applied to the touch screen, increase a size of the at least portion of the window; during the second touch state of the plurality of touch states and based on another decrease in the pressure being applied to the touch screen, decrease the size of the at least portion of the window.

Claims

1. An apparatus, comprising:

at least one non-transitory memory storing instructions and a plurality of applications;

a touch screen;

a vibrator; and

one or more processors in communication with the at least one non-transitory memory, the touch screen, and the vibrator, wherein the one or more processors execute the instructions to;

display an object and another object via an interface, such that the object and the another object are located in a same virtual display layer;

detect a gesture that is being applied to the touch screen on the object and that includes one or more of a plurality of touch states;

during a first touch state of the plurality of touch states, display the object in a first virtual display layer and the another object in a second virtual display layer;

during the first touch state of the plurality of touch states and based on an increase in a pressure being detected on the touch screen on the object, increase a blurring of the another object;

during the first touch state of the plurality of touch states and based on a decrease in the pressure being detected on the touch screen on the object, decrease the blurring of the another object;

during a second touch state of the plurality of touch states, output feedback that is perceptible by touch;

during the second touch state of the plurality of touch states, display, in different virtual display layers, at least a portion of the interface that is blurred and at least a portion of a window;

during the second touch state of the plurality of touch states and based on another increase in the pressure being detected on the touch screen, increase a size of the at least portion of the window;

during the second touch state of the plurality of touch states and based on another decrease in the pressure being detected on the touch screen, decrease the size of the at least portion of the window;

during a third touch state of the plurality of touch states, output additional feedback that is perceptible by touch; and

during the third touch state of the plurality of touch states, display information associated with the object.

2. The apparatus of claim 1, wherein the apparatus is configured such that the first touch state precedes the second touch state and the second touch state precedes the third touch state.

3. The apparatus of claim 1, wherein the apparatus is configured such that at least the first touch state, the second touch state, and the third touch state are triggered by a detection of a press gesture based on different levels of pressure being detected on the touch screen.

4. The apparatus of claim 1, wherein the apparatus is configured such that the gesture includes a continuous static gesture that varies only in pressure.

5. The apparatus of claim 1, wherein the apparatus is configured such that, in response to a detection of a slide gesture, a menu is displayed including a plurality of items corresponding to different actions in connection with the object.

6. The apparatus of claim 5, wherein the apparatus is configured such that the menu is displayed with at least part of the at least portion of the window.

7. The apparatus of claim 5, wherein the apparatus is configured such that the slide gesture is detected on the at least portion of the window.

8. The apparatus of claim 5, wherein the apparatus is configured such that the slide gesture is a component of the gesture.

9. The apparatus of claim 5, wherein the apparatus is configured such that the slide gesture is a dynamic component of the gesture that also includes a continuous static component.

10. The apparatus of claim 5, wherein the apparatus is configured such that, when the gesture remains below a predetermined pressure level for a predetermined amount of time before a cessation thereof and before the first touch state, another menu is displayed including the plurality of items corresponding to the different actions in connection with the object.

11. The apparatus of claim 1, wherein the apparatus is configured such that the window provides a preview.

12. The apparatus of claim 1, wherein the apparatus is configured such that the window is a new window displaying at least a portion of the information associated with the object.

13. The apparatus of claim 1, wherein the apparatus is configured such that, when that the pressure stops during the second touch state, the at least portion of the window is no longer displayed.

14. The apparatus of claim 1, wherein the apparatus is configured such that, during the second touch state, the at least portion of the window is sharpened and magnified so as to display the at least portion of the window with at least a portion of the information associated with the object.

15. The apparatus of claim 1, wherein the apparatus is configured such that the increase of the blurring of the another object based on the increase in the pressure being detected on the touch screen on the object is for cueing a user as to an availability of an access to the at least portion of the window.

16. The apparatus of claim 15, wherein the apparatus is configured such that the increase of the size of the at least portion of the window based on the another increase in the pressure being detected on the touch screen is for cueing the user as to an availability of an access to the information associated with the object.

17. The apparatus of claim 1, wherein the apparatus is configured such that at least a portion of the second virtual display layer is staggered relative to the first virtual display layer.

18. The apparatus of claim 1, wherein the apparatus is configured such that the increase and the decrease of the blurring of the another object, indicate a movement between the same virtual display layer and the second virtual layer.

19. The apparatus of claim 1, wherein the apparatus is configured such that at least one of:

said touch screen includes a touch interface and a display;

said touch screen is a combination of a touch interface and a display;

said touch screen is on a front face of the apparatus;

said touch screen is on a back face of the apparatus;

said one or more processors is in direct communication with the at least one non-transitory memory, the touch screen, and the vibrator;

said one or more processors is in indirect communication with the at least one non-transitory memory, the touch screen, and the vibrator;

said one or more processors is in communication, via at least one bus, with the at least one non-transitory memory, the touch screen, and the vibrator;

each instance of said display is carried out by the touch screen;

each instance of said detection is carried out by the touch screen;

each instance of said detection is carried out by the one or more processors;

each instance of said detection is carried out by the touch screen in cooperation with the one or more processors;

each instance of said detection is carried out by the touch screen in cooperation with the one or more processors by the processor receiving a signal generated by the touch screen in response to the pressure;

each instance of said increase and the decrease are carried out by the touch screen;

each instance of said feedback is carried out by the vibrator;

said touch states are discrete touch states;

said touch states are separate touch states;

said touch states involve non-overlapping different pressures;

said touch states involve pressures that are different, at least in part;

said touch states involve some pressures that are different while involving other pressure that are the same;

said touch states involve pressure ranges that overlap only in part;

said touch states involve pressure ranges that do not overlap;

said touch states involve different pressure magnitude thresholds;

said during the first touch state includes during an entirety of the first touch state;

said during the first touch state includes during at least a portion of the first touch state;

said during the first touch state includes during only a portion of the first touch state;

said during the first touch state includes during a change to the first touch state;

said during the first touch state includes after a change to the first touch state;

said during the first touch state includes at a beginning of the first touch state;

said during the second touch state includes during an entirety of the second touch state;

said during the second touch state includes during at least a portion of the second touch state;

said during the second touch state includes during only a portion of the second touch state;

said during the second touch state includes during a change to the second touch state;

said during the second touch state includes after a change to the second touch state;

said during the second touch state includes at a beginning of the second touch state;

said during the third touch state includes during an entirety of the third touch state;

said during the third touch state includes during at least a portion of the third touch state;

said during the third touch state includes during only a portion of the third touch state;

said during the third touch state includes during a change to the third touch state;

said during the third touch state includes after a change to the third touch state;

said during the third touch state includes at a beginning of the third touch state;

said pressure results from at least one of a touch gesture and/or a press gesture;

said pressure results from a combination of a touch gesture and a press gesture;

said pressure is detected utilizing one or more of a plurality of contact-sensing technologies including a capacitive-based contact sensing technology, a resistive-based contact sensing technology, an optical-based contact sensing technology, or a surface acoustic wave-based contact sensing technology;

said pressure generates a touch signal that, during a first component of the gesture, is not pressure magnitude-dependent, and, during a second component of the gesture, is pressure magnitude-dependent;

said pressure generates a touch signal that, during a first component of the gesture, is not pressure magnitude-dependent and thus results in a touch signal, and, during a second component of the gesture, is pressure magnitude-dependent and thus results in a pressure signal;

said increase and the another increase in the pressure are separate instances of increase;

said increase and the another increase in the pressure are part of the same increase;

said decrease and the another decrease in the pressure are separate instances of decrease;

said decrease and the another decrease in the pressure are part of the same decrease;

said another increase in the pressure is detected on the touch screen on the at least portion of the window;

said touch screen is a two-dimensional layered user interface;

the touch screen is a single layer user interface that simulates a three-dimensional layered user interface through use of virtual display layers;

said display of the object in the first virtual display layer and the another object in the second virtual display layer is associated with the first touch state, by a user;

said display of the object in the first virtual display layer and the another object in the second virtual display layer is associated with the first touch state, by a developer;

said display of the object in the first virtual display layer and the another object in the second virtual display layer is associated with the first touch state, via system learning;

said display, in the different virtual display layers, the at least portion of the interface that is blurred and the at least portion of the window, is associated with the second touch state, by a user;

said display, in the different virtual display layers, the at least portion of the interface that is blurred and the at least portion of the window, is associated with the second touch state, by a developer;

said display, in the different virtual display layers, the at least portion of the interface that is blurred and the at least portion of the window, is associated with the second touch state, via system learning;

at least one of said different virtual display layers includes the first virtual display layer;

at least one of said different virtual display layers includes the second virtual display layer;

said different virtual display layers include the first virtual display layer and the second virtual display layer;

said different virtual display layers are separate from the first virtual display layer and the second virtual display layer;

said display of the information associated with the object is associated with the third touch state, by a user;

said display of the information associated with the object is associated with the third touch state, by a developer;

said display of the information associated with the object is associated with the third touch state, via system learning;

said at least portion of the interface includes an entirety of the interface excluding the object;

said first virtual display layer includes a clipboard layer;

said second virtual display layer includes a clipboard layer;

said feedback results from the apparatus being vibrated utilizing the vibrator;

said feedback results from the apparatus being vibrated only once;

said feedback results from the apparatus being vibrated at least once;

said feedback results from the apparatus being vibrated for a predetermined period of time;

said feedback is performed by the vibrator;

said feedback includes one or more vibrations;

said feedback includes tactile feedback;

said vibrator includes one or more transducers;

said feedback is the same as the additional feedback;

said feedback is different from the additional feedback;

said feedback is less than the additional feedback in terms of duration;

said feedback is less than the additional feedback in terms of magnitude;

said feedback is less than the additional feedback in terms of instances;

said additional feedback is output simultaneously with the display of the information;

said additional feedback is output at least partly simultaneously with the display of the information;

said additional feedback is output before or after with the display of the information;

said feedback is output simultaneously with the at least portion of the interface that is blurred and the at least portion of the window are displayed in different virtual display layers;

said feedback is output at least partly simultaneously with the at least portion of the interface that is blurred and the at least portion of the window are displayed in different virtual display layers;

said feedback is output before or after the at least portion of the interface that is blurred and the at least portion of the window are displayed in different virtual display layers;

said feedback includes at least one of;

a vibration, a force feedback, a tactile output, a weight feedback, a mechanical output, or a mass feedback;

said vibrator includes at least one of;

a transducer, a motor, or an actuator;

said at least one non-transitory memory includes a single memory for storing the instructions and the plurality of applications;

said at least one non-transitory memory includes a first memory for storing the instructions and a second memory for storing the plurality of applications;

said interface includes a software interface;

said interface includes a graphical user interface;

said blur includes an obscuring;

said blur results in a vague presentation;

said blur results in an indistinct appearance;

said blur includes a three-dimensional depth cue;

said blur indicates a movement through different layers;

said at least portion of the interface is an entirety of the interface excluding the at least portion of the window;

said at least portion of the window includes an entire window;

said first touch state is capable of existing in a first usage scenario without the second touch state existing in the first usage scenario, and the first touch state and the second touch state are both capable of existing in a second usage scenario;

said first touch state is capable of existing in a first usage scenario without the second touch state existing in the first usage scenario, and the second touch state is capable of existing in a second usage scenario without the first touch state existing in the second usage scenario;

or

said blurring results in the appearance of depth in connection with the another object.

20. A non-transitory computer-readable media storing computer instructions that when executed by one or more processors of a mobile device, cause the mobile device to:

display an object and another object, such that the object and the another object are located in a same virtual display layer;

detect a gesture being applied to a touch screen on the object;

after a change to a first touch state resulting from the gesture is detected, display the object in a first virtual display layer and the another object in a second virtual display layer that is misaligned with respect to the first virtual display layer;

after the change to the first touch state resulting from the gesture is detected and based on an increase in a pressure being detected on the touch screen on the object, increase a blurring of the another object;

after the change to the first touch state resulting from the gesture is detected and based on a decrease in the pressure being detected on the touch screen on the object, decrease the blurring of the another object;

after a change to a second touch state resulting from the gesture is detected, display at least a portion of a window;

after the change to the second touch state resulting from the gesture is detected and based on another increase in the pressure being detected on the touch screen, increase a size of the at least portion of the window;

after the change to the second touch state resulting from the gesture is detected and based on another decrease in the pressure being detected on the touch screen, decrease the size of the at least portion of the window; and

after a particular change in the gesture is detected after the change to the second touch state resulting from the gesture is detected, display a menu including a plurality of items corresponding to different actions in connection with the object.

21. The non-transitory computer-readable media of claim 20, wherein the object includes a web hyperlink, and the different actions include an open action and a copy action utilizing a browser application.

22. The non-transitory computer-readable media of claim 20, wherein the object includes a date hyperlink, and the different actions include a create action utilizing a calendar application.

23. The non-transitory computer-readable media of claim 20, wherein the object includes at least one hyperlinked aspect of a contact, and the different actions include a first communication type action and a second communication type action.

24. The non-transitory computer-readable media of claim 20, wherein the object includes a physical address hyperlink, and the different actions include showing a physical address utilizing a navigation application.

25. The non-transitory computer-readable media of claim 20, wherein the object includes media, and the different actions include a play action utilizing a media application.

26. The non-transitory computer-readable media of claim 20, wherein the object includes an image, and the different actions include a copy action, a share action, and an open action.

27. A computer program product embodied on a non-transitory computer readable medium, comprising:

at least a portion of an application that is configured to cooperate with a mobile device including a touch screen and a vibrator coupled to at least one processor, where the application, when installed on the mobile device, cooperates with an operating system of the mobile device to cause the mobile device to;

display an object and another object via an interface;

detect a pressure being applied to the touch screen on the object;

when a magnitude of the pressure being detected on the touch screen on the object is less than a first magnitude threshold, display information associated with the object after a cessation of the pressure;

when the magnitude of the pressure being detected on the touch screen on the object is greater than the first magnitude threshold and is less than a second magnitude threshold;

based on an increase in the magnitude of the pressure being detected on the touch screen on the object, increase a blurring of the another object such that the another object appears to be increasing in depth as compared to the object, and

based on a decrease in the magnitude of the pressure being detected on the touch screen on the object, decrease the blurring of the another object such that the another object appears to be decreasing in depth as compared to the object;

when the magnitude of the pressure being detected on the touch screen is greater than the second magnitude threshold and is less than a third magnitude threshold;

display at least part of the interface that is blurred and at least a portion of a window,

sharpen and magnify the at least portion of the window,

display at least a portion of the information associated with the object in the at least portion of the window,

based on another increase in the magnitude of the pressure being detected on the touch screen, increase a size of the at least portion of the window,

based on another decrease in the magnitude of the pressure being detected on the touch screen, decrease the size of the at least portion of the window, and

when a slide gesture is detected being applied to the touch screen;

display a menu including a plurality of items corresponding to different actions in connection with the object; and

when the magnitude of the pressure being detected on the touch screen is greater than the third magnitude threshold, display the information associated with the object.

28. The computer program product of claim 27, wherein the computer program product is configured such that the another increase in the magnitude of the pressure is detected on the touch screen on the at least portion of the window.

29. The computer program product of claim 27, wherein the computer program product is configured such that the increase of the blurring and the increase of the size of the at least portion of the window, both cue a user regarding a status of the magnitude of the pressure being detected on the touch screen.

30. A computer-implemented method, comprising:

developing at least a portion of an application such that the at least portion of the application is configured to cooperate with a mobile device including a touch screen and a memory coupled to at least one processor, the application, when stored on the mobile device, cooperates with an operating system of the mobile device to cause the mobile device to;

display an object and another object, such that the object and the another object are located in a same virtual display layer;

when a magnitude of a pressure being detected on the touch screen on the object is less than a first magnitude threshold, display information associated with the object after a cessation of the pressure;

when the magnitude of the pressure being detected on the touch screen on the object is greater than the first magnitude threshold and is less than a second magnitude threshold;

display the object in a first virtual display layer and the another object in a second virtual display layer that is staggered with respect to the first virtual display layer,

based on an increase in the magnitude of the pressure being detected on the touch screen on the object, increase a blurring of the another object such that the another object appears to increase in depth as compared to the object, and

based on a decrease in the magnitude of the pressure being detected on the touch screen on the object, decrease the blurring of the another object such that the another object appears to decrease in depth as compared to the object;

when the magnitude of the pressure being detected on the touch screen is greater than the second magnitude threshold and is less than a third magnitude threshold;

sharpen and magnify at least a portion of a window,

display at least a portion of the information associated with the object in the at least portion of the window,

based on another increase in the magnitude of the pressure being detected on the touch screen, increase a size of the at least portion of the window,

based on another decrease in the magnitude of the pressure being detected on the touch screen, decrease the size of the at least portion of the window, and

when a slide gesture is detected being applied to the touch screen;

display a menu including a plurality of items corresponding to different actions in connection with the object; and

when the magnitude of the pressure being detected on the touch screen is greater than the third magnitude threshold, display the information associated with the object; and

causing storage of the at least portion of the application.