User interface with stacked application management

• US 10,318,106 B2
• Filed: 06/08/2015
• Issued: 06/11/2019
• Est. Priority Date: 10/01/2010
• Status: Active Grant

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: Z124 LLC (Flexis)
• Inventors: Sirpal, Sanjiv
• Primary Examiner(s): Xiao, Di
• Application Number:
  US14/733,669
• Publication Number:
  US 20150268851A1
• Time in Patent Office: 1,464 Days
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display

Abstract

Methods and apparatus for controlling a computing device using gesture inputs. The gesture inputs may be operative to move screens corresponding to applications executing on the handheld computing device from one display to another. Additionally, a multi portion gesture may be used to target different screens. For example, a first portion of the gesture may maintain or “pin” a screen in a display such that a second portion of the gesture is operative to move a different screen behind the pinned application.

Claims

1. A method for controlling a handheld computing device, comprising:

providing a first screen and a second screen associated with the handheld computing device;

logically associating one or more applications with the first screen of the handheld computing device;

logically associating one or more applications with the second screen of the handheld computing device;

establishing a first application stack corresponding to the one or more applications logically associated with the first screen, wherein the first application stack is a first logical representation of the one or more applications logically associated with the first screen, wherein the first logical representation is a data structure and comprises a relative order of the one or more applications logically associated with the first screen, and wherein one or more of the one or more applications logically associated with the first screen may not be displayed on the first screen;

establishing a second application stack corresponding to the one or more applications logically associated with the second screen, wherein the second application stack is a second logical representation of the one or more applications logically associated with the second screen, wherein the second logical representation is a data structure and comprises a relative order of the one or more applications logically associated with the second screen, wherein one or more of the one or more applications logically associated with the second screen may not be displayed on the second screen;

receiving a gesture input at a gesture sensor of the handheld computing device, wherein the gesture sensor is not associated with the first screen or the second screen;

adding a first application belonging to the first application stack to a second application stack logically associated with a second screen in response to the receiving step such that the first application is logically associated with the second screen, wherein moving further includes expanding the first application to be the actively displayed screen of the first screen and the actively displayed screen of the second screen;

maintaining the relative order of the one or more applications of the first application stack such that the first application stays at a top position in the first application stack; and

reordering the relative order of the one or more applications of the second application stack such that the moved first application is also at a top position in the second application stack.

2. The method according to claim 1, wherein the first application comprises an actively displayed screen of the first screen prior to the moving step and an actively displayed screen of the second screen after the moving step.

3. The method according to claim 2, wherein an underlying screen is revealed in the first screen after the moving step.

4. The method according to claim 3, wherein the underlying screen comprises one of a desktop screen and an application screen corresponding to a second application logically associated with the first screen such that the second application belongs to the first application stack.

5. The method according to claim 2, wherein the first application obscures a second screen in the second screen that comprises an actively displayed screen of the second screen prior to the moving step.

6. The method according to claim 5, wherein the second screen comprises one of a desktop screen and an application screen corresponding to a second application of a second application stack.

7. The method according to claim 1, wherein the gesture input comprises a first gesture portion and a second gesture portion.

8. The method according to claim 7, wherein the gesture input comprises a pin and drag gesture.

9. The method according to claim 7, wherein the first gesture portion maintains the actively displayed screen in a corresponding application stack, and wherein the second gesture portion results in movement of the first application relative to the actively displayed screen of a corresponding application stack.

10. The method according to claim 9, wherein the corresponding application stack is the first application stack, and the second gesture portion is directed away from the first gesture portion.

11. The method according to claim 9, wherein the first application is revealed in the second screen after the moving step.

12. The method according to claim 9, wherein the corresponding application stack is the second application stack, and the second gesture portion is directed toward the first gesture portion.

13. The method according to claim 12, wherein the first application is hidden in the second screen after the moving step.

14. A method of controlling a handheld computing device comprising:

providing a first screen and a second screen associated with the handheld computing device;

logically associating one or more applications with the first screen of the handheld computing device, the logical association being a first application stack data structure and comprising a relative order of the one or more applications, wherein one or more of the one or more applications logically associated with the first screen may not be screened on the first screen;

logically associating one or more applications with the second screen of the handheld computing device, the logical association being a second application stack data structure comprising a relative order of the one or more applications, wherein one or more of the one or more applications logically associated with the second screen may not be displayed on the second screen;

receiving a first portion of a gesture input, wherein the gesture input is received in a gesture capture region not associated with the first screen or the second screen;

targeting the first portion of the gesture input to a first screen having a first actively displayed screen corresponding to a first application;

maintaining the first actively screened screen in the first screen in response to the first portion of the gesture input;

receiving a second portion of the gesture input;

targeting a different screen than the actively displayed screen in the first screen with the second portion; and

wherein the different screen undergoes a change in position with respect to the first screen and a second screen in response to the second portion of the gesture input;

moving a first application belonging to the first application stack data structure to the second application stack data structure logically associated with the second screen in response to at least one of the receiving steps such that the first application is logically associated with the second screen; and

reordering the relative order of the one or more applications of the second application stack data structure such that the moved first application is at a top position in the second application stack data structure.

15. The method according to claim 14, wherein the first portion and the second portion of the gesture input are received at a gesture sensor associated with the first screen such that the different screen corresponds to a second application residing behind said first application.

16. The method according to claim 14, wherein the first portion of the gesture input is received at a gesture sensor associated with the first screen and the second portion of the gesture input is received at a gesture sensor associated with the second screen, wherein the different screen is moved from the second screen to the first screen behind the first screen.

17. The method according to claim 14, wherein the screens targeted in the corresponding steps at least partially depend upon a location where the corresponding portion of the gesture input is received.

18. A handheld computing device comprising:

a first display;

a second display;

a processor; and

a memory coupled with and readable by the processor and storing therein a set of instructions which, when executed by the processor, causes the processor to control application screens rendered on the first display and second display by;

logically associating one or more applications with the first display of the handheld computing device;

logically associating one or more applications with the second display of the handheld computing device;

establishing a first application stack corresponding to the one or more applications logically associated with the first display, wherein the first application stack is a first logical representation of the one or more applications logically associated with the first display, wherein the first logical representation is a data structure and comprises a relative order of the one or more applications logically associated with the first display, wherein a screen of one or more of the one or more applications logically associated with the first display may not be displayed on the first screen;

establishing a second application stack corresponding to the one or more applications logically associated with the second display, wherein the second application stack is a second logical representation of the one or more applications logically associated with the second display, wherein the second logical representation is a data structure and comprises a relative order of the one or more applications logically associated with the second display, wherein one or more of the one or more applications logically associated with the second display may not be displayed on the second display;

receiving a gesture input at a gesture sensor of the handheld computing device, wherein the gesture sensor is not associated with the first display or the second display;

adding a first application belonging to the first application stack to the second application stack in response to the receiving step such that the first application is logically associated with the second display, wherein moving further includes expanding the first application to be the actively displayed screen of the first display and the actively displayed screen of the second display;

maintaining the relative order of the one or more application of the first application stack such that the first application stays at a top position in the first application stack; and

reordering the relative order of the one or more applications of the second application stack such that the moved first application is also at a top position in the second application stack.

19. The handheld computing device according to claim 18, wherein the first application obscures a second screen in the second screen that comprises an actively displayed screen of the second screen prior to the moving step.

20. The handheld computing device according to claim 19, wherein the second screen comprises one of a desktop screen and an application screen corresponding to a second application of a second application stack.