Method and system for viewing stacked screen displays using gestures

• US 9,213,365 B2
• Filed: 09/28/2011
• Issued: 12/15/2015
• Est. Priority Date: 10/01/2010
• Status: Active Grant

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: Z124 LLC (Flexis)
• Inventors: Sirpal, Sanjiv, Faulk, Brett, Reeves, Paul, de Paz, Alexander, Schrock, Rodney Wayne, Visosky, John Steven, Freedman, Eric, Ficklin, Jared, Burton, Denise, Cripps, Misty, Wygonik, Gregg
• Primary Examiner(s): Lubit, Ryan A
• Assistant Examiner(s): Cohen, Yaron
• Application Number:
  US13/247,971
• Publication Number:
  US 20120105363A1
• Time in Patent Office: 1,539 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1649 the additional display being independently orientable, e.g. for presenting information to a second user
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An intuitive technique for inputting user gestures into a handheld computing device is disclosed allowing a user to better manipulate different types of screen display presentations, such as desktops and application windows, when performing tasks thereon, wherein a window stack for application windows and/or desktops can be navigated and sequentially displayed according to the window stack ordering without disturbing or changing this ordering.

Claims

1. A method for configuring a mobile multi-display device having a first touch sensitive display and a second touch sensitive display for displaying a plurality of windows and desktops, comprising:

placing the multi-display device in an open state with the first and second touch sensitive displays facing in a same direction;

displaying a first window on the first and second touch sensitive displays, wherein the first window is a dual-display window, wherein dual-display windows can be displayed on at least one of the first and second touch sensitive displays;

receiving a first user finger gesture input to a gesture capture area of the multi-display device, the gesture capture area operatively associated with at least one of the first and second touch sensitive displays, but being separate therefrom;

interpreting the first user finger gesture input as a request for navigating a window stack ordering of the plurality of windows and desktops, data for the window stack ordering stored in a non-transient data storage, wherein the window stack ordering is a logical arrangement of active and inactive windows and desktops;

in response to the interpreting, determining a second window to present on at least one of the first and second touch sensitive displays, wherein the second window is identified as immediately preceding or immediately following, in the window stack ordering, the first window;

determining whether the second window is a dual-display window;

when the second window is a dual-display window;

moving the first window off of the first and second touch sensitive displays in a direction of the first user finger gesture input;

ceasing to display the first window on the first and second touch sensitive displays; and

displaying the second window on the first and second touch sensitive displays; and

when the second window is not a dual-display window;

determining a third window to present on one of the first and second touch sensitive displays, wherein the third window is identified as immediately preceding or immediately following, in the window stack ordering, the second window;

moving the first window off of the first and second touch sensitive displays in a direction of the first user finger gesture input and ceasing to display the first window on the first and second touch sensitive displays;

displaying the second window on one of the first and second touch sensitive displays; and

displaying the third window on an other one of the first and second touch sensitive displays, wherein when the third window is a dual-display window, the third window is displayed on only the other one of the first and second touch sensitive displays in a single-display mode.

2. The method of claim 1, wherein the gesture capture area includes a capacitive touch sensitive area for receiving the user gesture input, and wherein the first and second touch sensitive displays and the gesture capture area are on a common first screen.

3. The method of claim 1, wherein the gesture capture area is not capable of displaying any windows and desktops, wherein the gesture capture area comprises a first gesture capture area and a second gesture capture area, wherein the first touch sensitive display and the first gesture capture area are on a first screen, and wherein the second touch sensitive display and the second gesture capture area are on a different second screen.

4. The method of claim 1, wherein after the second window is displayed, the window stack ordering is unchanged from before the step of determining the second window to present.

5. The method of claim 4, comprising:

determining the second window is not a dual-display window and displaying the second window on one of the first and second touch sensitive displays and the third window on the other one of the first and second touch sensitive displays;

receiving a second user finger gesture input to the gesture capture area;

interpreting the second user finger gesture input as a second request for navigating the window stack ordering of the plurality of windows and desktops;

determining a fourth window to present on at least one of the first and second touch sensitive displays, wherein the fourth window is identified as immediately preceding or immediately following, in the window stack ordering, the third window;

moving the second window off of the one of the first and second touch sensitive displays in a direction of the second user finger gesture input and second ceasing to display the second window;

moving the third window to the one of the first and second touch sensitive displays in the direction of the second user finger gesture input; and

displaying the fourth window on the other one of the first and second touch sensitive displays.

6. The method of claim 5, wherein when the fourth window is a dual-display window, the fourth window is displayed on only the other one of the first and second touch sensitive displays in a single-display mode.

7. The method of claim 5, wherein each of the first user gesture input and the second user gesture input is interpreted as being for a same user gesture.

8. The method of claim 7, wherein the user gesture input includes one of:

a drag, and a flick, wherein the drag includes an initial contact with the gesture capture area and a contact movement in one of a first direction and a second direction, wherein the flick includes the initial contact with the gesture capture area and a truncated contact movement in one of the first direction and the second direction, and wherein the second direction is substantially opposite of the first direction.

9. The method of claim 4, further including:

determining the second window is a dual-display window and displaying the second window on the first and second touch sensitive displays;

receiving a user finger gesture input to the second window;

interpreting the user finger gesture input as a request to change the window stack ordering;

changing the window stack ordering as a result of the user finger gesture input while continuing to display the second window, wherein the second window becomes an uppermost window in the window stack ordering;

receiving a second user finger gesture input to the gesture capture area of the multi-display device;

interpreting the second user finger gesture input as a second request for navigating down the changed window stack ordering of the plurality of windows and desktops;

determining a next window to present on at least one of the first and second touch sensitive displays, wherein the next window is identified as immediately following the second window in the changed window stack ordering, and wherein the first window is the next window;

moving the second window off of the first and second touch sensitive displays in a direction of the second user finger gesture input;

ceasing to display the second window on the first and second touch sensitive displays; and

displaying the first window on the first and second touch sensitive displays.

10. The method of claim 1, wherein there is a predetermined collection of a plurality of user finger gesture input descriptions for recognizing user gesture inputs that are interpretable in the step of interpreting.

19. The method of claim 8, wherein when the multi-display device is in a portrait display mode, the first direction is toward a left side of the gesture capture area and the first direction is used to navigate down the window stack ordering, and the second direction is toward a right side of the gesture capture area and the second direction is used to navigate up the window stack ordering.

20. The method of claim 1, comprising:

determining the second window is not a dual-display window;

displaying the second window on one of the first and second touch sensitive displays and the third window on the other one of the first and second touch sensitive displays;

receiving a second user finger gesture input to the gesture capture area;

interpreting the second user finger gesture input as a second request for navigating the window stack ordering of the plurality of windows and desktops;

determining there is no window identified as immediately preceding or immediately following the third window in the window stack ordering, wherein the third window is one of a top of the window stack and a bottom of the window stack, and wherein the first window is an other one of the top of the window stack and the bottom of the window stack;

moving the second window off of the one of the first and second touch sensitive displays and second ceasing to display the second window;

moving the third window to the one of the first and second touch sensitive displays in the direction of the second user finger gesture input; and

displaying the first window on the other one of the first and second touch sensitive displays, wherein the first window is displayed on only the other one of the first and second touch sensitive displays in the single-display mode.

11. A non-transitory computer readable medium for configuring a dual-display device having a first touch sensitive display and a second touch sensitive display for displaying a plurality of windows and desktops, comprising:

machine instructions that;

display a first window on the first and second touch sensitive displays, wherein the first window is a dual-display window, wherein dual-display windows can be displayed on at least one of the first and second touch sensitive displays, and wherein the device is in an open state with the first and second touch sensitive displays facing in a same direction;

receive a first user finger gesture input to a gesture capture area of the device, the gesture capture area operatively associated with at least one of the first and second touch sensitive displays, but being separate therefrom;

interpret the first user finger gesture input as a request for navigating a window stack ordering of the plurality of windows and desktops, data for the window stack ordering stored in a non-transient data storage, wherein the window stack ordering is a logical arrangement of active and inactive windows and desktops;

in response to the step of interpreting, determine a second window to present on at least one of the first and second touch sensitive displays, wherein the second window is identified as immediately preceding or immediately following, in the window stack ordering, the first window;

determine whether the second window is a dual-display window;

when the second window is a dual-display window;

move the first window off of the first and second touch sensitive displays in a direction of the first user finger gesture input;

cease to display the first window on the first and second touch sensitive displays; and

display the second window on the first and second touch sensitive displays; and

when the second window is not a dual-display window;

determine a third window to present on one of the first and second touch sensitive displays, wherein the third window is identified as immediately preceding or immediately following, in the window stack ordering, the second window;

move the first window off of the first and second touch sensitive displays in a direction of the first user finger gesture input and ceasing to display the first window on the first and second touch sensitive displays;

display the second window on one of the first and second touch sensitive displays; and

display the third window on an other one of the first and second touch sensitive displays, wherein when the third window is a dual-display window, the third window is displayed on only the other one of the first and second touch sensitive displays in a single-display mode.

12. The non-transitory computer readable medium of claim 11, wherein the window stack ordering of the windows and desktops remains unchanged, wherein the first touch sensitive display is on a first screen, and wherein the second touch sensitive display is on a different second screen.

13. The non-transitory computer readable medium of claim 11, wherein the machine instructions further perform the following steps:

receiving, after determining the second window is not a dual-display window, a second user finger gesture input to the gesture capture area of the device;

interpreting the second user finger gesture input as a second request for navigating the window stack ordering of the plurality of windows and desktops;

determining a fourth window to present on at least one of the first and second touch sensitive displays, wherein the fourth window is identified as immediately preceding or immediately following, in the window stack ordering, the third window;

ceasing to display the second window on the one of the first and second touch sensitive displays;

moving the third window to the one of the first and second touch sensitive displays in the direction of the second user finger gesture input; and

displaying the fourth window on the other one of the first and second touch sensitive displays, wherein the first and second touch sensitive displays are on a common first screen.

14. The non-transitory computer readable medium of claim 13, wherein the machine instructions further perform the following steps:

after displaying the fourth window on the other one of the first and second touch sensitive displays, receiving a user finger gesture input to the third window displayed on the one of the first and second touch sensitive displays;

interpreting the user finger gesture input as a request to change the window stack ordering; and

changing the window stack ordering as a result of the user finger gesture input, wherein the third window becomes an uppermost window in the window stack ordering.

15. A hand-held device, comprising:

a first touch sensitive display and a second touch sensitive display for displaying a plurality of windows and desktops;

a gesture capture area associated with at least one of the first and second touch sensitive displays that receives a first user finger gesture input, the gesture capture area being separate from the first and second touch sensitive displays, the gesture capture area not being capable of displaying any of the windows and desktops;

wherein the first and second touch sensitive displays are responsive to user touch for receiving a second user finger gesture input;

a display manager that determines which of the plurality of windows and desktops are displayed on the first and second touch sensitive displays;

a gesture interpreter that interprets each of the first and second user finger gesture inputs for determining an action to perform on the first and second touch sensitive displays, wherein the gesture interpreter compares each of the first and second user finger gesture inputs with a predetermined collection of a plurality of user gesture input descriptions for recognizing user gesture inputs that are interpretable;

a non-transient data storage that stores data indicative of a window stack ordering of the plurality of windows and desktops, wherein the window stack ordering is a logical arrangement of active and inactive windows and desktops;

wherein for a first window of the plurality of windows and desktops displayed on the first and second touch sensitive displays, when the first user gesture input is received, the display manager determines a second window to present on at least one of the first and second touch sensitive displays, wherein the first window is a dual-display window, wherein the display manager identifies the second window as immediately preceding or immediately following, in the window stack ordering, the first window;

wherein, when the second window is a dual-display window, the display manager replaces the first window on the first and second touch sensitive displays with a display of the second window;

wherein, when the second window is not a dual-display window, the display manager determines a third window to present on at least one of the first and second touch sensitive displays, wherein the display manager identifies the third window as immediately preceding or immediately following, in the window stack ordering, the second window, wherein the display manager replaces the first window on the first and second touch sensitive displays with a display of the second window on one of the first and second touch sensitive displays and a display of the third window on an other one of the first and second touch sensitive displays, and wherein, when the third window is a dual-display window, the the display manager displays the third window in a single-display mode; and

wherein the window stack ordering is unchanged after the replacement of the first window with the display of the second window.

16. The device of claim 15, further including a task manager, wherein when data indicative of the second user finger gesture input is received by the display manager after the second window is displayed, the task manager changes the window stack ordering so that the second window is represented as being at a top of the window stack ordering, and wherein the first and second touch sensitive displays are on a common first screen.

17. The device of claim 15, wherein the gesture capture area comprises a first gesture capture area and a second gesture capture area, wherein the first touch sensitive display and the first gesture capture area are on a first screen, and wherein the second touch sensitive display and the second gesture capture area are on a different second screen.

18. The device of claim 17, further including:

an attachment configured to foldably connect the first screen with the second screen;

a first sensor configured to produce a first signal indicative of a fold position of the first and second screens relative to one another; and

a non-transitory computer-readable medium having instructions stored thereon that include;

a first set of the instructions configured to determine that the device has moved from a first physical orientation to a different second physical orientation, wherein the first and second physical orientations differ by the first physical orientation being one of;

folded or in a landscape orientation;

wherein the window stack ordering does not change as a result of folding the device, and the ordering does not change as a result of unfolding the device.