Window stack models for multi-screen displays

• US 9,285,957 B2
• Filed: 08/31/2011
• Issued: 03/15/2016
• Est. Priority Date: 10/01/2010
• Status: Active Grant

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: Z124 LLC (Flexis)
• Inventors: Sirpal, Sanjiv, Gimpl, Martin, Cassar, Ron, Visosky, John Steven, Csiki, Robert
• Primary Examiner(s): Long, Andrea
• Assistant Examiner(s): HUYNH, LINDA TANG
• Application Number:
  US13/222,970
• Publication Number:
  US 20120084714A1
• Time in Patent Office: 1,658 Days
• Field of Search: 345 11-689, 707600-899, 709200-253, 715200-867
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display

Abstract

Systems and methods are provides for creating a window stack for a multi-screen device. The stack is an arrangement of an active window and at least one other active or inactive window for at least one of the two displays. The system can receive activation of a window in the device. Upon activation of the window, the system can determine a display associated with the active window and can determine a position in the window stack for the active window. Then, the system can generate a logic data structure for the active window to describe the position of the active window in the window stack.

Claims

1. A non-transitory computer readable medium, having stored thereon, computer-executable instructions executable by a processor, the computer-executable instructions causing the processor to execute a method for creating a window stack for a multi-display device, the computer-executable instructions comprising:

instructions to create a first window stack for a first display of the multi-display device, wherein the first window stack is a logical arrangement stored in a memory of the multi-display device that describes a display order of all windows and desktops associated with the first display from a top to a bottom of the first window stack, wherein an inactive window or desktop is not displayed, and wherein the display order of windows and desktops in the first window stack can change based on user input;

instructions to create a second window stack for a second display of the multi-display device, wherein the second window stack is a logical arrangement stored in the memory of the multi-display device that describes a display order of all windows and desktops associated with the second display from a top to a bottom of the second window stack, and wherein the display order of windows and desktops in the second window stack can change based on user input;

instructions to create a logical data structure for each of one or more active windows and two or more inactive windows and desktops in each of the first and second window stacks;

instructions to assign a window identifier for each of the one or more windows and desktops;

instructions to assign a stack position identifier for all windows and desktops that identifies a position of each window and desktop from the top to the bottom of one of the first and the second window stacks;

instructions to receive an input to launch a first application in the multi-display device;

instructions to create a logical data structure for the first application;

instructions to open a first window of the first application;

instructions to assign a window identifier for the first window and store the window identifier in the logical data structure of the first application;

in response to receiving the input to launch the first application, instructions to determine one of the first display and the second display associated with the first window of the first application, wherein a window of a newly launched application can be displayed on either the first display or the second display;

after determining the first display is associated with the first window, instructions to assign a stack position identifier to the first window to indicate that the first window is at a top of the first window stack;

instructions to store the stack position identifier in the logical data structure of the first application;

after assigning the stack position identifier to the first window, instructions to change the stack position identifier for the one or more windows and desktops of the first window stack; and

instructions to display the first window on the first display, wherein the first window is displayed and is visible on at least a portion of the first display, a second window of a second open application is active and is displayed on the second display, and a third window of a third open application is displayed across a portion of both the first and second displays, wherein the third window has a display identifier indicating that the third window is associated with a composite display comprising at least the portion of the first and second displays, wherein the first window, the second window, and the third window are active, and wherein a first display controller is associated with the first display and a second display controller is associated with the second display.

2. The computer readable medium as defined in claim 1, wherein an active window is displayed on at least one of the first and second displays of the multi-display device, and wherein the first window stack is a first portion of a serial stack and the second window stack is a second portion of the serial window stack.

3. The computer readable medium as defined in claim 1, the computer readable medium further comprising:

instructions to execute a multi-display management module operable to manage the display of all applications and desktops on the first and second displays and the movement of an application or desktop from one display to the other display, wherein the input to launch the first application is received by the first display controller, and, in response to the first display controller receiving the input to launch the first application, the multi-display management module associates the first window with the first display.

4. The computer readable medium as defined in claim 3, further comprising instructions to determine, by the multi-display management module, a position in the first window stack for the first window, wherein the position in the first window stack is a position among all windows and desktops in the first window stack.

5. The computer readable medium as defined in claim 3 further comprising:

instructions to execute a task management module, wherein in response to the multi-display management module associating the first window with the first display, the task management module moves a window of the one or more windows and desktops in the first window stack to an inactive position, and the task management module suspends the operation of an application associated with the window, and wherein the first display controller associated with the first display ceases display of the window on the first display.

6. The computer readable medium as defined in claim 1:

wherein the logical data structure of each window and desktop includes an active identifier;

wherein the window identifier is one of a globally unique identifier, a numeric identifier, and an alphanumeric identifier; and

wherein the stack position identifier is one of a globally unique identifier, a numeric identifier, and an alphanumeric identifier.

7. The computer readable medium as defined in claim 1, wherein a stack position identifier of the second window does not change in response to displaying the first window on the first display.

8. The computer readable medium as defined in claim 1, wherein dimensions of the first window can change, and wherein the dimensions comprise one or more of:

coordinates for two or more corners of the first window; and

one coordinate and a height and a width of the first window.

9. The computer readable medium as defined in claim 8, wherein, before receiving the input to launch the first application, at least a portion of the third window is positioned on top of the first window stack and is displayed on the first display of the multi-display device.

10. The computer readable medium as defined in claim 9, wherein a stack position identifier of the third window is changed in response to assigning the top stack position identifier to the first window.

11. The computer readable medium as defined in claim 1, wherein all windows open on the multi-display device can move from the first window stack and the first display to the second window stack and the second display, and from the second window stack and the second display to the first window stack and the first display.

12. A multi-display device comprising:

a first display associated with a first display controller;

a second display associated with a second display controller;

a memory; and

a processor in communication with the memory and each of the first and second displays, the processor programmed to;

create a first window stack for the first display of the multi-display device, wherein the first window stack is a logical arrangement stored in the memory of the multi-display device that describes a display order of all windows and desktops associated with the first display from a top to a bottom of the first window stack, wherein an inactive window or desktop is not displayed, and wherein the display order of windows and desktops in the first window stack can change based on user input;

create a second window stack for the second display of the multi-display device, wherein the second window stack is a logical arrangement stored in the memory of the multi-display device that describes a display order of all windows and desktops associated with the second display from a top to a bottom of the second window stack, and wherein the display order of windows and desktops in the second window stack can change based on user input;

create a logical data structure for each of one or more active windows and two or more inactive windows and desktops in each of the first and second window stacks;

assign a window identifier for each of the one or more windows and desktops;

assign a stack position identifier for all windows and desktops that identifies a position of each window and desktop from the top to the bottom of one of the first and the second window stacks;

receive an input to launch a first application in the multi-display device;

create a logical data structure for the first application;

open a first window of the first application;

assign a window identifier for the first window and store the window identifier in the logical data structure of the first application;

in response to receiving the input to launch the first application, determine one of the first display and the second display associated with the first window of the first application, wherein a window of a newly launched application can be displayed on either the first display or the second display;

after determining the first display is associated with the first window, assign a stack position identifier to the first window to indicate that the first window is at a top of the first window stack;

store the stack position identifier in the logical data structure of the first application;

after assigning the stack position identifier to the first window, change the stack position identifier for the one or more windows and desktops of the first window stack; and

display the first window on the first display, wherein the first window is displayed and is visible on at least a portion of the first display. a second window of a second open application is active and is displayed on the second display, wherein a third window of a third open application is displayed across a portion of both the first and second displays, wherein the third window has a display identifier indicating that the third window is associated with a composite display comprising at least the portion of the first and second displays, wherein the first window, the second window, and the third window are active.

13. The multi-display device as defined in claim 12, wherein, before receiving the input to launch the first application, at least a portion of the third window is positioned on top of the first window stack and is displayed on the first display of the multi-display device.

14. The multi-display device as defined in claim 12, wherein the input to launch the first window is received by the first display controller.

15. The multi-display device as defined in claim 12:

wherein the first window stack is a first portion of a serial stack and the second window stack is a second portion of the serial window stack;

wherein the logic data structure includes an active identifier;

wherein the window identifier is one of a globally unique identifier, a numeric identifier, and an alphanumeric identifier; and

wherein the stack position identifier is one of a globally unique identifier, a numeric identifier, and an alphanumeric identifier.

16. The multi-display device as defined in claim 12, further comprising:

a multi-display management module operable to determine to which of the first display and the second display a newly launched window should be associated, wherein the newly launched window can be associated with either one of the first display and the second display; and

a task management module operable to suspend the operation of applications associated with windows that are inactive.

17. A method for creating a window stack in a multi-display device, the method comprising:

a processor executing a framework, a desktop, and an Application Manager;

the desktop providing at least one icon representing a first application;

creating a first window stack for a first display of the multi-display device, wherein the first window stack is a logical arrangement stored in a memory of the multi-display device that describes a display order of all windows and desktops associated with the first display from a top to a bottom of the first window stack, wherein an inactive window or desktop is not displayed, and wherein the display order of windows and desktops in the first window stack can change based on user input;

creating a second window stack for a second display of the multi-display device, wherein the second window stack is a logical arrangement stored in the memory of the multi-display device that describes a display order of all windows and desktops associated with the second display from a top to a bottom of the second window stack, and wherein the display order of windows and desktops in the second window stack can change based on user input;

creating a logical data structure for each of one or more active windows and two or more inactive windows and desktops in each of the first and second window stacks;

assigning a window identifier for each of the one or more windows and desktops;

assigning a stack position identifier for all windows and desktops that identifies a position of each window and desktop from the top to the bottom of one of the first and the second window stacks;

the framework receiving an input to launch the first application;

creating a logical data structure for the first application;

opening a first window of the first application;

assigning a window identifier for the first window and storing the window identifier in the logical data structure of the first application;

the framework determining at least a portion of the first display and the second display or a composite display to render a first window associated with the first application, wherein the composite display comprises at least the portion of the first and second displays, and wherein a window of a newly launched application can be displayed on the first display, the second display, or the composite display;

after determining the first display is associated with the first window, assigning a stack position identifier to the first window to indicate that the first window is at a top of the first window stack;

storing the stack position identifier in the logical data structure of the first application;

after assigning the stack position identifier to the first window, changing the stack position identifier for the one or more windows and desktops of the first window stack; and

displaying the first window on the first display, wherein the first window is displayed and is visible on at least aportion of the first display, a second window of a second open application is active and is displayed on the second display, and a third window of a third open application is displayed across a portion of both the first and second displays, wherein the third window has a display identifier indicating that the third window is associated with the composite display, wherein the first window, the second window, and the third window are active, and wherein a first display controller is associated with the first display and a second display controller is associated with the second display.

18. The method defined in claim 17, wherein the window identifier is one of a globally unique identifier, a numeric identifier, and an alphanumeric identifier.

19. The method defined in claim 17, wherein the first and second window stacks include all windows and desktops executing on the multi-display device, and wherein the first window is also associated with an identifier for the composite display of the multi-display device.

20. The method defined in claim 17, wherein the first window stack is a first portion of a serial stack and the second window stack is a second portion of the serial window stack.

21. The method defined in claim 20, further comprising the framework rendering the composite display, wherein the composite display includes at least the third window.