Unified desktop freeform window mode

• US 9,069,518 B2
• Filed: 03/30/2012
• Issued: 06/30/2015
• Est. Priority Date: 09/27/2011
• Status: Active Grant

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: Z124 LLC (Flexis)
• Inventors: Reeves, Paul E., Sirpal, Sanjiv, Gimpl, Martin
• Primary Examiner(s): Tran, Tuyetlien
• Assistant Examiner(s): Posigian, David S
• Application Number:
  US13/436,593
• Publication Number:
  US 20130080938A1
• Time in Patent Office: 1,187 Days
• Field of Search: 715/761
• US Class Current: 1/1
• CPC Class Codes: B29D 11/00673 Supports for light guides
• CPC Class Codes: E05D 3/12 with two parallel pins and one arm
• CPC Class Codes: E05Y 2999/00 Subject-matter not otherwise provided for in this subclass
• CPC Class Codes: G02B 6/0001 specially adapted for lighting devices or systems lighting or signalling on vehicles using light guides B60Q1/00; lighting devices for vehicle dashboards B60Q3/10; lighting devices for vehicle interior using light guides B60Q3/62; lighting devices mounted on the vehicle rear part using light guides F21S43/235; measuring arrangements having light conducting pointers G01D13/265; illumination of liquid crystal displays G02F1/1336; illuminated signs G09F13/00
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 1/1601 Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64
• CPC Class Codes: G06F 1/1605 Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1618 the display being foldable up to the back of the other housing with a single degree of freedom, e.g. by 360° rotation over the axis defined by the rear edge of the base enclosure
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 1/1649 the additional display being independently orientable, e.g. for presenting information to a second user
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 1/1681 Details related solely to hinges hinge details related to the transmission of signals or power are classified in G06F1/1683
• CPC Class Codes: G06F 1/1683 for the transmission of signal or power between the different housings, e.g. details of wired or wireless communication, passage of cabling
• CPC Class Codes: G06F 1/1692 the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: G06F 2203/04803 : Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/00 : Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 : with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 : Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 : Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 : Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 : by capacitive means
• CPC Class Codes: G06F 3/048 : Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 : based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04817 : using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 : Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 : for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 : Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 : Scrolling or panning
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/0487 : using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04897 : Special input arrangements or commands for improving display capability
• CPC Class Codes: G06F 3/1423 : controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1438 : using more than one graphics controller
• CPC Class Codes: G06F 3/1446 : display composed of modules, e.g. video walls
• CPC Class Codes: G06F 3/1454 : involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/00 : Arrangements for program control, e.g. control units program control for peripheral devices G06F13/10
• CPC Class Codes: G06F 9/44 : Arrangements for executing specific programs
• CPC Class Codes: G06F 9/451 : Execution arrangements for user interfaces
• CPC Class Codes: G06G 1/00 : Hand manipulated computing devices planimeters G01B5/26
• CPC Class Codes: G06T 3/00 : Geometric image transformations in the plane of the image
• CPC Class Codes: G06T 3/20 : Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/40 : Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G09G 1/00 : Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of datacathode-ray oscilloscopes G01R13/20; radar display arrangements G01S7/04; display of digital non-picture data in television systems H04N7/0255
• CPC Class Codes: G09G 2300/023 : Display panel composed of stacked panels
• CPC Class Codes: G09G 2330/021 : Power management, e.g. power saving
• CPC Class Codes: G09G 2354/00 : Aspects of interface with display user
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/12 : Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: G09G 5/14 : Display of multiple viewports
• CPC Class Codes: G09G 5/34 : for rolling or scrolling
• CPC Class Codes: G09G 5/373 : for modifying the size of the graphic pattern
• CPC Class Codes: G09G 5/377 : for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04B 1/3833 : Hand-held transceivers
• CPC Class Codes: H04M 1/0206 : Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
• CPC Class Codes: H04M 1/0214 : Foldable telephones, i.e. with body parts pivoting to an open position around an axis parallel to the plane they define in closed position combined with translation movement H04M1/0235
• CPC Class Codes: H04M 1/0216 : Foldable in one direction, i.e. using a one degree of freedom hinge
• CPC Class Codes: H04M 1/0266 : for a display module assembly
• CPC Class Codes: H04N 21/4316 : for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/47 : End-user applications
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/631 : Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 5/222 : Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2628 : Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04W 24/02 : Arrangements for optimising operational condition
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 48/18 : Selecting a network or a communication service
• CPC Class Codes: H04W 68/00 : User notification, e.g. alerting and paging, for incoming communication, change of service or the like
• CPC Class Codes: H04W 72/563 : of the wireless resources
• CPC Class Codes: H04W 88/02 : Terminal devices
• CPC Class Codes: H04W 88/06 : adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H05K 13/00 : Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
• CPC Class Codes: H05K 13/046 : Surface mounting surface mounted components H05K3/341
• CPC Class Codes: H05K 5/0017 : with operator interface units
• CPC Class Codes: H05K 5/0226 : Hinges
• CPC Class Codes: H05K 5/04 : Metal casings
• CPC Class Codes: H05K 7/02 : Arrangements of circuit components or wiring on supporting structure
• CPC Class Codes: H05K 7/1452 : Mounting of connectors; Switching; Reinforcing of back panels
• CPC Class Codes: Y10T 29/49826 : Assembling or joining
• CPC Class Codes: Y10T 29/4984 : Retaining clearance for motion between assembled parts

Abstract

Methods and devices for selectively presenting a user interface or “desktop” across two devices are provided. More particularly, a unified desktop is presented across a device and a computer system. The unified desktop acts as a single user interface that presents data and receives user interaction in a seamless environment that emulates a personal computing environment. To function within the personal computing environment, freeform windows are generated to encapsulate user interfaces for device applications. The freeform windows allow the user interfaces for the device applications to function as other windows in the personal computing environment.

Claims

1. A method, comprising:

connecting a device to a computer system to form a unified system, wherein the device includes a first processor, a first memory, and a first screen, and wherein the computer system includes a second processor, a second memory, and a second screen;

generating, by the device, a unified desktop for the unified system, wherein the unified desktop is displayed on the first screen of the device and the second screen of the computer system, wherein the unified desktop includes a first user interface displayed on the first screen of the device and a second user interface displayed on the second screen of the computer system, wherein the second user interface replaces a desktop associated with the computer system, and wherein the unified desktop emulates a personal computer environment;

determining, by the device, one or more status indicators to present in the first user interface and the second user interface of the unified desktop, wherein the status indicators provide information about the device and about the computer system;

presenting, by the device, the one or more status indicators in the first user interface and the second user interface of the unified desktop, wherein the one or more status indicators presented in the first user interface are different from the one or more status indicators presented in the second user interface;

executing, by the device, a device application associated with the device in the unified desktop;

providing, by the device, a freeform window for a third user interface associated with the device application in the unified desktop, wherein the freeform window allows the device application to display on the second user interface in the unified desktop and emulate a window in the personal computer environment;

determining, by the device, one or more features of the device application that do not function in the personal computer environment;

providing, by the device, a first user interface device, associated with the freeform window, to enable at least one of the one or more features of the device application that do not function in the personal computer environment;

determining, by the device, one or more device application controls that do not function in the personal computer environment; and

providing, by the device, a second user interface device, associated with the freeform window, to enable at least one of the one or more device application controls that do not function in the personal computer environment, wherein the second user interface device is a button in the freeform window.

2. The method of claim 1, wherein the freeform window allows the device application to expand or contract the third user interface, wherein the freeform window allows the device application to maximize the third user interface, wherein the freeform window allows the device application to shrink the third user interface, and wherein the freeform window allows the device application to close the third user interface and stop execution of the device application.

3. The method of claim 1, wherein the first screen of the device includes a first display and a different second display, and wherein the unified desktop is displayed on the first and second displays of the first screen of the device and the second screen of the computer system.

4. The method of claim 1, further comprising:

receiving, by the device, a selection of a first status indicator of the one or more status indicators provided in the second user interface;

determining, by the device, that the first status indicator is associated with the device;

providing, by the device, further information about the device in the second user interface; and

providing, by the device, a third user interface device in the second user interface, wherein the third user interface device is associated with the first status indicator.

5. The method of claim 4, further comprising:

receiving, by the device, a selection of the third user interface device; and

providing, by the device, a device settings user interface in the second user interface associated with the first status indicator.

6. The method of claim 1, wherein the device application is one of a phone application, a text messaging application, a utilities application, a game application, or a mobile application.

7. The method of claim 1, further comprising:

displaying at least one device application shortcut in the unified desktop; and

receiving a selection of a device application shortcut in the unified desktop.

8. The method of claim 1, wherein the first screen of the device includes a first display, wherein a different second screen of the device includes a second display, and wherein the unified desktop is displayed on the first and second displays of the device and the second screen of the computer system.

9. A unified system, comprising:

a computer system comprising;

a first screen;

a first processor; and

a first memory, wherein the computer displays a desktop on the first screen;

a device comprising;

a second screen;

a second memory; and

a second processor;

wherein when the computer system and the device are connected to form the unified system, the device is operable to;

generate a unified desktop for the unified system, wherein the unified desktop includes a first user interface associated with the device and a second user interface associated with the computer system, and wherein the unified desktop emulates a personal computer environment;

provide the unified desktop over both the first screen of the computer system and the second screen of the device, wherein the unified desktop includes the first user interface displayed on the second screen of the device and the second user interface displayed on the first screen of the computer system, wherein the second user interface replaces the desktop displayed by the first screen of the computer system;

determine one or more status indicators to present in the first user interface and the second user interface of the unified desktop, wherein the status indicators provide information about the device and about the computer system;

present the one or more status indicators in the first user interface and the second user interface of the unified desktop, wherein the one or more status indicators presented in the first user interface are different from the one or more status indicators presented in the second user interface;

execute a device application associated with the device in the unified desktop, wherein the device application is executed by the device;

provide a freeform window for a user interface associated with the device application in the unified desktop, wherein the freeform window allows the device application to display on the second user interface in the unified desktop and emulate a window in the personal computer environment;

determine one or more device application features that do not function in the personal computer environment;

provide a first user interface device, associated with the freeform window, to enable at least one of the one or more device application features that do not function in the personal computer environment;

determine one or more device application controls that do not function in the personal computer environment; and

provide a second user interface device, associated with the freeform window, to enable at least one of the one or more device application controls that do not function in the personal computer environment, wherein the second user interface device is a button in the freeform window.

10. The unified system of claim 9, wherein the freeform window allows the device application to display at least partially over another window.

11. The unified system of claim 10, wherein the freeform window allows the device application to display at least partially behind another window.

12. The unified system of claim 11, further comprising receiving selection of the device application in the unified desktop, wherein a user selects a shortcut displayed in the unified desktop to select the device application.

13. The unified system of claim 9, wherein the second screen of the device includes a first display and a different second display, and wherein the first user interface is displayed on the first and second displays of the second screen of the device.

20. The unified system of claim 9, wherein the second screen of the device includes a second display, wherein a different screen of the device includes a different first display, and wherein the first user interface is displayed on the first and second displays of the device.

14. A non-transitory computer readable medium having stored thereon computer-executable instructions, the computer executable instructions causing a processor running in a device to execute a method for providing a unified desktop, the computer-executable instructions comprising:

instructions to connect the device to a computer system to form a unified system, wherein the device includes a first processor, a first memory, and a first screen, and wherein the computer system includes a second processor, a second memory, and a second screen;

instructions to generate the unified desktop for the unified system, wherein the unified desktop includes a first user interface associated with the device and a second user interface associated with the computer system, and wherein the unified desktop emulates a personal computer environment;

instructions to provide the unified desktop over both the first screen of the device and the second screen of the computer system, wherein the unified desktop includes the first user interface displayed on the first screen of the device and the second user interface displayed on the second screen of the computer system, wherein the second user interface replaces a desktop associated with the computer system;

instructions to determine one or more status indicators to present in the first user interface and the second user interface of the unified desktop, wherein the status indicators provide information about the device and about the computer system;

instructions to present the one or more status indicators in the first user interface and the second user interface of the unified desktop, wherein the one or more status indicators presented in the first user interface are different from the one or more status indicators presented in the second user interface;

instructions to execute a device application associated with the device in the unified desktop, wherein the device application is executed by the device;

instructions to provide a freeform window for a user interface associated with the device application in the unified desktop, wherein the freeform window allows the device application to display on the second user interface in the unified desktop and emulate a window in the personal computer environment;

instructions to determine one or more device application features that do not function in the personal computer environment;

instructions to provide a first user interface device, associated with the freeform window, to enable at least one of the one or more device application features that do not function in the personal computer environment;

instructions to determine one or more device application controls that do not function in the personal computer environment; and

instructions to provide a second user interface device, associated with the freeform window, to enable at least one of the one or more device application controls that do not function in the personal computer environment, wherein the second user interface device is a button in the freeform window.

15. The non-transitory computer readable medium of claim 14, wherein a third user interface device, associated with the freeform window, accesses previous information displayed by the device application.

16. The non-transitory computer readable medium of claim 15, wherein a fourth user interface device, associated with the freeform window, exits or stops execution of the device application.

17. The non-transitory computer readable medium of claim 16, wherein a fifth user interface device, associated with the freeform window, expands the device application user interface into the entire freeform window, and wherein a sixth user interface device, associated with the freeform window, changes the device application to a second user interface.

18. The non-transitory computer readable medium of claim 14, wherein the first screen of the device includes a first display and a second display, and wherein the first user interface is displayed on the first and second displays of the device.

19. The non-transitory computer readable medium of claim 14, wherein the device includes the first screen with a first display and a different second screen with a second display, and wherein the first user interface is displayed on the first and second displays of the device.