METHOD AND SYSTEM FOR PERFORMING COPY-PASTE OPERATIONS ON A DEVICE VIA USER GESTURES

• US 20120081317A1
• Filed: 09/28/2011
• Published: 04/05/2012
• Est. Priority Date: 10/01/2010
• Status: Abandoned Application

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: IMERJ LLC (Flex, Ltd.)
• Inventors: Sirpal, Sanjiv, Reeves, Paul, de Paz, Alexander, Burton, Denise, Ficklin, Jared, Wygonik, Gregg
• Application Number:
  US13/247,955
• Publication Number:
  US 20120081317A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 : Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 : for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 : Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 : controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1446 : display composed of modules, e.g. video walls
• CPC Class Codes: G06T 3/02 : Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 3/40 : Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G09G 2356/00 : Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 5/14 : Display of multiple viewports
• CPC Class Codes: H04L 12/1827 : Network arrangements for conference optimisation or adaptation

Abstract

A multi-screen user device and methods for performing a copy-paste operation using finger gestures are disclosed. A first finger gesture is used to select a display area from which data is to be copied. Subsequently, a drag finger gesture is used to identify where the data that is to be pasted. The drag may extend across a non-display boundary between a first and second display screen of the multi-screen device.

Claims

1. A method for performing a copy-paste operation using user finger gesture input to a device having one or more touch sensitive display screens, comprising:

receiving a first finger gesture input to one of the touch sensitive display screens;

selecting a source area of the touch sensitive display screens, the source area selected identified by a display screen location for the first finger gesture input;

receiving a finger drag gesture input for identifying a target area of the touch sensitive display screens into which data from the source data is to be copied, wherein the target area corresponds to a location on the touch sensitive display screens where the drag gesture is last detected before it ceases to be detected; and

copying the data to the target area.

2. The method of claim 1, wherein the one touch sensitive display screen includes a capacitive touch sensitive area for receiving the finger gesture input.

3. The method of claim 1, further including a step of outputting on one of the touch sensitive display screens a change in the display of the source area for identifying the source area to a user.

4. The method of claim 3, further including a step of selecting the target area by:

(i) determining the target area by identifying the location on one of the touch sensitive display screens where the drag gesture is last detected before it ceases to be detected, and (ii) determining that the target area is configured to receive the data.

5. The method of claim 4, wherein the step of selecting includes determining that the target area that accepts a clipboard input.

6. The method of claim 1, wherein the first finger gesture includes pressing and holding a finger against the one touch sensitive display screen for a predetermined time for identifying a display location for the source area.

7. The method of claim 6, wherein the finger drag gesture includes dragging the finger gesture on the one touch sensitive display screen.

8. The method of claim 1, further including identifying to a user one or more display areas, of the touch sensitive display screens, as the user inputs a portion of the drag gesture over each of the one or more display areas that are determined to be acceptable for pasting the data therein.

9. The method of claim 1, wherein the finger drag gesture extends across a boundary of a first of the touch sensitive display screens and onto a second of the touch sensitive display screens, wherein the first and second display screens are foldable relative to one another.

10. A computer readable medium for performing a copy-paste operation using user finger gesture inputs to first and second display screens of a device, wherein the device includes a folding mechanism attached to each of the first and second display screens for providing the first and seconds display screens in a folded configuration wherein the first and second display screens face in opposite directions, and in an unfolded configuration wherein the first and second display screens face in a substantially same direction, comprising:

machine instructions for performing the following steps;

determining that the first and second display screens are in the unfolded configuration;

receiving an input from a first finger gesture to the first display screen, wherein the first finger gesture input is for identifying a source area from which displayed data is to be copied;

receiving an input from a finger drag gesture for identifying a target area of the second display screen into which data from the source area is to be copied, wherein the target area corresponds to a location of the second display screen where the drag gesture is last detected before it ceases to be detected;

wherein the finger drag gesture includes a continuous contact with the first display screen from the first finger gesture; and

copying the data to the target area.

11. The computer readable medium of claim 10, wherein the source area and the target area each corresponds to a displayed portion of a different application window;

wherein each of the different application windows correspond to a different software application installed on the device.

12. The computer readable medium of claim 10, wherein each of the software applications is operable on the device independently of each of the other of the software applications.

13. The computer readable medium of claim 10, wherein the step of copying includes copying the data from the source area to a clipboard, and then automatically inputting corresponding clipboard data to the target area.

14. The computer readable medium of claim 10, further including highlighting the source area prior to a performance of the finger drag gesture.

15. A hand-held device for performing a copy-paste operation using user finger gesture inputs, comprising:

first and second display screens of the device, wherein the device includes a folding mechanism attached to each of the first and second display screens for providing the first and seconds display screens in a folded configuration wherein the first and second display screens face in opposite directions, and in an unfolded configuration wherein the first and second display screens face in a substantially same direction;

a display manager for determining whether the first and second display screens are in an unfolded configuration or a folded configuration;

a gesture interpreter for interpreting each of a first finger gesture input to the first display screen, and a finger drag gesture input to each of the first and second display screens;

a window manager for receiving;

(i) first data from the gesture interpreter, the first data indicative of the first finger gesture input, wherein the first data is for identifying a source area, displayed on the first display screen, from which displayed data is to be copied, and (ii) second data from the gesture interpreter, the second data indicative of the finger drag gesture input, wherein the second data is for identifying a target area of the second display screen into which data from the source data is to be copied, wherein the target area corresponds to a location of the second display screen where the drag gesture is last detected by the gesture interpreter before the drag gesture ceases to be detected by the gesture interpreter;

wherein when the source area and the target area are respectively determined on the first and second display screens, data representative of a contents of the source area is copied into the target area.

16. The hand-device of claim 15, wherein the source area is included in a display of a first application, and the target area is included in a display of a different second application.

17. The hand-device of claim 15, wherein the first finger gesture includes pressing and holding a finger against the first display screen for a predetermined time for identifying a display location for the source area.

18. The hand-device of claim 17, wherein the finger drag gesture includes dragging the first finger gesture on each of the first and second display screens substantially continuously across a boundary therebetween.

19. The hand-device of claim 15 further including an application support service for inputting the data from the source area into a clipboard, and then automatically inputting corresponding clipboard data to the target area.

20. The hand-device of claim 15, wherein the window manager highlights the source area prior to a performance of the finger drag gesture.