Operation processing method, operation processing device, and control method

• US 9,696,882 B2
• Filed: 03/31/2014
• Issued: 07/04/2017
• Est. Priority Date: 08/28/2013
• Status: Active Grant

• Current Assignee: Lenovo Company Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Company Limited (Lenovo Group Ltd.)
• Inventors: Xiao, Manjun, Lu, Rui, Zeng, Zhiwei, Li, Zhigang, Xie, Xiaohui
• Primary Examiner(s): Ipakchi, Maryam
• Application Number:
  US14/230,667
• Publication Number:
  US 20150067589A1
• Time in Patent Office: 1,191 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

An operation processing method and an operation processing device applied in an electronic apparatus include a display unit in which a first interactive interface having a first size is displayed. The method includes displaying a second interactive interface having a second size which is different from the first size and having a mapping relation with the first interactive interface in the display unit, detecting a first action executed by the user in the second interactive interface; and executing a first operation in the first interactive interface according to the first action. Thus, the first interactive interface can be mapped into the second interactive interface and the first operation that the user expects to execute in the first interactive interface can be implemented by the first action executed in the second interactive interface, so that the user can conveniently operate the electronic apparatus.

Claims

1. An operation processing method applied in an electronic apparatus including a display unit in which a first interactive interface having a first size is displayed, the method comprises:

displaying a second interactive interface having a second size that is different from the first size in the display unit, and the first interactive interface having a mapping relation with the second interactive interface;

detecting a first action executed by the user in the second interactive interface; and

executing a first operation in the first interactive interface according to the first action,

wherein, displaying the second interactive interface in the display unit includes;

displaying a blank interactive interface in the display unit as the second interactive interface;

detecting operable objects included in the first interactive interface;

determining layout information of the operable objects in the first interactive interface; and

displaying virtual objects in the blank interactive interface according to the layout information, the virtual objects being expressed by geometric shape and text description, not a reduced display of the real operable objects, and being mapped into the operable objects according to the mapping relation,

wherein a background image or any inoperable object of the first interactive interface is not displayed in the second interactive interface.

2. The operation processing method according to claim 1, wherein, before displaying the second interactive interface in the display unit, the method further includes:

detecting a second action executed by the user to the electronic apparatus;

deciding whether the second action satisfies a first condition; and

displaying the second interactive interface in the display unit according to the second action if the second action satisfies the first condition.

3. The operation processing method according to claim 2, wherein, displaying the second interactive interface in the display unit according to the second action includes:

determining a display mode of the second interactive interface in the display unit according to the second action, the display mode including at least one of the following respective items;

a display position, a display size and a speed of change in size; and

displaying the second interactive interface in the display unit according to the display mode.

4. The operation processing method according to claim 1, wherein, displaying the second interactive interface in the display unit includes:

zooming the first interactive interface according to the mapping relation; and

displaying the zoomed first interactive interface in the display unit as the second interactive interface.

5. The operation processing method according to claim 1, wherein, detecting the first action executed by the user in the second interactive interface includes:

detecting an interactive gesture executed by the user in the first interactive interface;

determining first global coordinates of the interactive gesture in the first interactive interface;

deciding whether at least a part of the interactive gesture is executed in the second interactive interface according to the first global coordinates;

determining the interactive gesture as the first action if it decides that at least a part of the interactive gesture is executed in the second interactive interface; and

determining the interactive gesture as a third action and executing a second operation in the first interactive interface according to the third action if it decides that none of the part of the interactive gesture is executed in the second interactive interface.

6. The operation processing method according to claim 5, wherein, determining the interactive gesture as the first action includes:

deciding whether the interactive gesture is made to the second interactive interface itself;

determining the interactive gesture as a fourth action and executing a third operation to the second interactive interface in the first interactive interface according to the fourth action if it decides that the interactive gesture is made to the second interactive interface itself; and

determining the interactive gesture as the first action if it decides that the interactive gesture is not made to the second interactive interface itself.

7. The operation processing method according to claim 6, wherein, the third operation includes at least one of the following respective items:

reducing the second interactive interface, magnifying the second interactive interface, moving the second interactive interface, refreshing the second interactive interface, and closing the second interactive interface.

8. The operation processing method according to claim 1, wherein, executing the first operation in the first interactive interface according to the first action includes:

determining local coordinates of the first action in the second interactive interface;

mapping the local coordinates into second global coordinates in the first interactive interface according to the mapping relation; and

executing the first operation in the first interactive interface according to the second global coordinates.

9. The operation processing method according to claim 8, wherein, after executing the first operation in the first interactive interface according to the second global coordinates, the method further includes updating the display in the second interactive interface through a first response to the first operation in the first interactive interface according to the mapping relation.

10. The operation processing method according to claim 1, wherein, the display unit is a touch display screen, and further includes after displaying the second interactive interface:

displaying an operation object in the first interactive interface after detecting a preset trigger signal in the second interactive interface;

detecting the first action executed by the user in the second interactive interface is specifically;

sensing amount of variation of input parameter in the second interactive interface, the amount of variation of input parameter being caused by change in spatial location between a first operation body and the second interactive interface; and

executing the first operation in the first interactive interface according to the first action is specifically;

controlling the operation object to respond to the amount of variation of input parameter in the first interactive interface.

11. The operation processing method according to claim 10, wherein, the touch display screen is at least the touch display screen which is able to sense short distance gesture operation, and the amount of variation of input parameter includes at least one of the following items:

amount of variation of the distance between the input contact points and the touch display screen;

or

amount of variation of coordinates of the input contact points on parallel plane of the touch display screen.

12. The operation processing method according to claim 11, wherein, the amount of variation of input parameter being caused by the change in the spatial location between the first operation body and the second interactive interface includes:

the amount of variation of the distance between the input contact points and the touch display screen being caused by change in the distances between the first operation body and the second interactive interface; and

the amount of variation of coordinates of the input contact points on the parallel plane of the touch display screen being caused by movement of the first operation body on the parallel plane.

13. The operation processing method according to claim 10, wherein, controlling the operation object to respond to the amount of variation of input parameter in the first interactive interface includes:

controlling the operation object to move away from the second interactive interface in the first interactive interface when the amount of variation of input parameter shows that a distance from the touch display screen becomes larger;

controlling the operation object to move closer to the second interactive interface in the first interactive interface when the amount of variation of input parameter shows that the distance from the touch display screen becomes smaller; and

controlling the operation object to move according to the amount of variation of coordinates in the first interactive interface when the amount of variation of input parameter shows the amount of variation of the coordinates on a parallel plane of the touch display screen.

14. The operation processing method according to claim 13, wherein, controlling the operation object to respond to the amount of variation of input parameter in the first interactive interface further includes controlling the operation object to select target pointed when the amount of variation of input parameter shows that the distance from the touch display screen becomes smaller and a time interval between a time of detecting the amount of variation of input parameter and a time of detecting a previous amount of variation of input parameter is larger than a preset time value.

15. The operation processing method according to claim 10, wherein, the amount of variation of input parameter includes:

amount of variation of coordinates of input contact points on the touch display screen; and

the amount of variation of input parameter being caused by the change in the spatial location between the first operation body and the second interactive interface specifically includes;

amount of variation of coordinates of the input contact points on the second interactive interface of the touch display screen being caused by movement of the first operation body on the second interactive interface.

16. An operation processing device applied in an electronic apparatus including a display in which a first interactive interface having a first size is displayed, the operation processing device includes:

a first detector for detecting a first action executed by the user in a second interactive interface;

a processor; and

a storage medium with computer program instructions recorded thereon, as being executed by the processor, the computer program instructions renders the processor to achieve the steps of;

an interface display step for displaying the second interactive interface having a second size that is different from the first size in the display unit, and the first interactive interface having a mapping relation with the second interactive interface; and

an operation executing step for executing the first operation in the first interactive interface according to the first action,

wherein, the interface display step is configured for;

displaying a blank interactive interface in the display unit as the second interactive interface;

detecting operable objects included in the first interactive interface;

determining layout information of the operable objects in the first interactive interface; and

displaying virtual objects in the blank interactive interface according to the layout information, the virtual objects being expressed by geometric shape and text description, not a reduced display of the real operable objects, and being mapped into the operable objects according to the mapping relation,

wherein a background image or any inoperable object of the first interactive interface is not displayed in the second interactive interface.

17. The operation processing device according to claim 16, wherein, the display is a touch display screen, and the computer program instructions renders the processor to achieve the steps of:

a display step for displaying an operation object in the first interactive interface of the touch display screen after detecting a preset trigger signal in the second interactive interface of the touch display screen;

wherein, the first detector is specifically for sensing the amount of variation of input parameter in the second interactive interface, and an amount of variation of input parameter is caused by change in spatial location between a first operation body and the second interactive interface;

a control executing step is specifically for controlling the operation object to respond to the amount of variation of input parameter in the first interactive interface.

18. A control method applied in an electronic apparatus having at least a touch display screen, wherein, the control method includes:

displaying an operation object in a second region of the touch display screen after detecting a preset trigger signal in a first region of the touch display screen, the first region being not overlapped with the second region;

sensing amount of variation of input parameter in the first region, the amount of variation of input parameter being caused by change in spatial location between a first operation body and the first region;

controlling the operation object to respond to the amount of variation of input parameter in the second region, before displaying the operation object in the second region in the touch display screen, the control method further includes;

displaying a first interactive interface having a first size in the second region,

displaying a second interactive interface having a second size that is different from the first size in the first region, and the first interactive interface having a mapping relation with the second interactive interface;

sensing the amount of variation of input parameter in the first region includes;

detecting a first action executed by the user in the second interactive interface; and

controlling the operation object to respond to the amount of variation of input parameter in the second region is specifically;

executing a first operation in the first interactive interface according to the first action

wherein, displaying the second interactive interface in the second region includes;

displaying a blank interactive interface in the second region as the second interactive interface;

detecting operable objects included in the first interactive interface;

determining layout information of the operable objects in the first interactive interface; and

displaying virtual objects in the blank interactive interface according to the layout information, the virtual objects being expressed by geometric shape and text description, not a reduced display of the real operable objects, and being mapped into the operable objects according to the mapping relation,

wherein a background image or any inoperable object of the first interactive interface is not displayed in the second interactive interface.