TOUCH AND NON-CONTACT GESTURE BASED SCREEN SWITCHING METHOD AND TERMINAL

• US 20180136812A1
• Filed: 01/11/2018
• Published: 05/17/2018
• Est. Priority Date: 07/16/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: KIM, Jinyong, JEON, Jinyoung, KANG, Jiyoung, KIM, Daesung, LEE, Boyoung
• Application Number:
  US15/868,366
• Publication Number:
  US 20180136812A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A touch and gesture input-based control method for a mobile terminal or handheld display is provided for facilitating the switching operation between for an object in response to a gesture input subsequent to a touch input. The method includes detecting a touch input; selecting at least one object corresponding to the touch input; detecting a gesture input; and performing switching corresponding to the gesture input in a state where the object is held at a position of the touch input. The invention permits paging through lists of documents or icons, etc., while retaining the display of the held object on the touch screen.

Claims

1. A method for controlling a terminal, comprising:

detecting, by touch input on a touchscreen display, a selection of at least one object from a plurality of objects on the touchscreen display;

detecting, by a sensor, a non-contact gesture input while the touch input is maintained on the selected at least one object; and

switching, in response to the non-contact gesture input, display of one or more of the plurality of objects based on a shape of an object used to generate the non-contact gesture input while the selected at least one object is stationarily displayed at a position where the touch input is maintained,

wherein a number of switching operations is based on the shape of the object expressing the number independently from movement of the non-contact gesture input.

2. The method of claim 1, wherein the selected at least one object held on the touchscreen display comprises at least one of an icon, a text, an image, a file, a folder, a content of a web browser, a web address, and a web link, and wherein a visual effect including vibration is applied to the selected at least one object indicating the at least one object is movable.

3. The method of claim 1, wherein detecting a selection of the at least one object held on the touchscreen display comprises displaying the object with a visual effect including at least one of enlargement, shrinking, shading or highlighting.

4. The method of claim 1, wherein the non-contact gesture input is detected during at least a partial overlapping time period with the touch input maintained on the touchscreen display selecting the at least one object displayed on the touchscreen display.

5. The method of claim 1, wherein switching the display of the one or more plurality of objects comprises at least one of switching a displayed page, switching a displayed folder, switching a displayed tab, switching a displayed application, and switching a displayed task.

6. The method of claim 1, wherein switching the display of the one or more of the plurality of objects other than the selected at least one object further comprises:

switching a currently displayed page of a plurality of pages to another page of the plurality of pages while the selected at least one object is stationarily displayed on the touchscreen display.

7. The method of claim 1, wherein switching the display of the one or more of the plurality of objects other than the selected at least one object further comprises:

switching a currently displayed folder to one of a higher tier folder and a lower tier folder of one of a file path of the displayed folder or another folder in a folder list while the selected at least one object is stationarily displayed on the touchscreen display.

8. The method of claim 1, wherein the selected at least one object comprises an address selected from a webpage displayed within a browser including a plurality of tabs, and

wherein switching the display of the one or more of the plurality of objects further comprises:

while the touch input is maintained stationarily on the selected address, detecting the non-contact gesture input, and

in response to detecting termination of the non-contact gesture input while the touch input is maintained stationarily on the selected address, switching a currently displayed tab of the plurality of tabs to another tab of the plurality of tabs and automatically accessing, in the another tab of the browser, a website designated by the selected address of the selected at least one object for display.

9. The method of claim 1, wherein switching the display of the one or more of the plurality of objects other than the selected at least one object further comprises:

switching a currently displayed application or task listed within a list of executing applications or tasks to another application or another task of the list of currently executing applications or tasks.

10. The method of claim 9, wherein the selected at least one object being stationarily displayed on the touchscreen display is displayed in an optimal format for the another application or another task.

11. The method of claim 1, further comprising:

in response to detecting by the touchscreen a release of the detected touch input from the selected at least one object stationarily displayed on the touchscreen display, executing an operation corresponding to the release of the detected touch input from the selected at least one object.

12. The method of claim 11, wherein the operation corresponding to the release of the touch input comprises at least one of:

displaying the selected at least one object at a position where the detected touch input is released,

executing retrieval of a website for a link corresponding to the selected object in a currently displayed tab of a web browser, and

pasting the object into an execution screen of a currently displayed application or task.

13. The method of claim 11, wherein when the selected at least one object comprises at least one image pasted into or attached to a text message or an email message, the method further comprises:

displaying at least one of an icon including a cautioning that the at least one image is attached to the text message or the email message, at least one mark-up language code for attaching the at least one image to the text message or the email message, a file name of the at least one image, and a file attachment menu.

14. The method of claim 11, wherein the selected at least one object comprises at least one image that is pasted into or attached to a Social Networking application.

15. The method of claim 1, wherein the non-contact gesture further comprises a hand disposed stationarily over the touchscreen display.

27. The method of claim 1, wherein the sensor is a touch sensor operatively coupled to the touchscreen, and configured to detect both the touch input to the touchscreen, and the non-contact gesture input.

28. The method of claim 1, wherein the sensor comprises at least one of a resonance-based electromagnetic sensor, and an interference-based electromagnetic sensor.

16. (A terminal comprising:

an input unit configured to detect touch inputs and a non-contact gesture input;

a display unit configured to display a screen; and

a control unit configured to;

detect by a touch input selection of at least one object of a plurality of objects displayed on the display unit,

detect, by a sensor of the input unit, the non-contact gesture input while the touch input is maintained on the selected at least one object, and

switch, in response to the non-contact gesture input, display of one or more of the plurality of objects other than the selected at least one object based on a shape of an object used to generate the non-contact gesture input while the selected at least one object is stationarily displayed at a position where the touch input is maintained,

wherein the control unit determines a number of switching operations based on the shape of the object expressing the number independently from movement of the non-contact gesture input.

17. The terminal of claim 16, wherein switching the display of the one or more plurality of objects comprises at least one of switching a displayed page, switching a displayed folder, switching a displayed tab, switching a displayed application, and switching a displayed task, and a visual effect including vibration is applied to the selected at least one object indicating the at least one object is movable.

18. The terminal of claim 16, wherein switching the display of the one or more plurality of objects further comprises switches a currently displayed page of a plurality of pages to another page of the plurality pages while the selected object is stationarily displayed on the screen.

19. The terminal of claim 16, wherein switching the display of the one or more plurality of objects further comprises switching a currently displayed folder to one of a higher tier folder and a lower tier folder of one of a file path of the displayed folder or another folder in a folder list while the selected at least one object is stationarily displayed on the screen.

20. The terminal of claim 16, wherein the selected at least one object comprises an address selected from a webpage displayed within a browser including a plurality of tabs, and

wherein switching the display of the one or more plurality of objects further comprises:

while the touch input is maintained stationarily on the selected address, detecting the non-contact gesture input, and

in response to detecting termination of the non-contact gesture input while the touch input is maintained stationarily on the selected address, switching a currently displayed tab of the plurality of tabs to another tab of the plurality of tabs and opening another tab of the browser to automatically access a website designated by the selected address of the selected at least one object for display in the another tab of the browser.

21. The terminal of claim 16, wherein switching the display of the one or more plurality of objects further comprises switching a currently displayed application or task within a list of currently executing applications to another application or task of the list of currently executing applications or tasks while the selected at least one object is stationarily displayed on the screen.

22. The terminal of claim 21, wherein the control unit is further configured to control the display unit to display the selected at least one object on the display unit in an optimal format for a currently displayed application or task in which the selected at least one object is displayed.

23. The terminal of claim 17, the control unit further configured to:

in response to detecting, by the input unit, a release of the touch input, controlling the display unit to execute at least one of;

displaying the selected at least one object at a position corresponding to the release of the touch input,

executing retrieval of a website for a link corresponding to the selected object in a currently displayed tab of a web browser, and

pasting the selected at least one object into an execution screen of a currently displayed application or task.

24. The terminal of claim 23, wherein when the selected at least one object comprises at least one image pasted into or attached to a text message or an email message, the control unit is further configured to:

control the display unit to display at least one of;

an icon including a cautioning that the at least one image is attached to the text message or the email message, at least one mark-up language code for attaching the at least one image to the text message or the email message, a file name of the at least one image, and a file attachment menu.

25. The terminal of claim 23, wherein the selected at least one object comprises at least one image that is pasted into or attached to a Social Networking application.

26. The terminal of claim 16, wherein the non-contact gesture further comprises a hand disposed stationarily over the display unit.

29. The terminal of claim 16, wherein the sensor of the input unit is operatively coupled to the display unit to detect both the touch input selection on the display unit, and the non-contact gesture input.

30. The terminal of claim 16, wherein the sensor comprises at least one of a resonance-based electromagnetic sensor, and an interference-based electromagnetic sensor.