User terminal device and method for controlling the user terminal device thereof

• US 10,007,360 B1
• Filed: 02/22/2018
• Issued: 06/26/2018
• Est. Priority Date: 09/29/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Mi-ra, Kuk, Sung-bin, Kim, Hark-joon, Lee, Sang-il, Jung, Min-kyu, Kang, Seong-hoon
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US15/901,956
• Publication Number:
  US 20180181217A1
• Time in Patent Office: 124 Days
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user terminal device and a control method are provided. The user terminal device includes a display, a sensor configured to sense a user interaction on the display, and a controller configured to, in response to a user interaction being sensed by the sensor of a touch being made by an input device of a polyhedral shape that includes different touch patterns on each of a plurality of surfaces, control a function of the user terminal device according to a touch pattern on a touched surface among the plurality of surfaces.

Claims

1. An electronic device comprising:

a touch screen display configured to sense a predetermined touch pattern of a hand manipulatable input device;

a memory storing instructions; and

a processor configured to execute the instructions to at least;

control to present information related to an application executable by the processor on a partial portion of the touch screen display,

control to, based at least on the sensed predetermined touch pattern, identify a surrounding area of the hand manipulatable input device while the hand manipulatable input device is placed over the partial portion of the touch screen display, and

control to, based at least on the identified surrounding area, provide a plurality of menu items of the application on the identified surrounding area to be selected by the hand manipulatable input device, wherein each of the plurality of menu items respectively corresponds to one of a plurality of functions of the application.

2. The electronic device of claim 1, wherein the processor is further configured to execute the instructions to:

control to receive a selection of one of the plurality of menu items provided in the surrounding area;

based on the selected one being related to a volume adjustment function for controlling audio volume output by an audio output of the electronic device, provide an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

control to perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

3. The electronic device of claim 2, wherein the first rotational direction is a clockwise direction.

4. The electronic device of claim 2, wherein the second rotational direction is a counterclockwise direction.

5. The electronic device of claim 1, wherein the touch screen display is a capacitive type touch screen display.

10. The electronic device of claim 1, wherein the touch screen display is a capacitive type touch screen display.

6. An electronic device comprising:

a touch screen display;

a memory storing instructions; and

a processor configured to execute the instructions to at least;

present first information related to a first application on a first partial portion of a touch screen display of the electronic device, and present second information related to a second application on a second partial portion of the touch screen display of the electronic device, wherein the first application is different from the second application;

identify one of the first application and the second application to present a plurality of menu items corresponding to the identified application on the touch display screen including the first partial portion and the second partial portion;

if the identified application is the first application, based at least on detecting via the touch screen display a touch pattern of a flat surface of the hand manipulatable input device, present a first plurality of menu items around a first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application; and

if the identified application is the second application, based at least on detecting via the touch screen display the touch pattern of the flat surface of the hand manipulatable input device, present a second plurality of menu items around a second area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application.

7. The electronic device of claim 6, wherein the processor is further configured to execute the instructions to:

receive a selection of one of the first plurality of menu item presented around the first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed;

based on the selected one being related to a volume adjustment function for controlling audio volume output by an audio output of the electronic device, present an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

8. The electronic device of claim 7, wherein the first rotational direction is a clockwise direction.

9. The electronic device of claim 7, wherein the second rotational direction is a counterclockwise direction.

11. A method executed by an electronic device comprising a touch screen display, the method comprising:

presenting first information related to a first application on a first partial portion of the touch screen display of the electronic device, and presenting second information related to a second application on a second partial portion of the touch screen display of the electronic device, wherein the first application is different from the second application;

identifying one of the first application and the second application to present a plurality of menu items corresponding to the identified application on the touch display screen including the first partial portion and the second partial portion;

if the identified application is the first application, based at least on detecting via the touch screen display a touch pattern of a flat surface of the hand manipulatable input device, presenting a first plurality of menu items around a first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application; and

if the identified application is the second application, based at least on detecting via the touch screen display the touch pattern of the flat surface of the hand manipulatable input device, presenting a second plurality of menu items around a second area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application.

12. The method of claim 11, further comprising:

receiving a selection of one of the first plurality of menu item presented around the first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed;

based on the selected one being related to a volume adjustment function for controlling audio volume output by an audio output of the electronic device, presenting an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

performing volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

13. The method of claim 12, wherein the first rotational direction is a clockwise direction.

14. The method of claim 12, wherein the second rotational direction is a counterclockwise direction.

15. The method of claim 11, wherein the touch screen display is a capacitive type touch screen display.

16. A non-transitory computer readable recording medium storing instructions executable by a processor of an electronic device to cause the processor to at least:

present first information related to a first application on a first partial portion of a touch screen display of the electronic device, and present second information related to a second application on a second partial portion of the touch screen display of the electronic device, wherein the first application is different from the second application;

identify one of the first application and the second application to present a plurality of menu items corresponding to the identified application on the touch display screen including the first partial portion and the second partial portion;

if the identified application is the first application, based at least on detecting via the touch screen display a touch pattern of a flat surface of the hand manipulatable input device, present a first plurality of menu items around a first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application; and

if the identified application is the second application, based at least on detecting via the touch screen display the touch pattern of the flat surface of the hand manipulatable input device, present a second plurality of menu items around a second area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application.

17. The non-transitory computer readable recording medium of claim 16, wherein the instructions further cause to the processor to:

receive a selection of one of the first plurality of menu item presented around the first area of the touch screen display where the touch pattern of the hand manipulatable input device is sensed;

based on the selected one being related to a volume adjustment for controlling audio volume output by an audio output of the electronic device, present an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

18. The non-transitory computer readable recording medium of claim 17, wherein the first rotational direction is a clockwise direction.

19. The non-transitory computer readable recording medium of claim 17, wherein the second rotational direction is a counterclockwise direction.

20. The non-transitory computer readable recording medium of claim 16, wherein the touch screen display is a capacitive type touch screen display.