User terminal device and method for controlling the user terminal device thereof

• US 9,880,643 B1
• Filed: 09/28/2017
• Issued: 01/30/2018
• Est. Priority Date: 09/29/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Mi-ra, Kuk, Sung-bin, Kim, Hark-joon, Lee, Sang-il, Jung, Min-kyu, Kang, Seong-hoon
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US15/718,105
• Publication Number:
  US 20180018030A1
• Time in Patent Office: 124 Days
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user terminal device and a control method are provided. The user terminal device includes a display, a sensor configured to sense a user interaction on the display, and a controller configured to, in response to a user interaction being sensed by the sensor of a touch being made by an input device of a polyhedral shape that includes different touch patterns on each of a plurality of surfaces, control a function of the user terminal device according to a touch pattern on a touched surface among the plurality of surfaces.

Claims

1. A non-transitory computer readable recording medium storing instructions executable by a processor of a user terminal to cause the processor to at least:

present first information related to a first application executable by the processor on a first partial portion of a touch screen display of the user terminal, and present second information related to a second application executable by the processor on a second partial portion of the touch screen display of the user terminal, wherein the first application is different from the second application;

based on the first partial portion of the touch screen display being touched by a first flat surface of a hand manipulatable input device, identify that the hand manipulatable input device is placed over a first position of the first partial portion of the touch screen display, wherein the hand manipulatable input device further comprises a second flat surface opposite the first flat surface;

provide a first plurality of menu items around the hand manipulatable input device being placed over the first position of the first partial portion, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application;

based on the second partial portion of the touch screen display being touched by the flat surface of the hand manipulatable input device, identify that the hand manipulatable input device is placed over a second position of the second partial portion of the touch screen display;

provide a second plurality of menu items around the hand manipulatable input device being placed over the second position of the second partial portion, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application;

receive a selection of one of the second plurality of menu items provided around the hand manipulatable input device being placed over the second position of the second partial portion;

based on the selected one being related to a volume adjustment function for controlling audio volume output by an audio output of the user terminal, provide an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

2. The non-transitory computer readable recording medium of claim 1, wherein the instructions cause the processor to identify, prior to controlling to provide the indicator on the touch screen display, that volume adjusting is to be performed.

3. The non-transitory computer readable recording medium of claim 1, wherein the touch screen display is a capacitive type.

4. The non-transitory computer readable recording medium of claim 1, wherein the first rotational direction is a clockwise direction.

5. The non-transitory computer readable recording medium of claim 1, wherein the second rotational is a counterclockwise direction.

6. A user terminal comprising:

a touch screen display;

an audio output;

a memory for storing instructions; and

a processor configured to execute the instructions to at least;

control to present first information related to a first application executable by the processor on a first partial portion of the touch screen display of the user terminal, and present second information related to a second application executable by the processor on a second partial portion of the touch screen display of the user terminal, wherein the first application is different from the second application;

control to, based on the first partial portion of the touch screen display being touched by a first flat surface of a hand manipulatable input device, identify that the hand manipulatable input device is placed over a first position of the first partial portion of the touch screen display, wherein the hand manipulatable input device further comprises a second flat surface opposite the first flat surface;

control to provide a first plurality of menu items around the hand manipulatable input device being placed over the first position of the first partial portion, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application;

control to, based on the second partial portion of the touch screen display being touched by the flat surface of the hand manipulatable input device, identify that the hand manipulatable input device is placed over a second position of the second partial portion of the touch screen display;

control to provide a second plurality of menu items around the hand manipulatable input device being placed over the second position of the second partial portion, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application;

control to receive a selection of one of the second plurality of menu items provided around the hand manipulatable input device being placed over the second position of the second partial portion;

control to, based on the selected one being related to a volume adjustment function for controlling audio volume output by the audio output of the user terminal, provide an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

control to perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

7. The user terminal of claim 6, wherein the instructions cause the processor to identify, prior to controlling to provide the indicator on the touch screen display, that volume adjusting is to be performed.

8. The user terminal of claim 6, wherein the touch screen display is a capacitive type.

9. The user terminal of claim 6, wherein the first rotational direction is a clockwise direction.

10. The user terminal of claim 6, wherein the second rotational is a counterclockwise direction.

11. A method executed by a user terminal comprising a touch screen display, the method comprising:

presenting first information related to a first application executable by the processor on a first partial portion of a touch screen display of the user terminal, and present second information related to a second application executable by the processor on a second partial portion of the touch screen display of the user terminal, wherein the first application is different from the second application;

based on the first partial portion of the touch screen display being touched by a first flat surface of a hand manipulatable input device, identifying that the hand manipulatable input device is placed over a first position of the first partial portion of the touch screen display, wherein the hand manipulatable input device further comprises a second flat surface opposite the first flat surface;

providing a first plurality of menu items around the hand manipulatable input device being placed over the first position of the first partial portion, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application;

based on the second partial portion of the touch screen display being touched by the flat surface of the hand manipulatable input device, identifying that the hand manipulatable input device is placed over a second position of the second partial portion of the touch screen display;

providing a second plurality of menu items around the hand manipulatable input device being placed over the second position of the second partial portion, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application;

receiving a selection of one of the second plurality of menu items provided around the hand manipulatable input device being placed over the second position of the second partial portion;

based on the selected one being related to a volume adjustment function for controlling audio volume output by an audio output of the user terminal, providing an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

performing volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

12. The method of claim 11, further comprising identifying, prior to controlling to provide the indicator on the touch screen display, that volume adjusting is to be performed.

13. The method of claim 11, wherein the touch screen display is a capacitive type.

14. The method of claim 11, wherein the first rotational direction is a clockwise direction.

15. The method of claim 11, wherein the second rotational is a counterclockwise direction.

16. A system comprising:

a hand manipulatable input device to be manipulated by a user and comprising a first flat surface to be positioned over a touch screen display, the hand manipulatable input device further comprising a second flat surface opposite the first flat surface and a sidewall between the first and second flat surfaces; and

a user terminal comprising;

the touch screen display;

an audio output;

a memory storing instructions; and

a processor configured to execute the instructions to at least;

control to present first information related to a first application executable by the processor on a first partial portion of a touch screen display of the user terminal, and present second information related to a second application executable by the processor on a second partial portion of the touch screen display of the user terminal, wherein the first application is different from the second application;

control to, based on the first partial portion of the touch screen display being touched by a first flat surface of the hand manipulatable input device, identify that the hand manipulatable input device is placed over a first position of the partial portion of the touch screen display;

control to provide a first plurality of menu items around the hand manipulatable input device being placed over the first position of the first partial portion, wherein each of the first plurality of menu items respectively corresponds to one of a plurality of functions of the first application;

control to, based on the second partial portion of the touch screen display being touched by the flat surface of the hand manipulatable input device, identify that the hand manipulatable input device is placed over a second position of the second partial portion of the touch screen display;

control to provide a second plurality of menu items around the hand manipulatable input device being placed over the second position of the second partial portion, wherein each of the second plurality of menu items respectively corresponds to one of a plurality of functions of the second application;

control to receive a selection of one of the second plurality of menu items provided around the hand manipulatable input device being placed over the second position of the second partial portion;

control to, based on the selected one being related to a volume adjustment function for controlling audio volume output by the audio output of the user terminal, provide an indicator on the touch screen display, wherein the indicator indicates the volume adjustment function; and

control to perform volume adjusting comprising increasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touchscreen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction.

17. The system of claim 16, wherein the processor is configured to execute the instructions further to control to identify, prior to controlling to provide the indicator on the touch screen display, that volume adjusting is to be performed.

18. The system of claim 16, wherein the touch screen display is a capacitive type.

19. The system of claim 16, wherein the first rotational direction is a clockwise direction.

20. The system of claim 16, wherein the second rotational is a counterclockwise direction.