User terminal device and method for controlling the user terminal device thereof

• US 9,927,885 B2
• Filed: 08/30/2017
• Issued: 03/27/2018
• Est. Priority Date: 09/29/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Mi-ra, Kuk, Sung-bin, Kim, Hark-joon, Lee, Sang-il, Jung, Min-kyu, Kang, Seong-hoon
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US15/690,384
• Publication Number:
  US 20170364166A1
• Time in Patent Office: 209 Days
• CPC Class Codes: G06F 2203/04802 3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user terminal device and a control method are provided. The user terminal device includes a display, a sensor configured to sense a user interaction on the display, and a controller configured to, in response to a user interaction being sensed by the sensor of a touch being made by an input device of a polyhedral shape that includes different touch patterns on each of a plurality of surfaces, control a function of the user terminal device according to a touch pattern on a touched surface among the plurality of surfaces.

Claims

1. A system comprising:

a hand manipulatable input device to be manipulated by a user and comprising a first flat surface to be provided over a touch screen display, a touch pattern for the first flat surface, and a second flat surface opposite the first flat surface; and

a user terminal device comprising;

a touch screen display;

an audio output;

a memory storing instructions; and

a processor configured to execute the instructions to at least;

control to identify that the hand manipulatable input device is placed at a first position of the touch screen display based on the touch pattern being recognized upon the touch screen display being touched by the first flat surface of the hand manipulatable input device;

control to provide an indicator on the touch screen display at a second position related to the first position of the touch screen display being touched by the first flat surface of the hand manipulatable input device, the indicator indicating a volume adjusting feature; and

control to perform volume adjustment comprising increasing volume of audio to be output by the audio output based at least on rotational movement of the hand manipulatable input device placed on the touch screen display in a first rotational direction and decreasing volume of audio to be output by the audio output based at least on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction, the first and second rotational directions being opposite each other, when the first flat surface of the hand manipulatable input device is on the touch screen display.

2. The system of claim 1, wherein the processor is configured to execute the instructions further to control to identify, prior to controlling to provide the indicator on the touch screen display, that the volume adjustment is to be performed.

3. The system of claim 1, wherein the touch screen display is a capacitive type.

4. The system of claim 1, wherein the first rotational direction is a clockwise direction.

5. The system of claim 1, wherein the second rotational direction is a counterclockwise direction.

6. The system of claim 1, wherein the processor is configured to execute the instructions further to:

control to provide a plurality of menu items for controlling the user terminal in an area of the touch screen display related to the first position of the touch screen display being touched by the first flat surface of the hand manipulatable input device.

7. The system of claim 6, wherein the area of the touch screen display related to the first position has a ring shape.

8. A non-transitory computer readable recording medium storing instructions executable by a processor of a user terminal to cause the processor to at least:

identify that a hand manipulatable input device is placed at a first position of the touch screen display of the user terminal based on a touch pattern being recognized upon the touch screen display being touched by a flat surface of the hand manipulatable input device;

provide an indicator on the touch screen display at a second position related to the first position of the touch screen display being touched by the flat surface of the hand manipulatable input device, the indicator indicating a volume adjustment feature; and

perform volume adjusting comprising increasing volume of audio to be output by an audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a first rotational direction and decreasing volume of audio to be output by the audio output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a different second rotational direction when the flat surface of the hand manipulatable input device is on the touch screen display.

9. The non-transitory computer readable recording medium of claim 8, wherein the instructions cause the processor to identify, prior to controlling to provide the indicator on the touch screen display, that volume adjusting is to be performed.

10. The non-transitory computer readable recording medium of claim 8, wherein the touch screen display is a capacitive type.

11. The non-transitory computer readable recording medium of claim 8, wherein the first rotational direction is a clockwise direction.

12. The non-transitory computer readable recording medium of claim 11, wherein the second rotational direction is a counterclockwise direction.

13. The non-transitory computer readable recording medium of claim 8, wherein the instructions further cause the processor to,

provide a plurality of menu items for controlling the user terminal in an area of the touch screen display related to the first position of the touch screen display being touched by the flat surface of the hand manipulatable input device.

14. The non-transitory computer readable recording medium of claim 13, wherein the area of the touch screen display related to the first position has a ring shape.

15. A method executed by a user terminal comprising a touch screen display, the method comprising:

identifying that a hand manipulatable input device having a flat surface is placed at a first position on the touch screen display of the user terminal based on a touch pattern being recognized upon the touch screen display being touched by the flat surface on the hand manipulatable input device;

providing an indicator on the touch screen display at a second position related to the first position of the touch screen display being touched by the flat surface of the hand manipulatable input device, the indicator indicating a volume adjustment feature; and

performing volume adjusting comprising increasing volume of audio to be output based on rotational movement of the hand manipulatable input device placed on the touch screen display in a first rotational direction and decreasing volume of audio to be output based on rotational movement of the input device placed on the touch screen display in a second rotational direction, the first and second rotational directions being opposite each other.

16. The method of claim 15, further comprising identifying, prior to providing the indicator on the touch screen display, the volume adjusting is to be performed.

17. The method of claim 15, wherein the touch screen display is a capacitive type.

18. The method of claim 15, wherein the first rotational direction is a clockwise direction.

19. The method of claim 18, wherein the second rotational direction is a counterclockwise direction.

20. The method of claim 15, further comprising:

providing a plurality of menu items for controlling the user terminal in an area of the touch screen display related to the first position when the touch screen display is being touched by the flat surface of the input device.

21. The method of claim 20, wherein the area of the touch screen display related to the first position has a ring shape.

22. A user terminal comprising:

a touch screen display;

a memory storing instructions; and

a processor configured to execute the instructions to at least;

control to identify that a hand manipulatable input device is placed at a first position on the touch screen display based on a touch pattern being recognized upon the touch screen display being touched by a flat surface of the hand manipulatable input device;

control to provide an indicator on the touch screen display at a second position related to the first position of the touch screen display being touched by the flat surface of the hand manipulatable input device, the indicator indicating a volume adjustment feature; and

when the flat surface of the hand manipulatable input device is touching the touch screen display, control to perform volume adjusting comprising increasing volume of audio to be output based at least on rotational movement of the hand manipulatable input device placed on the touch screen display in a first rotational direction and decreasing volume of audio to be output based at least on rotational movement of the hand manipulatable input device placed on the touch screen display in a second rotational direction, the first and second rotational directions being opposite each other.