User terminal device and display method thereof

• US 10,048,824 B2
• Filed: 04/04/2014
• Issued: 08/14/2018
• Est. Priority Date: 04/26/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jung, Jong-woo, Myung, In-sik, Rhee, Taik-heon, Cho, Dong-bin
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US14/245,269
• Publication Number:
  US 20140325435A1
• Time in Patent Office: 1,593 Days
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour

Abstract

A user terminal device is disclosed. The user terminal device includes a display, an inputter configured to receive a user drawing manipulation, a storage configured to store an image generated by the user drawing manipulation and information of a control operation matched with at least one part of the image, and a controller configured to display a home screen composed of a plurality of display layers sequentially overlaid on the display, and display the image on at least one display layer from among the plurality of display layers. The controller may be further configured to, in response to one part of the image being selected, perform the control operation matched with the selected part. Accordingly, a user'"'"'s own home screen can be displayed.

Claims

1. A user terminal device, comprising:

a display;

a detector configured to detect a user input on the display;

a storage configured to store an image drawn by the user input and information on a plurality of control operations matched with the image, each of the plurality of control operations being matched with a different part of the image, respectively; and

a controller configured to control the display to display the image, wherein the controller is further configured to, in response to one part of the image being selected, perform a control operation, matched with the selected part, among the plurality of control operations, and

wherein the controller is further configured to divide the image drawn by the user input into the different parts by classifying each area of the image into one of the different parts based on the user input.

2. The user terminal device as claimed in claim 1, wherein the controller is further configured to control the display to display a home screen comprising a plurality of display layers sequentially overlaid,

wherein the image is displayed on a display layer among the plurality of display layers, and

wherein the controller is further configured to, in response to the image being a background image, divide the background image into a plurality of parts based on the user input, match each of the plurality of control operations with different parts of the background image respectively.

3. The user terminal device of claim 2, wherein the controller determines a location on the home screen where the user input occurred and replaces an object in the determined location with the user input and wherein the object is at least one of an icon for executing an application, playing back multimedia contents, and a widget.

4. The user terminal device as claimed in claim 2, wherein the controller is further configured to display the background image on a bottom display layer from among the plurality of display layers.

5. The user terminal device as claimed in claim 2, wherein the controller is further configured to, in response to the image being a widget, display the widget on an area of a top display layer from among the plurality of display layers.

6. The user terminal device as claimed in claim 2, wherein the controller is further configured to, in response to the image being an icon, display the icon on at least one display layer from among the plurality of display layers which overlays a display layer from among the plurality of display layers where a background image is displayed, and provide the home screen where the background image is combined with the icon.

7. The user terminal device as claimed in claim 2, wherein the home screen is composed of one page unit screen,

wherein the controller is further configured to enlarge or reduce a size of the image according to a corresponding one of a zoom-in manipulation and a zoom-out manipulation.

8. The user terminal device as claimed in claim 2, wherein the controller is further configured to, in response to a scroll manipulation to scroll the home screen being detected, display the home screen by scrolling the home screen.

9. The user terminal device as claimed in claim 2, wherein the image, in response to the home screen being displayed on the display, is capable of being directly drawn on a surface of the display by the user input.

10. The user terminal device as claimed in claim 1, wherein the controller is further configured to, during the dividing of the drawn image into the different parts, display a recommended control operation information corresponding to a feature in an area of the image from among said each area of the image, and

in response to one control operation being selected from among the recommended control information, match the selected control operation said one part of the image.

11. The user terminal device as claimed in claim 1, wherein the controller is further configured to, in response to a control operation to be matched with the image being selected before the image is drawn by the user input, display a reference image corresponding to the selected control operation, and in response to a user manipulation being performed to modify the reference image, match the modified reference image and the selected control operation and store corresponding matching information in the storage.

12. The user terminal device as claimed in claim 1, wherein the controller is further configured to, in response to a control operation to be matched with the image being selected before the image is drawn by the user input, display a reference object corresponding to the selected control operation as a watermark.

13. The user terminal device as claimed in claim 1, wherein the controller is further configured to, in response to a screen editing menu being selected, display a screen including a first area in which the image can be drawn by the user input and a second area in which a control operation to be matched with the image can be selected.

14. The user terminal device as claimed in claim 1, further comprising a communicator configured to communicate with an external server,

wherein the controller is further configured to, in response to a sharing command being input, upload, to the external server, home screen data including the image.

15. The user terminal device as claimed in claim 14, wherein the controller is further configured to, in response to a new home screen data drawn by another user being downloaded from the external server, convert the home screen based on the new home screen data.

16. The user terminal device of claim 1, wherein the control operation comprises at least one of displaying an execution screen with respect to at least one application represented by the user input and playing back multimedia contents represented by the user input.

17. The user terminal device as claimed in claim 1, wherein the plurality of control operations are independently executable from other ones of the plurality of control operations.

18. The user terminal device as claimed in claim 17, wherein the controller is further configured to automatically detect the different parts of the image based on analyzing the image, generate a plurality of transparent objects corresponding to the automatically detected different parts, control the storage to store pixel coordinate values for each of the plurality of transparent objects, and match one of the plurality of control operations to each of the plurality of transparent objects.

19. The user terminal device as claimed in claim 17, wherein the controller is further configured to control the display to display a graphic divider on the image within the user input of the displayed image.

20. A device, comprising:

a detector configured to detect a pen input;

a storage; and

a controller configured to store, in response to an image being drawn by the pen input, information on the image drawn by the pen input and information on a plurality of control operations matched with the image, each of the plurality of control operations being matched with a different part of the image respectively,

wherein the controller is further configured to provide the image to at least one page of a home screen, and in response to one part of the image being selected, perform a control operation, from among the plurality of control operations, matched with the selected part, and

wherein the controller is further configured to divide the image drawn by the pen input into the different parts by classifying each area of the image into one of the different parts based on the pen input.

21. A method for displaying a home screen on a user terminal device, comprising:

generating an image drawn by a user input;

dividing the image drawn by the user input into different parts by classifying each area of the image into one of the different parts, respectively, based on the user input;

setting a plurality of control operations to be matched to the image, each of the plurality of control operations being matched with a different part of the image, respectively;

displaying the image; and

performing, in response to one part of the image being selected, a control operation, from among the plurality of control operations, matched with the selected part.

22. The method as claimed in claim 21 further comprising:

displaying a home screen comprising a plurality of display layers sequentially overlaid,

wherein the image is displayed on at least one display layer from among the plurality of layers, and

wherein the displaying a home screen comprises, in response to the image being a background image, displaying the background image on a bottom display layer from among the plurality of sequentially overlaid display layers.

23. The method as claimed in claim 22, wherein the displaying the home screen comprises, in response to the image being a widget, displaying the widget on an area of a top layer from among the plurality of sequentially overlaid display layers.

24. The method as claimed in claim 22, wherein the displaying the home screen comprises, in response to the image being an icon, displaying the icon in at least one display layer above a display layer, from among the plurality of sequentially overlaid display layers, where a background image is displayed, and providing the home screen where the background image is combined with the icon.

25. The method as claimed in claim 22, wherein the home screen is composed of one page unit screen, and

wherein the displaying further comprises enlarging or reducing a size of the image

according to a corresponding one of a zoom-in manipulation and a zoom-out manipulation.

26. The method as claimed in claim 22, further comprising:

in response to a scroll manipulation to scroll the home screen being detected, displaying the home screen by scrolling the home screen.

27. The method as claimed in claim 22, wherein the image, in response to the home screen being displayed on a display, is capable of being directly drawn on a surface of the display by the user input.

28. The method as claimed in claim 21, wherein the setting the control operation comprises:

in response to the image being drawn by the user input, displaying recommended control operation information corresponding to a feature of the image; and

in response to a control operation being selected from among the recommended control operation information, matching the selected control operation with a respective part of the image.

29. The method as claimed in claim 21, wherein the generating the image comprises:

in response to a control operation to be matched with the image being selected before the image is drawn by the user input, displaying a reference image corresponding to the selected control operation; and

in response to a user manipulation being performed to modify the reference image, generating the modified reference image as the image.

30. The method as claimed in claim 21, further comprising:

in response to a control operation to be matched with the image being selected before the image is drawn by the user input, displaying a reference object corresponding to the selected control operation as a watermark.

31. The method as claimed in claim 21, further comprising:

in response to a screen editing menu being selected, displaying a screen including a first area in which the image can be drawn by the user input and a second area in which a control operation to be matched with the image can be selected.

32. The method as claimed in claim 21, further comprising:

in response to a sharing command being input, uploading, to the external server, home screen data including the image.

33. The method as claimed in claim 21, further comprising:

in response to new home screen data, corresponding to a new home screen drawn by another user, being downloaded from an external server, changing the home screen based on the new home screen data.

34. A method for displaying a home screen on a user terminal device, comprising:

generating an image drawn by a pen input;

dividing the image drawn by the pen input into different parts by classifying each area of the image into one of different parts, respectively, based on the pen input;

matching a plurality of control operations with the image, each of the plurality of control operations being matched with a different part of the image, respectively;

providing the image on at least one page of the home screen; and

performing, in response to a part, from among the different parts of the image being selected, a control operation, from among the plurality of control operations, matched with the selected part.

35. A user terminal device, comprising:

a controller configured to generate, in response to receiving a first user input, an image corresponding to the first user input, match, in response to receiving a second user input, a control operation with the image, and perform, in response to receiving a third user input, the control operation,

wherein the first user input corresponds to an image drawn by the first user input on a surface of a display, and

wherein the third user input corresponds to a user selection which is input on the surface of the display to select the image,

wherein the controller is further configured to divide, in response to receiving a fourth user input, the image into a first image part and a second image part, match, in response to receiving a fifth user input, a first control operation with the first image part and a second control operation with the second image part different from the first image part, and perform, in response to receiving a user selection which is input on the surface of the display to select one of the first image part and the second image part, one of the first control operation and the second control operation which corresponds to the selected image part.

36. The user terminal device of claim 35, further comprising the display,

wherein the display is configured to display the image, and

wherein the display is a touch screen.