User terminal device for displaying map and method thereof

• US 10,066,958 B2
• Filed: 08/19/2014
• Issued: 09/04/2018
• Est. Priority Date: 08/19/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Jung, Jong-woo, Myung, In-sik, Rhee, Taik-heon, Cho, Dong-bin
• Primary Examiner(s): Heinle, Courtney D
• Application Number:
  US14/462,691
• Publication Number:
  US 20150051835A1
• Time in Patent Office: 1,477 Days
• Field of Search: 701533
• CPC Class Codes: G01C 21/3614 through interaction with a road map, e.g. selecting a POI icon on a road map
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04114 Touch screens adapted for alternating or simultaneous interaction with active pens and passive pointing devices like fingers or passive pens
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A user terminal device is provided. The user terminal device includes a display configured to display a map screen, a detector configured to sense a user manipulation, and a controller configured to, when a location and a direction are determined by the user manipulation on the map screen, display at least one photo image corresponding to the location and the direction of the user manipulation on the map screen.

Claims

1. A user terminal device comprising:

a display configured to display a map screen;

a detector configured to detect a user manipulation; and

a controller configured to, when a route is input by the user manipulation on the map screen, display a photographic image which is selected based on the route,

wherein when a line is drawn by the user manipulation on the map screen, the controller determines a moving route based on a direction of a trace of the line and displays a photographic image corresponding to the direction of the trace of the line along with the moving route,

wherein the photographic image is an image photographed in a direction corresponding to the direction of the trace of the line, and

wherein the moving route is determined by comparing the trace of the line with road information on the map screen and by setting, in response to determining that the trace of the line is inconsistent with an actual road, a road which is close to the line as the moving route.

2. The device as claimed in claim 1, wherein the controller configured to, when a location and the route are input by the user manipulation on the map screen, display the photographic image which is viewable based on a position and a direction corresponding to the route.

3. The device as claimed in claim 1, wherein the controller configured to, when a location and a direction are input by the user manipulation on the map screen, display the photographic image which is viewable based on the location and the direction.

4. The device as claimed in claim 3, wherein when the route on the map screen is input by the user manipulation, the controller is configured to display a plurality of photographic images corresponding to a plurality of locations along the route, the plurality of photographic images corresponding to a direction of the route at the plurality of locations.

5. The device as claimed in claim 3, wherein the controller displays a plurality of photographic images sequentially.

6. The device as claimed in claim 3, wherein when a destination is determined according to the user manipulation, the controller displays a moving route from a current location of the user terminal device to the destination on the map screen, and additionally displays at least one photographic image in a direction of the moving route on the map screen, from among a plurality of photographic images corresponding to the moving route.

7. The device as claimed in claim 3, wherein the user manipulation includes a text being drawn by the user on the map screen, the controller is configured to determine a destination by recognizing the text, and the controller is configured to search for a moving route from a current location to the destination automatically.

8. The device as claimed in claim 5, wherein the user manipulation includes a pen hovering manipulation moving along the moving route, and the controller displays photographic images in a moving direction at each point on the moving route sequentially according to the pen hovering manipulation.

9. The device as claimed in claim 5, wherein the controller is configured to select points from the moving route which meet a predetermined condition, and the controller is configured to display at least one photographic image in a direction of the moving route at each selected point.

10. The device as claimed in claim 3, wherein the user manipulation includes a touch point and a dragging or flicking manipulation,

wherein when the user manipulation is dragged or flicked in a certain direction on the map screen after it is touched, the controller determines the location based on the touch point, and determines the direction based on the dragged direction or the flicked direction.

11. The device as claimed in claim 10, wherein the controller is configured to select at least one from among a magnification, a size, a display location, and a photographing angle based on at least one from among a touch intensity, a touch area, a touch time, a moving distance of the user manipulation, and a moving speed of the user manipulation, and is configured to display a selected photographic image on the map screen.

12. The device as claimed in claim 10, wherein the user manipulation further includes a manipulation using a pen.

13. The device as claimed in claim 3, further comprising:

a storage;

wherein the controller is configured to select a photographic image corresponding to the location and the direction from among the photographic images stored in the storage.

14. The device as claimed in claim 3, further comprising:

a communication unit configured to communicate with a server;

wherein the controller is configured to search and download a photographic image corresponding to the location and the direction from the server, and the controller is configured to download the photographic image to the map screen.

15. The device as claimed in claim 3, further comprising:

a storage; and

a communication unit configured to communicate with a server;

wherein the controller is configured to detect the photographic image corresponding to the location and the direction from at least one from among the storage and the server, and

when a plurality of photographic images are detected, the controller is configured to display the plurality of photographic images consecutively.

16. The device as claimed in claim 3, wherein a share command is inputted via the detector, and the controller is configured to transmit the photographic image to other user terminal devices by using a communication unit.

17. The device as claimed in claim 3, wherein the controller is configured to display the photographic image by overlaying the image on the map screen at the location corresponding to the image.

18. The device as claimed in claim 3, wherein the controller is configured to display the photographic image as a separate screen from the map screen.

19. A display method of a user terminal device, comprising:

displaying a map screen;

detecting a user manipulation; and

when a route is input by the user manipulation on the map screen, displaying a photographic image which is selected based on the route,

wherein when a line is drawn by the user manipulation on the map screen, determining a moving route based on a direction of a trace of the line and displaying a photographic image corresponding to the direction of the trace of the line along with the moving route,

wherein the photographic image is an image photographed in a direction corresponding to the direction of the trace of the line, and

wherein the moving route is determined by comparing the trace of the line with road information on the map screen and by setting, in response to determining that the trace of the line is inconsistent with an actual road, a road which is close to the line as the moving route.

20. The method as claimed in claim 19, further comprising:

when a location and the route are input by the user manipulation on the map screen, displaying the photographic image which is viewable based on the position and a direction corresponding to the route.

21. The method as claimed in claim 19, further comprising:

when a location and a direction are input by the user manipulation on the map screen, displaying the photographic image which is viewable based on the location and the direction.

22. The method as claimed in claim 19, further comprising:

when the route on the map screen is input by the user manipulation, displaying a plurality of photographic images corresponding to a plurality of locations along the route, the plurality of images corresponding to a direction of the route at the plurality of locations.

23. The method as claimed in claim 22, wherein the plurality of photographic images are displayed sequentially.

24. The method as claimed in claim 19, further comprising:

displaying a moving route from a current location of the user terminal device to a destination on the map screen when a destination is determined according to the user manipulation; and

displaying at least one photographic image in a direction of the moving route from among a plurality of photographic images corresponding to the moving route on the map screen.

25. The method as claimed in claim 24, further comprising:

determining the destination by recognizing a text when the text is drawn by the user manipulation on the map screen; and

searching a moving route from the current location of the user terminal device to the destination automatically.

26. The method as claimed in claim 20, wherein the displaying the photographic image further comprises:

sequentially displaying photographic images in a moving direction at each point on the moving route according to the user manipulation, when the user manipulation moving along the moving route is detected.

27. The method as claimed in claim 26, wherein the user manipulation includes a pen hovering manipulation.

28. The method as claimed in claim 24, wherein the displaying the selected photographic image on the map screen further comprises:

selecting points from the moving route which meet a predetermined condition; and

displaying a photographic image in the moving direction at each selected point.

29. The method as claimed in claim 21, further comprising:

searching a photographic image corresponding to the location and the direction from a storage of the user terminal device or an external server.

30. The method as claimed in claim 29, wherein when the plurality of photographic images are detected, the displaying comprises:

displaying the plurality of photographic images consecutively.

31. The method as claimed in claim 19, further comprising:

inputting a share command; and

transmitting the photographic image to other user terminal devices according to the share command;

wherein when information on a moving route and a moving direction is transmitted from a user terminal device from among the plurality of user terminal devices, the server searches an image photographed in the moving direction at a plurality of points along the moving route from among prestored photographed images, and the server transmits the searched photographed image to the user terminal device.

32. A device comprising:

a display configured to display at least one image;

a detector configured to sense an input; and

a controller configured to control the displaying of the at least one image based on the input, wherein the input corresponds to at least one location and at least one direction,

wherein when a line is drawn by user manipulation on a map screen, the controller determines a moving route based on a direction of a trace of the line and controls the displaying of a photographic image corresponding to the direction of the trace of the line along with the moving route,

wherein the photographic image is an image photographed in a direction corresponding to the direction of the trace of the line, and

wherein the moving route is determined by comparing the trace of the line with road information on the map screen and by setting, in response to determining that the trace of the line is inconsistent with an actual road, a road which is close to the line as the moving route.

33. The device according to claim 32, wherein the location includes a destination for a moving route and the at least one image includes at least one from among at least one photograph and at least one map.

34. The device according to claim 33, wherein the controller is configured to display the at least one photograph indicating a distance between the device and a surface of the ground at the at least one location according to the input.

35. The device according to claim 33, wherein the input is one from among a user touch, a pen, a hovering manipulation, and a voice command.

36. A display method, comprising:

displaying at least one image;

sensing an input; and

controlling the displaying of the at least one image based on the input, wherein the input indicates at least one location and at least one direction,

determining a moving route based on a direction of a trace of a line drawn by a user manipulation on the displayed at least one image; and

displaying a photographic image corresponding to the direction of the trace of the line along with the moving route,

wherein the photographic image is an image photographed in a direction corresponding to the direction of the trace of the line, and

wherein the moving route is determined by comparing the trace of the line with road information on map screen and by setting, in response to determining that the trace of the line is inconsistent with an actual road, a road which is close to the line as the moving route.

37. The method according to claim 36, wherein the location includes a destination for a moving route and the at least one image includes at least one from among at least one photograph and at least one map.

38. The method according to claim 37, further comprising:

displaying the at least one photograph indicating a distance between a device and a surface of the ground at the at least one location according to the input.

39. The method according to claim 37, wherein the input is one from among a user touch, a pen, a hovering manipulation, and a voice command.