METHOD FOR CONNECTING MOBILE TERMINAL AND EXTERNAL DISPLAY AND APPARATUS IMPLEMENTING THE SAME

• US 20140075377A1
• Filed: 09/10/2013
• Published: 03/13/2014
• Est. Priority Date: 09/10/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: LEE, Gwanglim, LEE, Sangjin, LIM, Soochan, KANG, Doyoun, PARK, Sungjin, PARK, Boram
• Application Number:
  US14/022,760
• Publication Number:
  US 20140075377A1
• Time in Patent Office: Days
• US Class Current: 715/788
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/16 including more than one display unit
• CPC Class Codes: H04W 8/24 Transfer of terminal data

Abstract

A method and apparatus for controlling desktop virtualization function, per-display device window layout provision function, and user input-based external display device utilization function are provided.

Claims

1. A function control method using a mobile terminal and an external display device, the method comprising:

detecting a connection of the external display device;

outputting a default desktop window screen to the external display device;

receiving a control input;

controlling, when the control input is an external input for controlling a desktop region of the external display device, a screen display of the desktop region; and

controlling, when the control input is an internal input for controlling a default region of the mobile terminal, a screen display of the default region.

2. The method of claim 1, wherein the outputting of the default desktop window screen comprises:

maintaining a current state of the screen of the default region of the mobile terminal;

executing a desktop mode internally; and

generating the default desktop window screen on the external display device.

3. The method of claim 2, further comprising:

acquiring, when the external display device is connected to the mobile terminal, information on a screen size of the external display device.

4. The method of claim 3, wherein the acquiring of the information on the screen size of the external display device comprises:

acquiring the information on the screen size of the external device according to one of a polling by the mobile terminal and a pushing by the external display device.

5. The method of claim 1, wherein the controlling of the screen display of the desktop region is performed according to the external input made with one of a virtual input device of the mobile terminal and an external input device connected to the mobile terminal.

6. The method of claim 1, further comprising:

executing, when the control input corresponds to executing an application of the desktop region, the application for a desktop environment.

7. The method of claim 6, wherein the application for the desktop region is executed with an execution window having a layout for the desktop environment.

8. The method of claim 7, wherein the window comprises size adjustment buttons at a top side of a frame of the window.

9. The method of claim 1, wherein the mobile terminal and the external display device have screens different from each other in layout.

10. The method of claim 1, wherein the controlling of the screen display of the default region of the mobile terminal comprises maintaining a current state of the screen display of the external display device, and

wherein the controlling of the screen display of the desktop region of the external display device comprises maintaining a current state of the screen display of the mobile terminal.

11. The method of claim 1, wherein the default desktop window screen comprises a predetermined background image and icons for desktop applications capable of executing operations for the desktop window environment through the external display device.

12. The method of claim 1, wherein the mobile terminal and the external display device are connected to each other through at least one of a wired interface and a wireless interface.

13. The method of claim 12, wherein the wired interface comprises High-Definition Multimedia Interface (HDMI), and the wireless interface comprises Wireless Fidelity (Wi-Fi).

14. The method of claim 5, wherein the mobile terminal and the external input device are connected to each other through at least one of a wired interface and a wireless interface.

15. The method of claim 14, wherein the wired interface comprises Universal Serial Bus (USB), and the wireless interface comprises Bluetooth.

16. A function control method using a mobile terminal and an external display device, the method comprising:

detecting a connection between the mobile terminal and the external display device;

executing a desktop mode;

displaying a default desktop window screen for the desktop mode through the external display device; and

controlling a desktop virtualization function in a desktop window environment through the external display device.

17. A system for desktop virtualization, the system comprising:

a mobile terminal which supports a multi-screen function; and

an external display device which is connected to the mobile terminal and which displays a screen output by the mobile terminal in a format of a desktop window environment.

18. The system of claim 17, further comprising an external input device which is connected to the mobile terminal and which is used for manipulating windows displayed on the external display device.

19. The system of claim 17, wherein the mobile terminal and the external display device are connected to each other through at least one of a wired interface and a wireless interface.

20. The system of claim 18, wherein the mobile terminal and the external input device are connected to each other through at least one of a wired interface and a wireless interface.

21. The system of claim 17, wherein the mobile terminal comprises a virtual input device for use in manipulating windows displayed on the external display device.

22. The system of claim 17, wherein the mobile terminal executes, when an application execution request is input through the desktop region of the external display device, the application for a desktop environment.

23. The system of claim 22, wherein the external display device displays an execution window having a layout for the desktop environment.

24. A mobile terminal comprising:

an interface unit configured to provide at least one of wired and wireless interface for connection of an external display device and an external input device;

a touchscreen configured to display a window screen having a layout for a default region of the mobile terminal and a virtual input device for desktop environmental control of a desktop region of the external display device and to receive a control input using the virtual input device; and

a controller configured to control desktop virtualization for displaying, when interoperating with the external display device, data and an application generated in the mobile terminal in correspondence to the desktop environment through the external display apparatus and processing operations.

25. A non-transitory computer-readable storage medium recorded with a program that, when executed, causes at least one processor to perform a method comprising:

executing, when a mobile terminal is connected to an external display device, a desktop mode;

displaying a default desktop window screen for the desktop mode through the external display device; and

controlling a desktop virtualization function in a desktop window environment through the external display device.

26. A screen display method using a mobile terminal and an external display device, the method comprising:

detecting a window creation event occurring with execution of an application;

determining a display device for displaying a window in response to the window creation event;

acquiring a resource of the display device for displaying the window;

determining a window layout policy of the display device corresponding to the acquired resource;

creating the window on the display device in a layout according to the determined window layout policy; and

displaying an execution screen of the application through the window.

27. The method of claim 26, wherein the display device for displaying the window is at least one display device displaying the application execution screen among at least two display devices connected to the mobile terminal.

28. The method of claim 26, wherein the determining of the window layout policy comprises:

searching for the window layout policy matching a resource of the display device among preconfigured window layout policies.

29. The method of claim 28, wherein the determining of the window layout policy comprises:

searching a preconfigured mapping table for the resource corresponding to the display device and the window layout policy mapped to the resource; and

determining that the found window layout policy corresponds to the window layout policy of the display device.

30. The method of claim 26, wherein the resource of the display device comprises at least one of the resource of the display unit of the mobile terminal and the resource of at least one external display device connected to the mobile terminal.

31. The method of claim 26, wherein the acquiring of the resource of the display device comprises:

acquiring the resource according to one of a polling by the mobile terminal and a pushing by the external display device.

32. A screen display method using a mobile terminal and an external display device, the method comprising:

acquiring, at the mobile terminal when the external device is connected, a resource of the external display device;

determining a window layout policy corresponding to the acquired resource;

outputting a desktop window screen determined according to the window layout policy to the external display device;

displaying, at the external display device, the desktop window screen according to the window layout policy;

determining, at the mobile terminal when a user input for execution an application is detected, a window creation region for the application;

determining, when the window creation region is the external display device, the window layout policy for the external display device;

outputting an application execution screen according to the determined window layout policy to the external display device; and

displaying, at the external display device, the application execution screen in the layout according to the window layout policy.

33. The method of claim 32, wherein the mobile terminal and the external display device display the application execution screen in different layouts.

34. The method of claim 32, wherein the outputting of the application execution screen comprises:

creating the application execution screen internally according to the window layout policy in the state of maintaining current display of the mobile terminal.

35. The method of claim 32, wherein the determining of the window creation region comprises:

determining the display device for displaying the application execution screen;

determining, when the application is executed through the screen displayed on the mobile terminal, that the window creation region is a display unit of the mobile terminal; and

determining, when the application is executed through the screen displayed on the external display device, that the window creation region is the external display device.

36. The method of claim 32, wherein the mobile terminal and the external display device are connected to each other through at least one of a wired interface and a wireless interface.

37. The method of claim 36, wherein the wired interface comprises High-Definition Multimedia Interface (HDMI), and the wireless interface comprises Wireless Fidelity (Wi-Fi).

38. A method for providing a window layout per display device, the method comprising:

configuring window layout policies for display devices;

determining, when a window is created in response to an application execution request, the window layout policy to be applied to the window; and

creating the window in a layout according to the determined window layout policy.

39. A system for displaying a screen according to per-display device layout policies, the system comprising:

a mobile terminal which supports multi-screen function in connection with an external display device and which outputs a window formatted according to the window layout policy corresponding to a resource of the connected external display device; and

an external display device which displays the window output by the mobile terminal in the layout according to the window layout policy.

40. The system of claim 39, wherein the mobile terminal and the external display device are connected to each other through at least one of a wired interface and a wireless interface.

41. The system of claim 40, wherein the window displayed on the external display device comprises window size adjustment buttons at a top side of a frame of the window.

42. A mobile terminal comprising:

an interface unit configured to provide at least one of wired and wireless interfaces for connection of an external display device;

a display unit configured to display a screen according to a preconfigured window layout policy; and

a controller configured to configure window layout policies of display devices, to determine, when creating a window in response to an application execution request, the window layout policy to be applied to the window according to the preconfigured window layout policy, to create the window in a layout according to the window layout policy, and to control the external display device to display the window.

43. A non-transitory computer-readable storage medium recorded with a program that, when executed, causes at least one processor to perform a method comprising:

detecting a window creation event occurring with execution of an application;

determining a display device for displaying a window in response to the window creation event;

acquiring resource of the display device for displaying the window;

determining a window layout policy of the display device corresponding to the acquired resource;

creating the window on the display device in a layout according to the determined window layout policy; and

displaying an execution screen of the application through the window.

44. A method for processing a user input made on a mobile terminal equipped with a touchscreen and connected to an external display device, the method comprising:

detecting the user input on the touchscreen;

determining whether the user input is related to a first screen of the external display device; and

performing, when the user input is related to the first screen, a function related to the first screen in response to the user input and, when the user input is not related to the first screen, a function related to a second screen of the touchscreen in response to the user input.

45. The method of claim 44, wherein the determining of whether the user input is related to a first screen of the external display device comprises:

determining, when the user input is detected on a touch screen emulation screen displayed on the touchscreen, that the user input is related to the first screen of the external display device and, when no emulation screen is displayed on the touchscreen or when the user input is detected out of the emulation screen, that the user input is not related to the first screen.

46. The method of claim 45, wherein the emulation screen comprises a touch region and at least one soft key.

47. The method of claim 46, wherein the performing of the function comprises:

displaying, when a drag is detected in the touch region, a point moving in a direction of the drag.

48. The method of claim 46, wherein the performing of the function comprises:

converting, when first touch coordinates and second touch coordinates are detected in the touch region, the first and second touch coordinates to third and fourth touch coordinates respectively; and

changing the first screen in size based on the third and fourth coordinates.

49. The method of claim 48, wherein the performing of the function comprises:

converting the first and second touch coordinates to the third and fourth touch coordinates respectively based on a size of the touch region and a size of the first screen.

50. The method of claim 44, further comprising:

transmitting, when the external display device is connected to the mobile terminal, the first screen to the external display device.

51. A mobile terminal comprising:

an interface unit configured to connect to an external display device through a wired link;

a radio communication unit configured to connect to the external display device through a wireless link;

a touchscreen including a touch panel and a display panel; and

a controller configured to control the interface unit, the radio communication unit, and the touchscreen,

wherein the controller detects a user input, determines whether the user input is related to a first screen of the external display, device and performs, when the user input is related to the first screen, a function related to the first screen in response to the user input and, when the user input is not related to the first screen, a function related to a second screen of the touchscreen in response to the user input.

52. The mobile terminal of claim 51, wherein the controller determines, when the user input is detected on a touch screen emulation screen displayed on the touchscreen, that the user input is related to the first screen of the external display device and, when no emulation screen is displayed on the touchscreen or when the user input is detected out of the emulation screen, that the user input is not related to the first screen.

53. The mobile terminal of claim 52, wherein the emulation screen comprises a touch region and at least one soft key.

54. The mobile terminal of claim 53, wherein the controller controls, when a drag is detected in the touch region, the external display device to display a point moving in a direction of the drag.

55. The mobile terminal of claim 53, wherein the controller converts, when first touch coordinates and second touch coordinates are detected in the touch region, the first and second touch coordinates to third and fourth touch coordinates respectively, and changes the first screen in size based on the third and fourth coordinates.

56. The mobile terminal of claim 55, wherein the controller converts the first and second touch coordinates to the third and fourth touch coordinates respectively based on a size of the touch region and a size of the first screen.

57. The mobile terminal of claim 51, wherein the controller controls, when the external display device is connected to the interface unit or the radio communication unit, the interface unit or the radio communication unit to transmit the first screen to the external display device.

58. The mobile terminal of claim 51, wherein the interface unit comprises High-Definition Multimedia Interface (HDMI) for transmitting the first screen to the external display device.