Mobile terminal, image display device and user interface provision method using the same

• US 9,927,942 B2
• Filed: 03/20/2017
• Issued: 03/27/2018
• Est. Priority Date: 07/06/2012
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Kwontae, Kim, Youngkeun
• Primary Examiner(s): LEE, NICHOLAS J
• Application Number:
  US15/463,914
• Publication Number:
  US 20170255304A1
• Time in Patent Office: 372 Days
• Field of Search: None
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 2370/20 Details of the management of multiple sources of image data
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42204 : User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 : Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/4312 : involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 5/2624 : for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A method of sharing data, in a system having both an image display device and an external device, can include connecting the image display device to the external device; capturing, by the external device, a current screen on the external device; generating, by the external device, first screen information based on the captured current screen, which includes the captured current screen and margin information when the external device is in a portrait mode; encoding, by the external device, the generated first screen information; transmitting, by the external device, the encoded first screen information to the image display device; decoding, by the image display device, the encoded first screen information; and outputting, by the image display device, a first mirroring image based on the decoded first screen information, in which the first mirroring image corresponds to the current screen on the external device and includes right and left margins.

Claims

1. A method of sharing data in a system comprising both an image display device and an external device, the method comprising:

connecting the image display device to the external device via a wireless network;

capturing, by the external device, a current screen displayed on the external device;

generating, by the external device, first screen information based on the captured current screen, wherein the generated first screen information comprises the captured current screen and right and left margins when the external device is in a portrait mode;

encoding, by the external device, the generated first screen information;

transmitting, by the external device, the encoded first screen information to the image display device via the wireless network;

decoding, by the image display device, the encoded first screen information;

outputting, by the image display device, a first mirroring image based on the decoded first screen information, wherein the first mirroring image corresponds to the current screen displayed on the external device and wherein the first mirroring image includes the right and left margins;

generating, by the external device, second screen information based on the captured current screen, wherein the generated second screen information comprises the captured current screen without the right and left margins when the external device is in a landscape mode;

encoding, by the external device, the generated second screen information;

transmitting, by the external device, the encoded second screen information to the image display device via the wireless network;

decoding, by the image display device, the encoded second screen information; and

outputting, by the image display device, a second mirroring image based on the decoded second screen information, wherein the second mirroring image corresponds to the current screen displayed on the external device and wherein the second mirroring image has no right and left margins.

2. The method of claim 1, further comprising:

processing, by the external device, the right and left margins in black such that the current screen of the portrait mode suits a screen of the image display device.

3. The method of claim 1, further comprising:

storing, by the image display device, width and length information of a screen of the image display device.

4. The method of claim 1, further comprising:

outputting, by the image display device, a cursor which is a guide image at a point pointed to by a wireless remote controller; and

generating, by the image display device, coordinate information of the cursor output at the point pointed to by the wireless remote controller.

5. The method of claim 1, wherein a screen posture direction of the external device is determined by using a gyroscope sensor.

6. The method of claim 1, further comprising:

generating, by the external device, third screen information based on the captured current screen, wherein the generated third screen information comprises the captured current screen and margin information when the external device is in the landscape mode and the image display device is in a portrait mode;

encoding, by the external device, the generated third screen information;

transmitting, by the external device, the encoded third screen information to the image display device via the wireless network;

decoding, by the image display device, the encoded third screen information; and

outputting, by the image display device, a third mirroring image based on the decoded third screen information, wherein the third mirroring image corresponds to the current screen displayed on the external device and wherein the third mirroring image includes upper and lower margins.

7. A mobile terminal for sharing data with an image display device, the mobile terminal comprising:

a sensor;

a wireless network interface configured to connect to the image display device;

a display; and

a controller coupled to the wireless network interface and the display,

wherein the controller is configured to;

control the wireless network interface to receive information on a screen posture direction of the image display device from the image display device,

control the sensor to sense a screen posture direction of the mobile terminal,

capture a current screen on the display,

generate first screen information based on the captured current screen, wherein the generated first screen information comprises the captured current screen and right and left margins if the screen posture direction of the image display device is different from the screen posture direction of the mobile terminal,

encode the generated first screen information,

control the wireless network interface to transmit the encoded first screen information to the image display device,

generate second screen information based on the captured current screen, wherein the generated second screen information comprises the captured current screen without the right and left margins if the screen posture direction of the image display device is the same as the screen posture direction of the mobile terminal,

encode the generated second screen information, and

control the wireless network interface to transmit the encoded second screen information to the image display device.

8. The mobile terminal of claim 7, wherein the controller is further configured to process the right and left margins in black such that the current screen of the mobile terminal suits a screen of the image display device.

9. The mobile terminal of claim 7, wherein the screen posture direction of the mobile terminal is determined by using a gyroscope sensor.

10. The mobile terminal of claim 7, wherein the mobile terminal corresponds to a mobile phone, smartphone, a personal digital assistant (PDA) or a portable multimedia player (PMP).

18. The mobile terminal of claim 7, wherein the generated first screen information comprises the captured current screen and right and left margins if the mobile terminal is in a portrait mode and the image display device is in a landscape mode.

11. An image display device for sharing data with a mobile terminal, the image display device comprising:

a wireless network interface configured to connect to the mobile terminal;

a display; and

a controller coupled to the wireless network interface and the display,

wherein the controller is configured to;

control the wireless network interface to receive first screen information from the mobile terminal, wherein the first screen information further comprises right and left margins when the mobile terminal is in a portrait mode,

control the display to output a first mirroring image based on the first screen information, wherein the first mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the first mirroring image includes the right and left margins,

control the wireless network interface to receive second screen information from the mobile terminal, wherein the second screen information has no right and left margins when the mobile terminal is in a landscape mode, and

control the display to output a second mirroring image based on the second screen information, wherein the second mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the second mirroring image has no right and left margins.

12. The image display device of claim 11, wherein the controller is further configured to:

control the wireless network interface to receive third screen information from the mobile terminal, wherein the third screen information further comprises margin information when the mobile terminal is in the landscape mode and the image display device is in a portrait mode, and

control the display to output a third mirroring image based on the third screen information, wherein the third mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the third mirroring image includes upper and lower margins.

13. The image display device of claim 11, further comprising:

a memory configured to store width and length information of a screen of the image display device.

14. The image display device of claim 11, wherein the controller is further configured to control the display to output a cursor which is a guide image at a point pointed to by a wireless remote controller.

15. The image display device of claim 14, wherein the controller is further configured to generate coordinate information of the cursor output at the point pointed to by the wireless remote controller.

16. The image display device of claim 11, wherein the image display device corresponds to a TV receiver, a laptop computer, a digital broadcast terminal, a navigation device, a mobile phone, a smartphone, a personal digital assistant (PDA) or a portable multimedia player (PMP).

17. The image display device of claim 11, wherein the wireless network interface performs based on Wi-Fi, Bluetooth or ZigBee.

19. A mobile terminal for sharing data with an image display device, the mobile terminal comprising:

a sensor;

a wireless network interface configured to connect to the image display device;

a display; and

a controller coupled to the sensor, the wireless network interface and the display,

wherein the controller is configured to;

control the wireless network interface to receive information on a screen posture direction of the image display device,

control the sensor to sense a screen posture direction of the mobile terminal,

compare the screen posture direction of the image display device with the screen posture direction of the mobile terminal sensed by the sensor,

capture a current screen on the display,

generate a first or second screen information based on the comparison result, wherein the generated first or second screen information comprises the captured current screen, and

control the wireless network interface to transmit the generated first or second screen information to the image display device.

20. The mobile terminal of claim 19, wherein the generated first screen information comprises the captured current screen and right and left margins if the screen posture direction of the image display device is different from the screen posture direction of the mobile terminal.

21. The mobile terminal of claim 20, wherein the generated first screen information comprises the captured current screen and right and left margins if the mobile terminal is in a portrait mode and the image display device is in a landscape mode.

22. The mobile terminal of claim 20, wherein the generated second screen information comprises the captured current screen without the right and left margins if the screen posture direction of the image display device is the same as the screen posture direction of the mobile terminal.

23. The mobile terminal of claim 19, wherein one of the first or second screen information is generated based on the comparison result.

24. The mobile terminal of claim 19, wherein the controller is further configured to process the right and left margins in black such that the current screen of the mobile terminal suits a screen of the image display device.

25. The mobile terminal of claim 19, wherein the screen posture direction of the mobile terminal is determined by using a gyroscope sensor.

26. The mobile terminal of claim 19, wherein the wireless network interface performs based on Wi-Fi, Bluetooth or ZigBee.

27. The mobile terminal of claim 19, wherein the mobile terminal corresponds to a mobile phone, smartphone, a personal digital assistant (PDA) or a portable multimedia player (PMP).