METHOD OF TRANSMITTING AND RECEIVING DATA, DISPLAY DEVICE AND MOBILE TERMINAL USING THE SAME

• US 20120208466A1
• Filed: 11/28/2011
• Published: 08/16/2012
• Est. Priority Date: 02/15/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: PARK, Jinyung, PARK, Junho, KIM, Jongcheol, Therat SETHUMADAVAN, Bipin
• Granted Patent: US 9,055,162 B2
• Time in Patent Office: Days
• US Class Current: 455/41.3
• CPC Class Codes: G06F 1/1601 Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64
• CPC Class Codes: G06F 1/1605 Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 21/4108 characterised by an identification number or address, e.g. local network address protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/44231 Monitoring of peripheral device or external card, e.g. to detect processing problems in a handheld device or the failure of an external recording device configuring of peripheral devices in general G06F9/4411; reporting information sensed by appliance or service execution status of appliance services in a home automation network H04L12/2823; monitoring the status of connected device in data switched networks H04L43/0817
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04W 4/02 : Services making use of location information
• CPC Class Codes: H04W 4/21 : for social networking applications

Abstract

A method of facilitating communications between a mobile terminal and a display device includes determining an orientation of a mobile terminal with respect to a display device that is physically distinct of the mobile terminal, and determining a manner in which wireless content data is to be communicated between the display device and the mobile terminal. The method includes wirelessly transmitting the content data between the display device and the mobile terminal based on the determined manner. The determined manner of the communication can be based on determining whether the mobile terminal faces a display screen of the display device for wirelessly transmitting the content data from the mobile terminal to the display device or determining whether the mobile terminal faces away from the display screen of the display device for wirelessly transmitting the content data from the display device to the mobile terminal.

Claims

1. A method of facilitating communications between a mobile terminal and a display device, the method comprising:

determining an orientation of a mobile terminal with respect to a display device that is physically distinct of the mobile terminal;

based on results of the determination of the orientation of the mobile terminal and the display device, determining a manner in which wireless content data is to be communicated between the display device and the mobile terminal; and

wirelessly transmitting the content data between the display device and the mobile terminal based on the determined manner.

2. The method of claim 1, wherein the determined manner in which the wireless content data is communicated between the display device and the mobile terminal is based on determining whether the mobile terminal faces a display screen of the display device for wirelessly transmitting the content data from the mobile terminal to the display device or determining whether the mobile terminal faces away from the display screen of the display device for wirelessly transmitting the content data from the display device to the mobile terminal.

3. The method of claim 2, further comprising, prior to determining the orientation, determining whether the mobile terminal and the display device are locationally proximate, wherein determining whether the mobile terminal and the display device are locationally proximate comprises determining whether the mobile terminal touches the display device.

4. The method of claim 2, further comprising, prior to determining the orientation, determining whether the mobile terminal and the display device are locationally proximate, wherein determining whether the mobile terminal and the display device are locationally proximate comprises determining a distance between the mobile terminal and the display device, accessing a prestored threshold distance, and comparing the determined distance to the prestored threshold distance to determine whether the mobile terminal is located within the prestored threshold distance of the display device.

5. The method of claim 1, wherein determining the orientation comprising determining at least one of a first orientation and a second orientation, a first side of the mobile terminal facing a display screen of the display device in the first orientation, and a second side of the mobile terminal that differs from the first side of the mobile terminal facing the display screen of the display device in the second orientation.

6. The method of claim 5, responsive to determining the first orientation, configuring the display device to enable a flow of content data from the mobile terminal to the display device.

7. The method of claim 6, further comprising displaying, on the display device, the content data wirelessly transmitted from the mobile terminal to the display device.

8. The method of claim 5, responsive to determining the second orientation, configuring the display device to enable a flow of content data from the display device to the mobile terminal.

9. The method of claim 8, further comprising displaying, on the mobile terminal, the content data wirelessly transmitted from the display device to the mobile terminal.

10. A method of facilitating communications between a mobile terminal and a display device, the method comprising:

establishing a network connection between a mobile terminal and a display device;

determining that the mobile terminal and the display device satisfy a requisite proximity;

responsive to the determining that the mobile terminal and the display device satisfy the requisite proximity, wirelessly communicating data between the mobile terminal and the display device;

determining an orientation of the mobile terminal with respect to the display device based on the wirelessly communicated data between the mobile terminal and the display device;

processing the data related to the orientation of the mobile terminal with respect to the display device;

indicating a user instruction regarding a wireless transfer of content data between the display device and the mobile terminal based on the processed data; and

wirelessly transferring the content data between the display device and the mobile terminal according to the user instruction.

11. The method of claim 10, wherein the proximity comprises the mobile terminal touching the display device.

12. The method of claim 10, wherein determining whether the mobile terminal and the display device satisfies the requisite proximity comprises determining a distance between the mobile terminal and the display device, accessing a prestored threshold distance, and comparing the determined distance to the prestored threshold distance to determine whether the mobile terminal is located within the prestored threshold distance of the display device.

13. The method of claim 10, wherein the display device is untethered with respect to the mobile terminal, wherein the display device and the mobile terminal are electrically disconnected with respect to each other.

14. The method of claim 10, wherein the content data comprises at least one of video, text, audio, a photograph, a document file, a game, a telephone call, a video call, and a software application.

15. The method of claim 10, wherein the user instruction further comprises a cut operation relating to capture of the content data to be moved between the mobile terminal and the display device.

16. The method of claim 15, wherein the cut operation further comprises:

displaying a representation of content data on a display screen of the display device;

determining that the mobile terminal has an orientation in which a particular side of the mobile terminal faces the display screen of the display device; and

responsive to determining that the mobile terminal has the orientation in which the particular side of the mobile terminal faces the display screen of the display device, removing the representation of the content data on the display screen of the display device.

17. The method of claim 16, wherein the user instruction further comprises a paste operation relating to the content data to be moved between the mobile terminal and the display device.

18. The method of claim 17, wherein the paste operation is performed subsequent to the cut operation, wirelessly transferring the content data that is cut from the display device to the mobile terminal and enabling the mobile terminal to display the representation of the content data on a first side of the mobile terminal.

19. The method of claim 10, wherein the user instruction comprises a selection operation of content data, where the selection operation comprises:

displaying a representation of content data on a display screen of the display device;

detecting the orientation of the mobile terminal with respect to the display screen of the display device;

responsive to detecting the orientation, selecting the representation of the content data on the display screen of the display device; and

presenting an indication on the display screen of the display device that the content data is selected.

20. The method of claim 10, further comprising detecting the orientation of the mobile terminal when the mobile terminal touches the display device.

21. A method of facilitating communications between a mobile terminal and a display device, the method comprising:

establishing a network connection between a mobile terminal and a display device;

determining that a proximity of the mobile terminal to the display device satisfies a requisite proximity;

responsive to the determining that the mobile terminal and the display device satisfy the requisite proximity, determining an orientation of the mobile terminal with respect to the display device;

processing the data related to the orientation of the mobile terminal with respect to the display device, the processing comprising determining one of a first orientation and a second orientation, the first orientation occurring where a first side of the mobile terminal faces a display screen of the display device and the second orientation occurring where a second side of the mobile terminal faces the display screen of the display device;

responsive to determining the first orientation, receiving, at the display device, content data from the mobile terminal; and

responsive to determining the second orientation, wirelessly transmitting, from the display device, content data to the mobile terminal.

22. The method of claim 21, wherein the proximity comprises the mobile terminal touching the display device.

23. The method of claim 21, wherein the proximity comprises the mobile terminal being located within a predefined range of the display device.

24. The method of claim 21, wherein determining whether the mobile terminal and the display device satisfies the requisite proximity comprises determining a distance between the mobile terminal and the display device, accessing a prestored threshold distance, and comparing the determined distance to the prestored threshold distance to determine whether the mobile terminal is located within the prestored threshold distance of the display device.

25. The method of claim 21, wherein the content data comprises at least one of video, text, audio, a photograph, a document file, a game, a telephone call, a video call, and a software application.

26. The method of claim 21, further comprising detecting the orientation of the mobile terminal when the mobile terminal touches the display device.

27. The method of claim 21, wherein the determining the orientation comprises detecting whether one of a front side, a rear side and an edge side of the mobile terminal touches a screen portion of the display device.

28. The method of claim 21, responsive to determining the first orientation, receiving, in the display device, the content data stored in the mobile terminal when the first side of the mobile terminal touches a portion of the display screen of the display device.

29. The method of claim 28, wherein the content data received from the mobile terminal comprises content data that is being replayed in the mobile terminal.

30. The method of claim 28, wherein the first side of the mobile terminal is a front side of the mobile terminal.

31. The method of claim 28, further comprising:

detecting a location of the display screen of the display device that is touched by the mobile terminal; and

responsive to detecting the location of the display screen, displaying, at the location of the touch, at least one of content data selected from the mobile terminal and information regarding the content data.

32. The method of claim 31, wherein the displaying of the content data and information comprises:

displaying an image, selected from the mobile terminal, on the screen of the display device; and

playing a moving image selected from the mobile terminal when the image displayed on the screen is selected.

33. The method of claim 31, wherein the displaying of the content data and information comprises:

displaying information of music data, selected from the mobile terminal, on the display screen of the display device; and

receiving, by the display device, audio data comprising the music data, and successively replaying music data that is replayed by the mobile terminal.

34. The method of claim 31,

wherein the displaying of the content data and information comprises displaying contact information selected from the mobile terminal on the display screen, the contact information being displayed in association with the content data displayed at the touch location of the display screen.

35. The method of claim 31, wherein,

the displaying of the content data and information comprises successively executing an application that is executed by the mobile terminal, and

the transmitting and receiving of the content data involves receiving at least one of message information and login information for the application, from the mobile terminal.

36. The method of claim 21, wherein the transmitting of the content data comprises transmitting the content data, stored in the mobile terminal, to the mobile terminal when the second side of the mobile terminal touches a portion of the display screen of the display device.

37. The method of claim 36, further comprising detecting a location of the display screen of the display device that is touched by the mobile terminal,

wherein the transmitting and receiving of the content data comprises transmitting the content data displayed at the location of the touch on the display screen, to the mobile terminal.

38. The method of claim 37, wherein the second side is location at a rear side of the mobile terminal.

39. The method of claim 21, wherein determining the orientation comprises performing a detection with at least one of a magnetometer, an accelerometer, a gyroscope sensor, a proximity sensor, an ambient light sensor, and a colorimeter.

40. The method of claim 21, wherein the determining the orientation comprises:

receiving color information measured by a sensor that is disposed in a front side or a rear side of the mobile terminal; and

determining the orientation at least based on color information received from the mobile terminal.

41. The method of claim 40, wherein the determining of the orientation compares the color information received from the mobile terminal and color information of an image displayed on the display screen of the display device, based on a time when the mobile terminal touches the display device.

42. The method of claim 41, wherein the determining of the orientation determines the front side of the mobile terminal as touching a portion of the display screen of the display device, when the color information, measured by the sensor that is disposed in the front side of the mobile terminal, corresponds to the color information of the displayed image.

43. The method of claim 21, further comprising detecting a location comprising determining a touch location of the mobile terminal by using at least one of a touch sensor, a Near Field Communication (NFC) tag, and a catadioptric camera that are located in the display device.

44. The method of claim 43, wherein determining the touch location comprises:

detecting at least one NFC tag, from which an NFC reader located in the mobile terminal has read information, from among a plurality of NFC tags disposed in a rear side of a portion of the display screen of the display device; and

determining the touch location of the mobile terminal in correspondence with a location of the detected NFC tag.

45. The method of claim 43, wherein the determining of the touch location determines the touch location of the mobile terminal by using respective images captured by a plurality of catadioptric cameras that are respectively disposed at front edges of the display device.

46. A mobile terminal which transmits and receives data to and from a display device over a wireless network, the mobile terminal comprising:

a storage unit storing content;

a wireless communication unit transmitting and receiving data to and from the display device when the mobile terminal touches the display device; and

a control unit controlling the wireless communication unit to perform different functions of transmitting and receiving data, according to an orientation of the display device,

wherein,

when a first surface of the mobile terminal touches a screen portion of the display device, data stored in the storage unit is transmitted to the display device through the wireless communication unit, and

when a second surface of the mobile terminal touches the screen portion, data stored in the display device is received through the wireless communication unit.

47. The mobile terminal of claim 46, wherein the wireless communication unit is configured to receive information regarding at least one of the orientation and touch location of the mobile terminal.

48. A display device comprising:

a network interface configured to establish a network connection between a mobile terminal and a display device;

a sensing unit configured to detect a proximity of the mobile terminal to the display device;

the network interface is configured to wirelessly communicate data between the mobile terminal and the display device to determine an orientation of the mobile terminal with respect to the display device;

a display screen of the display device configured to display content data; and

a control unit configured to;

process the data for the orientation to determine one of a first orientation and a second orientation, the first orientation occurring where a first side of the mobile terminal faces the display screen of the display device and the second orientation occurring where a second side of the mobile terminal faces the display screen of the display device;

responsive to determining the first orientation, receiving, at the display device, content data from the mobile terminal via the network interface; and

responsive to determining the second orientation, transmitting, from the display device, content data to the mobile terminal via the network interface.