Controlling a display apparatus via a GUI executed on a separate mobile device

• US 10,467,031 B2
• Filed: 02/18/2014
• Issued: 11/05/2019
• Est. Priority Date: 02/21/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Song, Hyung-joo, Yoo, Jin-kyu, Kim, Tae-ho, Park, Kang-yong, Lee, Kyeong-woon, Choi, Young-soo
• Primary Examiner(s): Yi, Rinna
• Application Number:
  US14/182,621
• Publication Number:
  US 20140237397A1
• Time in Patent Office: 2,086 Days
• Field of Search: 715761
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205

Abstract

A display apparatus and a control method thereof are provided. The display apparatus includes an image processor configured to process an image signal, a display unit configured to display an image based on the image signal, a storage section configured to store Graphic User Interface (GUI) information about a GUI to be displayed in a mobile device for controlling the display apparatus, a web server configured to communicate with a web browser of the mobile device, and a controller configured to transmit the stored GUI information to the mobile device if the web browser of the mobile device requests the GUI information through the web server, and to operatively control the display apparatus in accordance with control information received from the mobile device.

Claims

1. A display apparatus comprising:

a display configured to display an image based on an image signal;

memory configured to store a plurality of graphical user interface (GUI) information comprising at least a first GUI about an application launcher including information about a list of a plurality of applications executable in the display apparatus, a second GUI for controlling an operation of the plurality of applications executed in the display apparatus, and characteristics of the mobile device comprising at least one of an operating system, a platform, or a product specification of a mobile device; and

at least one processor configured to;

communicate a web browser of the mobile device through a web server comprised within the display apparatus;

receive a request of the GUI information about the first GUI from the web browser of the mobile device;

transmit the stored GUI information about the first GUI corresponding to the characteristic of the mobile device to the mobile device to display the first GUI on the mobile device via the web server of the display apparatus in response to the received request of the GUI information from the web browser of the mobile device;

in response to one of the plurality of applications of the display apparatus being selected by a first user input on the first GUI received from the mobile device, transmit information about the selected application to the display apparatus, execute a corresponding application in the display device associated with the selected application on the mobile device, display the second GUI corresponding to the executed application in a predetermined region on the display of the display device, and transmit the stored GUI information about the second GUI corresponding to the characteristic of the mobile device to the mobile device to display the second GUI for controlling an operation of the selected application on the mobile device while the second GUI is displayed on the predetermined region of the display of the display device to control by the mobile device or the second GUI displayed on the display apparatus; and

control the operation of the executed application in the display apparatus according to a second user input from the mobile device, the second user input being input in response to the displayed second GUI on the mobile device.

2. The display apparatus according to claim 1,

wherein the at least one processor executes an application in accordance with control information received from the mobile device.

3. The display apparatus according to claim 2,

wherein the at least one processor is further configured to execute one among the plurality of applications in accordance with control information received from the mobile device.

4. The display apparatus according to claim 2, wherein the GUI information comprises information about a GUI of the executed application in the display device.

5. The display apparatus according to claim 1,

wherein the at least one processor is further configured to:

select one GUI information corresponding to the selected application in the mobile device among the plurality of stored GUI information, and

transmit the selected GUI information to the mobile device.

6. A method of controlling a display apparatus displaying an image based on an image signal, the method comprising:

storing a plurality of graphical user interface (GUI) information comprising at least a first GUI for an application launcher including information about a list of a plurality of applications executable in the display apparatus, a second GUI for controlling an operation of the plurality of applications executed in the display apparatus, and characteristics of the mobile device comprising at least one of an operating system, a platform, or a product specification of a mobile device;

communicating with a web browser of a mobile device through a web server comprised within the display apparatus;

receiving a request of GUI information about the first GUI from the web browser of the mobile device;

transmitting stored GUI information about the first GUI corresponding to the characteristic of the mobile device to the mobile device to display the first GUI on the mobile device via the web server of the display apparatus in response to the received request of the GUI information from the web browser of the mobile device;

in response to one of the plurality of applications of the display apparatus being selected by a first user input on the first GUI received from the mobile device, transmitting information about the selected application to the display apparatus, executing a corresponding application in the display device associated with the selected application on the mobile device, displaying the second GUI corresponding to the executed application in a predetermined region on a display of the display apparatus, and transmitting the stored GUI information about the second GUI corresponding to the characteristic of the mobile device to the mobile device to display the second GUI for controlling an operation of the selected application on the mobile device while the second GUI is displayed on the predetermined region of the display of the display apparatus to control by the mobile device or the second GUI displayed on the display apparatus; and

controlling the operation of the executed application in the display apparatus according to a second user input from the mobile device, the second user input being input in response to the displayed second GUI on the mobile device.

7. The method according to claim 6,

wherein the performing the operations comprises executing an application in accordance with control information received from the mobile device.

8. The method according to claim 7,

wherein the performing the operations comprises executing one among the plurality of applications in accordance with control information received from the mobile device.

9. The method according to claim 7, wherein the GUI information comprises information about a GUI of the executed application in the display device.

10. The method according to claim 6, further comprising selecting one GUI information corresponding to the selected application in the mobile device among the plurality of GUI information,

wherein the transmitting of the GUI information comprises transmitting the selected GUI information to the mobile device.

11. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 6.

12. A system for controlling a display apparatus using a mobile device, the system comprising:

the mobile device; and

the display apparatus comprising a web server, the display apparatus configured to;

store a plurality of graphical user interface (GUI) information comprising at least a first GUI about an application launcher including information about a list of a plurality of applications executable in the display apparatus, a second GUI for controlling an operation of the plurality of applications executed in the display apparatus, and characteristics of the mobile device comprising at least one of an operating system, a platform, or a product specification of a mobile device;

communicate a web browser of the mobile device through the web server comprised within the display apparatus;

receive a request of the GUI information about the first GUI from the web browser of the mobile device;

transmit stored GUI information about the first GUI corresponding to the characteristic of the mobile device to the mobile device to display the first GUI on the mobile device via the web server of the display apparatus in response to the received request of the GUI information from the web browser of the mobile device;

in response to one of the plurality of applications of the display apparatus being selected by a first user input on the first GUI received from the mobile device, transmit information about the selected application to the display apparatus, execute a corresponding application in the display device associated with the selected application on the mobile device, display the second GUI corresponding to the executed application in a predetermined region on a display of the display apparatus, and transmit the stored GUI information about the second GUI corresponding to the characteristic of the mobile device for controlling an operation of the selected application to the mobile device to display the second GUI on the mobile device while the second GUI is displayed on the predetermined region of the display of the display apparatus to control by the mobile device or the second GUI displayed on the display apparatus; and

control the operation of the selected application according to a second user input from the mobile device, the second user input being input in response to the displayed second GUI on the mobile device.

13. The system of claim 12, wherein the GUI information relates to a GUI with which the display apparatus is controlled using the mobile device.

14. The system of claim 12, wherein the display apparatus further comprises:

the display configured to display an image operatively based on an image signal.