Method and system for providing NUI

• US 9,823,812 B2
• Filed: 12/27/2011
• Issued: 11/21/2017
• Est. Priority Date: 11/24/2011
• Status: Active Grant

• Current Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Original Assignee: Korea Electronics Technology Institute (Government of South Korea)
• Inventors: Kim, Jae Ho, Sung, Ha Gyeong, Won, Kwang Ho, Lee, Sang Shin, Ahn, Il Yeup, Song, Min Hwan, Yoon, Jae Seok
• Primary Examiner(s): Ell, Matthew
• Application Number:
  US14/362,369
• Publication Number:
  US 20140331144A1
• Time in Patent Office: 2,156 Days
• Field of Search: 715765
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications

Abstract

A method and system for providing a Network-based User Interface (NUI) is provided. The method for providing the NUI includes: selecting one from among devices connected to a network; acquiring a UI regarding the selected device through the network; and interacting with the device by using the acquired UI. Accordingly, the user terminal can acquire the UI regarding the device connected to the network through the network and interact with the device, so that the user can easily manipulate the device at a remote distance and can easily grasp the statue of the device.

Claims

1. A method for providing a Network-based User Interface (NUI), the method comprising:

displaying, by a user terminal, devices connected to a network;

selecting, by the user terminal, a first device from among the displayed devices;

acquiring, by the user terminal and from a server through the network, an application which provides a User Interface (UI) controlling the selected first device; and

executing, by the user terminal, the acquired application for interacting with the selected first device using the UI provided by the executed application,

wherein the devices are stratified,

wherein, when the first device is selected, a second device which is a lower level device of the first device is displayed by the user terminal on an electronic map browser,

wherein a kind of an electronic map of the electronic map browser is changed according to a level of devices displayed on the electronic map browser,

wherein the selecting comprises

displaying graphic items, which are assigned to the devices, on an electronic map browser, and

selecting a graphic item from among the graphic items displayed on the electronic map browser,

wherein the selected graphic item is assigned to the first device,

wherein each of the graphic items displayed on the electronic map browser indicates one of a person and a place, and

wherein the displayed devices comprises a real device physically connected to the network and a virtual device virtually connected to the network, and the real device and virtual device are distinguished from each other by color on the electronic map browser.

2. The method of claim 1, wherein the acquiring comprises

accessing, by a browser executed in the user terminal, a web page of the server, and

acquiring, through the accessed web page, the application from the server.

3. The method of claim 1, further comprising:

requesting, by the user terminal, the server to search devices connected to the network; and

receiving, from the server, a device list of searched devices,

wherein the displaying comprises displaying, by the user terminal, the received device list, and

wherein the selecting comprises selecting the first device from among the devices listed in the displayed device list.

4. The method of claim 1, wherein the user terminal interacts with the first device directly through the network or indirectly via the server.

5. The method of claim 1, wherein the selecting comprises:

displaying, by the user terminal, the electronic map browser on which the devices are displayed; and

selecting the first device from among the devices displayed on the electronic map browser.

6. The method of claim 1, further comprising:

changing, by the user terminal, a screen of the electronic map browser to a previous browser screen or a next browser screen according to a user command.

7. The method of claim 1, wherein the devices are displayed by the user terminal according to a distance from the user terminal to the devices and a security level of a user of the user terminal.

8. A system for providing a Network-based User Interface (NUI) comprising:

a server configured to

store applications each comprising a User Interface (UI) for controlling a corresponding one of devices connected to a network; and

a terminal configured to

display the devices connected to the network,

select a first device from among the displayed devices,

acquire, from the server, the application which provides the UI for controlling the selected first device, and

execute the acquired application for interaction with the selected first device using the UI provided by the executed application,

wherein the devices are stratified,

wherein the terminal is configured to, when the first device is selected, display a second device which is a lower level device of the first device, on an electronic map browser,

wherein the terminal is configured to change a kind of an electronic map of the electronic map browser according to a level of devices displayed on the electronic map browser,

wherein the terminal is configured to

display graphic items, which are assigned to the devices, on an electronic map browser, and

select a graphic item from among the displayed graphic items,

wherein the selected graphic item is assigned to the first device,

wherein each of the graphic items displayed on the electronic map browser indicates one of a person and a place, and

wherein the displayed devices comprises a real device physically connected to the network and a virtual device virtually connected to the network, and the real device and virtual device are distinguished from each other by color on the electronic map browser.