SYSTEM AND METHOD FOR CONTROLLING DEVICE

• US 20120120102A1
• Filed: 11/16/2011
• Published: 05/17/2012
• Est. Priority Date: 11/17/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: YU, Yong-Ju, PARK, Jin
• Granted Patent: US 8,847,987 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Provided is a system and method for controlling a device using Augmented Reality (AR). A system for controlling a device using Augmented Reality (AR) includes a device server, an AR server, and a portable terminal. The device server registers information about each device. The AR server generates an AR screen displaying type information and service-related information of at least one device searched in response to a request of a portable terminal by using the registered device information, and provides the generated AR screen to the portable terminal. The portable terminal connects with a device selected among devices displayed on the AR screen and performs a specific function with the connected device.

Claims

1. A system for controlling a device using Augmented Reality (AR), comprising:

a device server for registering information relating to a plurality of devices;

an AR server for generating an AR screen displaying a device type information and service-related information of at least one device searched in response to a request of a portable terminal based on the registered device information; and

the portable terminal for establishing a connection with a specific device selected among the plurality of devices displayed on the AR screen received from the AR server.

2. The system of claim 1, wherein the registered device information includes Identification (ID), Location Information, Available Service, Visual Database (DB), Access Right, and Connection Medium.

3. The system of claim 2, wherein the location information is manually registered by a user or current location information of the portable terminal is registered as the location information, and

wherein the registered location information is stored in a location table of the AR server.

4. The system of claim 1, wherein the plurality of devices are displayed on the AR screen at screen locations corresponding to the actual locations of the plurality of devices.

5. The system of claim 1, wherein the device server transmits the registered device information, which is updated periodically or whenever the registered device information changes, to the AR server.

6. The system of claim 1, wherein the AR server registers the device information received from the device server, and updates the device information according to device update information received from the device server.

7. The system of claim 1, wherein, upon receiving an AR-based device search request from the portable terminal, the AR server searches for at least one device located within a predetermined range based on the location information of the portable terminal, and generates the AR screen displaying a type of the searched device by a visual DB.

8. The system of claim 7, wherein the location information of the portable terminal is received from the portable terminal together with the AR-based device search request.

9. The system of claim 1, wherein the portable terminal displays a type of each device and information about each device on the AR screen received from the AR server in response to an AR-based device search request.

10. The system of claim 9, wherein the service-related information includes Available Service, Access Right, and Connection Medium.

11. A method for controlling a device using Augmented Reality (AR), comprising:

registering information about each device in a device server;

generating, by an AR server, an AR screen displaying device type information and service-related information of at least one device searched in response to a request of a portable terminal based on the registered device information, and transmitting the generated AR screen to the portable terminal; and

connecting, by the portable terminal, with a specific device selected among devices displayed on the AR screen and performing a specific function with the connected device.

12. The method of claim 11, wherein the registered device information includes Identification (ID), Location Information, Available Service, Visual Database (DB), Access Right, and Connection Medium.

13. The method of claim 12, wherein the location information is manually registered by a user or current location information of the portable terminal is registered as the location information, and wherein

the registered location information is stored in a location table of the AR server.

14. The method of claim 11, wherein the devices are displayed on the AR screen at screen locations corresponding to the actual locations of the devices

15. The method of claim 11, further comprising:

transmitting the registered device information from the device server to the AR server and storing the received device information in the AR server; and

transmitting the device information, which is updated periodically or whenever the registered device information changes, from the device server to the AR server and updating the device information in the AR server.

16. The method of claim 11, wherein the generating and transmitting of the AR screen to the portable terminal comprises:

upon receiving an AR-based device search request from the portable terminal, searching for at least one device located within a predetermined range among the registered devices based on the location information of the portable terminal; and

generating the AR screen displaying a type of the searched device by a visual DB of the device and displaying information relating to each device together with the type of the device.

17. The method of claim 16, wherein the location information of the portable terminal is received from the portable terminal together with the AR-based device search request.

18. The method of claim 11, wherein the performing of the specific function comprises:

upon receiving the AR screen from the AR server, displaying a type of each device and information about each device on the AR screen; and

connecting with a particular device selected among devices displayed on the AR screen and performing the specific function with the connected device.

19. The method of claim 18, wherein the service-related information includes Available Service, Access Right, and Connection Medium.