APPARATUS AND METHOD FOR DEVICE ADMINISTRATION USING AUGMENTED REALITY IN ELECTRONIC DEVICE

• US 20150228124A1
• Filed: 02/10/2015
• Published: 08/13/2015
• Est. Priority Date: 02/10/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: KIM, Sung-Chul, KIM, Hong-Ryol
• Granted Patent: US 10,210,377 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/1696 the I/O peripheral being a printing or scanning device
• CPC Class Codes: G06F 1/1698 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone details of antennas disposed inside a computer H01Q1/2266
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20212 Image combination
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/64 Three-dimensional objects

Abstract

Methods and apparatuses are provided for operation for an electronic device. Video is output on a display unit of the electronic device. The display unit displays a screen showing a range for device recognition, and displays at least one result of the device recognition corresponding to at least one device.

Claims

1. An electronic device comprising:

a display unit configured to output video; and

a control unit configured to control the display unit to display a screen showing a range for device recognition, and to display at least one result of the device recognition corresponding to at least one device.

2. The electronic device of claim 1, wherein the control unit is further configured to control the display unit to display a device management User Interface (UI) for managing a device, if a result of the device recognition for the device is selected from among the at least one result.

3. The electronic device of claim 1, wherein the at least one result of the device recognition comprises at least one of a device state, an upper node, a device name, a distance from a corresponding recognized device, and a number of overlapped devices.

4. The electronic device of claim 2, wherein the device management UI comprises at least one of an upper node, a device name, a characteristic icon, a manual icon, an instruction icon, and specification information.

5. The electronic device of claim 4, wherein the instruction icon provides an interface for controlling the device.

6. The electronic device of claim 1, wherein the control unit is further configured to recognize the at least one device through one of the video taken through a camera unit of the electronic device and an electronic map.

7. The electronic device of claim 1, wherein the control unit is further configured to acquire device information through at least one of a memory unit and a device management system.

8. The electronic device of claim 1, further comprising:

a camera unit configured to acquire the video;

a sensor unit configured to acquire information about a position of the electronic device and a camera view direction; and

a memory unit configured to store device information.

9. The electronic device of claim 8, wherein the sensor unit comprises at least one of a Global Positioning System (GPS) receiver, a gyro sensor, a geomagnetic sensor, a gravity sensor, and a Near Field Communication (NFC) sensor.

10. The electronic device of claim 6, wherein the control unit is further configured to control the display unit to display a mode window comprising at least one of an object recognition mode, a text recognition mode, an NFC recognition mode, and a position information recognition mode.

11. The electronic device of claim 10, wherein the control unit is further configured to recognize at least one of an image of a device, a name tag, an Augmented Reality (AR) marker, a Quick Response (QR) code, a bar code, an NFC signal, and user position information, from the video acquired through the camera unit of the electronic device.

12. The electronic device of claim 6, wherein the control unit is further configured to control the display unit to display a screen pause button that freezes the video on the display unit.

13. The electronic device of claim 6, wherein the screen showing the range comprises at least one of a menu of filtering the at least one device, an identification mode window, an explanatory note distinguishing device states, a screen pause button, a RAdio Detection And Ranging (RADAR), and a distance adjustment meter.

14. The electronic device of claim 6, wherein the control unit is further configured to recognize a device located within a camera shooting range and a preset distance based on a position of the electronic device and a camera view direction.

15. The electronic device of claim 6, wherein the control unit is further configured to set a distance range for the device recognition, in the video taken by the camera unit of the electronic device.

16. The electronic device of claim 14, wherein, if a searched device does not exist within the camera shooting range based on the position of the electronic device and the camera view direction, the control unit controls the display unit to display a direction of the searched device based on the position of the electronic device.

17. The electronic device of claim 6, wherein the control unit is further configured to control the display unit to display the at least one result on the electronic map.

18. A method of operation for an electronic device, the method comprising:

outputting video on a display unit of the electronic device; and

displaying, on the display unit, a screen showing a range for device recognition, and displaying at least one result of the device recognition corresponding to at least one device.

19. The method of claim 18, further comprising displaying a device management User Interface (UI) for managing a device, if a result of the device recognition for the device is selected from among the at least one result.

20. The method of claim 18, wherein the at least one result of the device recognition comprises at least one of a device state, an upper node, a device name, a distance from a corresponding recognized device, and a number of overlapped devices on a screen.

21. The method of claim 19, wherein the device management UI comprises at least one of an upper node, a device name, a characteristic icon, a manual icon, an instruction icon, and specification information.

22. The method of claim 21, wherein the instruction icon provides an interface for controlling the device.

23. The method of claim 18, wherein displaying the screen showing the range for device recognition comprises displaying one of the video that is being taken through a camera unit of the electronic device and an electronic map.

24. The method of claim 18, wherein displaying the at least one result comprises acquiring device information through at least one of a memory unit and a device management system.

25. The method of claim 18, wherein displaying the at least one result further comprises:

driving a camera unit and acquiring the video;

driving a sensor unit and acquiring information about a position of the electronic device and a camera view direction; and

acquiring device information.

26. The method of claim 25, wherein the information about the position of the electronic device and the camera view direction are acquiring using at least one of a Global Positioning System (GPS) receiver, a gyro sensor, a geomagnetic sensor, a gravity sensor, and a Near Field Communication (NFC) sensor.

27. The method of claim 23, wherein displaying the screen showing the range for device recognition comprises displaying an identification mode window comprising at least one of an object recognition mode, a text recognition mode, an NFC recognition mode, and a position information recognition mode.

28. The method of claim 27, wherein displaying the at least one result comprises recognizing at least one of an image of a device, a name tag, an Augmented Reality (AR) marker, a Quick Response (QR) code, a bar code, an NFC signal, and user position information.

29. The method of claim 23, wherein the screen showing the range for device recognition comprises a screen pause button for freezing the video on the display unit.

30. The method of claim 23, wherein the screen showing the range for device recognition comprises at least one of a menu of filtering at least one device, an identification mode window, an explanatory note distinguishing device states, a screen pause button, a RAdio Detection And Ranging (RADAR), and a distance adjustment meter.

31. The method of claim 23, wherein displaying the at least one result comprises recognizing a device located within a camera shooting range and a preset distance based on a position of the electronic device and a camera view direction.

32. The method of claim 23, wherein the displaying the at least one result comprises setting a distance range to recognize a device, in the video that is being taken by the camera unit of the electronic device.

33. The method of claim 31, wherein displaying the at least one result, if the searched device does not exist within the camera shooting range on a basis of the position of the electronic device and the camera view direction, displaying the direction of the searched device on the electronic device screen on a basis of the position of the electronic device.

34. The method of claim 23, further comprising:

displaying the at least one result on the electronic map.