Peripheral device management system for communication between a display apparatus and a node terminal apparatus

• US 9,998,582 B2
• Filed: 02/09/2016
• Issued: 06/12/2018
• Est. Priority Date: 06/26/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Park, Sung-woo, Lee, Sang-jun, Ka, Jee-hoon
• Primary Examiner(s): Osifade, Idowu O
• Application Number:
  US15/019,017
• Publication Number:
  US 20160381201A1
• Time in Patent Office: 854 Days
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04W 4/70 Services for machine-to-machine communication [M2M] or machine type communication [MTC]

Abstract

A peripheral device management system includes a node terminal apparatus attached to a peripheral device and configured to detect an operating state of the attached peripheral device through a sensor configured to generate sensing data, and a display apparatus configured to receive the sensing data from the node terminal apparatus, to determine the operating state of the peripheral device based on the sensing data, and to display a user interface (UI) containing the operating state of the peripheral device. Accordingly, the peripheral device management system provides an Internet of things (IOT) service to a peripheral device that may not be capable of supporting an IOT service.

Claims

1. A system comprising:

a node terminal apparatus attached to a peripheral device and configured to sense vibration feedback or audio feedback according to an operating state of the peripheral device using a sensor, and generate sensing data based on the sensed vibration feedback or the sensed audio feedback; and

a display apparatus configured to, in response to the sensing data being received from the node terminal apparatus, acquire device information related to the received sensing data from pre-stored device information, and display a user interface (UI) indicating the operating state of the peripheral device based on the acquired device information,

wherein the peripheral device is incapable of communicating with the display apparatus and the node terminal apparatus is capable of communicating with the display apparatus,

wherein the device information includes information of a plurality of feedbacks generated according to an operation of the peripheral device,

wherein the display apparatus is further configured to;

compare the vibration feedback or the audio feedback, and the plurality of feedbacks included in the device information,

identify the operating state of the peripheral device based on a result of the comparison,

transmit, if the device information related to the sensing data is not stored, the sensing data to an external server, and

store, in response to the device information related to the sensing data being received from the external server, the received device information, and

wherein the node terminal apparatus is attachable to and detachable from a surface of the peripheral device.

2. The system as claimed in claim 1, wherein the display apparatus is further configured to perform pairing with the node terminal apparatus according to a pairing request received from the node terminal apparatus and, in response to the sensing data of the peripheral device being received from the paired node terminal apparatus.

3. The system as claimed in claim 2, wherein:

the UI is a peripheral device UI comprising a UI element corresponding to at least one peripheral device; and

the display apparatus is configured to add a UI element corresponding to a peripheral device that is registered in the display apparatus to the peripheral device UI and display the peripheral device UI with a position of the UI element based on a relative distance between the registered peripheral device and the display apparatus.

4. The system as claimed in claim 3, wherein the display apparatus is further configured to determine the position of the UI element corresponding to the peripheral device registered in the peripheral device UI according to a user command, and determine the relative distance of the UI element of the peripheral device registered in the peripheral device UI based on a signal intensity of the node terminal apparatus attached to the registered peripheral device.

5. The system as claimed in claim 3, wherein the display apparatus is further configured to display the operating state of the peripheral device on the UI element corresponding to the peripheral device with the node terminal apparatus attached to it.

6. The system as claimed in claim 5, wherein the display apparatus is further configured to display, with an animation effect, the operating state of the peripheral device on the UI element corresponding to the peripheral device with the node terminal apparatus attached to it, or display the operating state as a message popup near the UI element corresponding to the peripheral device with the node terminal apparatus attached to it.

7. The system as claimed in claim 1, wherein:

the UI is a message UI for guiding a user about the operating state of the peripheral device with the node terminal apparatus attached to it; and

the display apparatus is further configured to, in response to the sensing data being received from the node terminal apparatus during displaying of image content, display, on the image content, the message UI for guiding the operating state determined based on the received sensing data.

8. The system as claimed in claim 7, wherein the message UI is displayed as a popup in a region for displaying a UI element corresponding to the peripheral device with the node terminal apparatus attached to it.

9. The system as claimed in claim 3, wherein the display apparatus is further configured to determine a position of a user terminal apparatus configured to communicate with the display apparatus on the peripheral device UI, change a peripheral device UI comprising a UI element corresponding to the at least one peripheral device to correspond to a screen of the user terminal apparatus based on the determined position of the user terminal apparatus and a direction in which the user terminal apparatus is moving, and transmit the peripheral device UI to the user terminal apparatus.

10. The system as claimed in claim 1, wherein:

the display apparatus is further configured to transmit control information corresponding to the operating state of the peripheral device determined based on the sensing data to the node terminal apparatus; and

the node terminal apparatus is further configured to control an operation of the peripheral device with the node terminal apparatus attached to it based on the control information received from the display apparatus.

11. A method for managing a peripheral device, the method comprising:

sensing vibration feedback or audio feedback according to an operating state of a peripheral device to generate sensing data based on the vibration feedback or the audio feedback by a node terminal apparatus attached to the peripheral device;

obtaining the operating state of the peripheral device using the sensing data and transmitting the generated sensing data to a display apparatus by the node terminal apparatus;

in response to the sensing data being received by the display apparatus from the node terminal apparatus, acquiring device information related to the received sensing data from pre-stored device information, the device information includes information of a plurality of feedbacks generated according to an operation of the peripheral device

comparing the vibration feedback or the audio feedback, and the plurality of feedbacks included in the device information,

identifying the operating state of the peripheral device based on a result of the comparison,

displaying a user interface (UI) indicating the operating state of the peripheral device, and

transmitting, if the device information related to the sensing data is not stored, the sensing data to an external server; and

storing, in response to the device information related to the sensing data being received from the external server, the received device information in the display apparatus,

wherein the peripheral device is incapable of communicating with the display apparatus and the node terminal apparatus is capable of communicating with the display apparatus, and

wherein the node terminal apparatus is attachable to and detachable from a surface of the peripheral device.

12. The method as claimed in claim 11, further comprising:

performing pairing with the node terminal apparatus according to a pairing request received from the node terminal apparatus by the display apparatus; and

in response to the sensing data of the peripheral device being received from the paired node terminal apparatus.

13. The method as claimed in claim 12, wherein:

the UI is a peripheral device UI comprising a UI element corresponding to at least one peripheral device; and

the displaying comprises adding a UI element corresponding to a peripheral device that is registered in the display apparatus to the peripheral device UI and displaying the peripheral device UI.

14. The method as claimed in claim 13, further comprising:

determining a position of the UI element corresponding to the peripheral device registered in the peripheral device UI according to a user command; and

determining a relative distance of the UI element of the peripheral device registered in the peripheral device UI based on a signal intensity of the node terminal apparatus attached to the registered peripheral device,

wherein the displaying comprises adding a UI element corresponding to the registered peripheral device to the peripheral device UI and displaying the peripheral device UI based on a position and the determined relative distance of the UI element.

15. The method as claimed in claim 13, wherein the displaying comprises displaying the operating state of the peripheral device on a UI element corresponding to a peripheral device with the node terminal apparatus attached to it.

16. The method as claimed in claim 15, wherein the displaying comprises displaying, with an animation effect, the operating state of the peripheral device on the UI element corresponding to the peripheral device with the node terminal apparatus attached to it, or displaying the operating state as a message popup near the UI element corresponding to the peripheral device with the node terminal apparatus attached to it.

17. The method as claimed in claim 11, wherein:

the UI is a message UI for guiding a user about the operating state of the peripheral device with the node terminal apparatus attached to it; and

the displaying comprises, in response to the sensing data being received from the node terminal apparatus during display of image content, displaying, on the image content, the message UI for guiding the operating state determined based on the received sensing data.

18. The method as claimed in claim 17, wherein the message UI is displayed as a popup in a region for displaying a UI element corresponding to the peripheral device with the node terminal apparatus attached to it.

19. The method as claimed in claim 13, further comprising determining a position of a user terminal apparatus that communicates with the display apparatus, changing a peripheral device UI comprising a UI element corresponding to the at least one peripheral device to correspond to a screen of the user terminal apparatus based on the determined position of the user terminal apparatus and a direction in which the user terminal apparatus is moving, and transmitting the peripheral device UI to the user terminal apparatus, according to a user command, by the display apparatus.

20. The method as claimed in claim 11, further comprising:

transmitting control information corresponding to the operating state of the peripheral device determined based on the sensing data to the node terminal apparatus by the display apparatus; and

controlling an operation of the peripheral device with the node terminal apparatus attached to it based on the control information received from the display apparatus by the node terminal apparatus.

21. A display apparatus comprising:

a communication interface configured to communicate with a node terminal apparatus that is attachable to and detachable from a surface of a peripheral device;

a display configured to display a user interface (UI); and

a processor configured to;

control the communication interface to receive sensing data, based on a sensed vibration feedback or a sensed audio feedback, from the node terminal apparatus;

in response to the sensing data being received from the node terminal apparatus, acquire device information related to the received sensing data from pre-stored device information, the device information includes information of a plurality of feedbacks generated according to an operation of the peripheral device,

compare the vibration feedback or the audio feedback, and the plurality of feedbacks included in the device information,

identify an operating state of the peripheral device based on a result of the comparison,

display a user interface (UI) indicating the operating state of the peripheral device;

transmit, if the device information related to the sensing data is not stored, the sensing data to an external server, and

store, in response to the device information related to the sensing data being received from the external server, the received device information,

wherein the peripheral device is incapable of communicating with the display apparatus and the node terminal apparatus is capable of communicating with the display apparatus.

22. The display apparatus of claim 21, wherein the UI comprises a plurality of UI elements displayed according to a relative position between the display apparatus and the peripheral device with the node terminal apparatus attached to it.