FOG ENABLED TELEMETRY EMBEDDED IN REAL TIME MULTIMEDIA APPLICATIONS

• US 20180007115A1
• Filed: 07/01/2016
• Published: 01/04/2018
• Est. Priority Date: 07/01/2016
• Status: Abandoned Application

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Nedeltchev, Plamen, Chivukula, Srinivas, Nethi, Ramesh, Vishwanath, Harish Kolar
• Application Number:
  US15/201,238
• Publication Number:
  US 20180007115A1
• Time in Patent Office: Days
• CPC Class Codes: H04L 65/1026 at the edge
• CPC Class Codes: H04L 65/4015 where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services

Abstract

Disclosed are systems, methods, and computer-readable storage media for fog enabled telemetry in real time multimedia applications. An edge computing device can receive first sensor data from at least a first sensor and a collaboration data stream from a first client device. The collaboration data stream can including at least one of chat, audio or video data. The edge computing device can convert the first sensor data into a collaboration data stream format, yielding a first converted sensor data, and then embed the first converted sensor data into the collaboration data stream, yielding an embedded collaboration data stream. The edge computing device can then transmit the embedded collaboration data stream to an intended recipient.

Claims

1. A method comprising:

receiving, by an edge computing device, first sensor data from at least a first sensor and a collaboration data stream from a first client device, the collaboration data stream including at least one of chat, audio or video data;

converting, by the edge computing device, the first sensor data into a collaboration data stream format, yielding a first converted sensor data;

embedding the first converted sensor data into the collaboration data stream, yielding an embedded collaboration data stream; and

transmitting the embedded collaboration data stream to an intended recipient.

2. The method of claim 1, wherein the edge computing device utilizes a first pluggable Internet of Things (IoT) protocol to communicate with the first sensor to receive the sensor data.

3. The method of claim 2, wherein the first pluggable IoT protocol is one of Modbus, Distributed Network Protocol (DNP3), Constrained Application Protocol (CoAP) or Message Queue Telemetry Transport (MQTT).

4. The method of claim 1, wherein converting the sensor data in a collaboration data stream format comprises:

normalizing the sensor data to a standard object model of a collaboration protocol.

5. The method of claim 4, wherein the collaboration protocol is one of Extensible Messaging and Presence Protocol (XMPP) and Data Distribution Service (DDS).

6. The method of claim 1, further comprising:

receiving second sensor data from a second sensor, the edge computing device utilizing a second pluggable IoT protocol to communicate with the second sensor;

converting the second sensor data into the collaboration data stream format, yielding second converted sensor data; and

embedding the second converted sensor data into the collaboration data stream to yield the embedded collaboration data stream.

7. The method of claim 1, further comprising:

associating the first sensor data with the first client device.

8. An edge computing device comprising:

one or more computer processors; and

a memory storing instructions that, when executed by the one or more computer processors, cause the edge computing device to;

receive first sensor data from at least a first sensor and a collaboration data stream from a first client device, the collaboration data stream including at least one of chat, audio or video data;

convert the first sensor data into a collaboration data stream format, yielding a first converted sensor data;

embed the first converted sensor data into the collaboration data stream, yielding an embedded collaboration data stream; and

transmit the embedded collaboration data stream to an intended recipient.

9. The edge computing device of claim 8, wherein the edge computing device utilizes a first pluggable Internet of Things (IoT) protocol to communicate with the first sensor to receive the sensor data.

10. The edge computing device of claim 9, wherein the first pluggable IoT protocol is one of Modbus, Distributed Network Protocol (DNP3), Constrained Application Protocol (CoAP) or Message Queue Telemetry Transport (MQTT).

11. The edge computing device of claim 8, wherein converting the sensor data in a collaboration data stream format comprises:

normalizing the sensor data to a standard object model of a collaboration protocol.

12. The edge computing device of claim 11, wherein the collaboration protocol is one of Extensible Messaging and Presence Protocol (XMPP) and Data Distribution Service (DDS).

13. The edge computing device of claim 8, wherein the instructions further cause the edge computing device to:

receive second sensor data from a second sensor, the edge computing device utilizing a second pluggable IoT protocol to communicate with the second sensor;

convert the second sensor data into the collaboration data stream format, yielding second converted sensor data; and

embed the second converted sensor data into the collaboration data stream to yield the embedded collaboration data stream.

14. The edge computing device of claim 8, wherein the second pluggable IoT protocol is different than the first pluggable IoT protocol.

15. A non-transitory computer-readable medium storing instructions that, when executed by an edge computing device, cause the edge computing device to:

receive first sensor data from at least a first sensor and a collaboration data stream from a first client device, the collaboration data stream including at least one of chat, audio or video data;

convert the first sensor data into a collaboration data stream format, yielding a first converted sensor data;

embed the first converted sensor data into the collaboration data stream, yielding an embedded collaboration data stream; and

transmit the embedded collaboration data stream to an intended recipient.

16. The non-transitory computer-readable medium of claim 15, wherein the edge computing device utilizes a first pluggable Internet of Things (IoT) protocol to communicate with the first sensor to receive the sensor data.

17. The non-transitory computer-readable medium of claim 16, wherein the first pluggable IoT protocol is one of Modbus, Distributed Network Protocol (DNP3), Constrained Application Protocol (CoAP) or Message Queue Telemetry Transport (MQTT).

18. The non-transitory computer-readable medium of claim 15, wherein converting the sensor data in a collaboration data stream format comprises:

normalizing the sensor data to a standard object model of a collaboration protocol.

19. The non-transitory computer-readable medium of claim 18, wherein the collaboration protocol is one of Extensible Messaging and Presence Protocol (XMPP) and Data Distribution Service (DDS).

20. The non-transitory computer-readable medium of claim 15, wherein the instructions further cause the edge computing to:

receive second sensor data from a second sensor, the edge computing device utilizing a second pluggable IoT protocol to communicate with the second sensor, wherein the second pluggable IoT protocol is different than the first pluggable IoT protocol;

convert the second sensor data into the collaboration data stream format, yielding second converted sensor data; and

embed the second converted sensor data into the collaboration data stream to yield the embedded collaboration data stream.