Semantic mappings from human readable messages to programmatic interfaces

• US 9,609,062 B2
• Filed: 06/25/2014
• Issued: 03/28/2017
• Est. Priority Date: 06/26/2013
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Hershberg, Joshua Dickenson
• Primary Examiner(s): Alam, Uzma
• Application Number:
  US14/315,144
• Publication Number:
  US 20150006696A1
• Time in Patent Office: 1,007 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

A mechanism for semantically mapping Internet of Things (IoT) devices maps human-readable information from an Internet of Things (IoT) device to a programmatic interface to enable a user to control the IoT device. The human-readable information includes at least one of text, video, audio, haptics, and images.

Claims

1. A method of mapping data from an Internet of Things (IoT) device to a programmatic interface, the method comprising:

observing, at a computing device, a human-readable indication of an identity of the IoT device;

determining a property of the IoT device to be controlled;

transmitting, from the computing device to a server, a request for a semantic tag associated with the property to be controlled, wherein the request includes the property of the IoT device and the identity of the IoT device;

receiving from the server, at the computing device, the semantic tag associated with the property; and

transmitting, from the computing device to the IoT device, a command to set the property of the IoT device, wherein the command includes the semantic tag.

2. The method of claim 1, wherein observing the human-readable indication of the presence of the IoT device includes observing a presence broadcast by the IoT device, wherein the presence broadcast is human-readable.

3. The method of claim 1, wherein assigning the agreed-upon semantic tag to the associated information includes assigning the agreed-upon semantic tag to a remotely exposed property of the IoT device.

4. The method of claim 1, further comprising, in response to observing the human-readable indication of the presence of the IoT device, mapping a user interface for the IoT device to the programmatic interface.

5. The method of claim 1, wherein observing the human-readable indication of the presence of the IoT device includes observing the human-readable indication of the presence of the IoT device at a user interface.

6. The method of claim 5, wherein a property associated with the IoT device is a user interface element.

7. The method of claim 6, wherein the user interface element associated with the IoT device is at least one of a switch and a radio button.

8. The method of claim 1, wherein observing the human-readable indication of the presence of the IoT device includes observing the human-readable indication of the presence of the IoT device at an application layer interface.

9. The method of claim 1, wherein observing the human-readable indication of the presence of the IoT device includes observing the human-readable indication of the presence of the IoT device at a presentation layer interface.

10. The method of claim 1, wherein the human-readable indication includes at least one of text, video, audio, haptics, and images.

11. An apparatus for mapping data from an Internet of Things (IoT) device to a programmatic interface, the apparatus comprising a transceiver, a processor, a memory, and/or an interface configured to:

observe, at the apparatus, a human-readable indication of an identity of the IoT device;

determine a property of the IoT device to be controlled;

transmit, from the apparatus to a server, a request for a semantic tag associated with the property to be controlled, wherein the request includes the property of the IoT device and the identity of the IoT device;

receive from the server, at the apparatus, the semantic tag associated with the property; and

transmit, from the apparatus to the IoT device, a command to set the property of the IoT device, wherein the command includes the semantic tag.

12. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are configured to observe the human-readable indication of the presence of the IoT device by observing a presence broadcast by the IoT device, wherein the presence broadcast is human-readable.

13. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are configured to assign the agreed-upon semantic tag to the associated information by assigning the agreed-upon semantic tag to a remotely exposed property of the IoT device.

14. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are further configured map a user interface for the IoT device to the programmatic interface.

15. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are configured to observe the human-readable indication of the presence of the IoT device by observing the human-readable indication of the presence of the IoT device at a user interface.

16. The apparatus of claim 15, wherein a property associated with the IoT device is a user interface element.

17. The apparatus of claim 16, wherein the user interface element associated with the IoT device is at least one of a switch and a radio button.

18. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are configured to observe the human-readable indication of the presence of the IoT device by observing the human-readable indication of the presence of the IoT device at an application layer interface.

19. The apparatus of claim 11, wherein the transceiver, the processor, the memory, and/or the interface are configured to observe the human-readable indication of the presence of the IoT device by observing the human-readable indication of the presence of the IoT device at a presentation layer interface.

20. The apparatus of claim 11, wherein the human-readable indication includes at least one of text, video, audio, haptics, and images.

21. A non-transitory computer-readable storage medium including data that, when accessed by a machine, cause the machine to perform operations comprising:

observing, at a computing device, a human-readable indication of an identity of the IoT device;

determining a property of the IoT device to be controlled;

transmitting, from the computing device to a server, a request for a semantic tag associated with the property to be controlled, wherein the request includes the property of the IoT device and the identity of the IoT device;

receiving from the server, at the computing device, the semantic tag associated with the property; and

transmitting, from the computing device to the IoT device, a command to set the property of the IoT device, wherein the command includes the semantic tag.

22. The non-transitory computer-readable storage medium of claim 21, further comprising data that, when accessed by the machine, cause the machine to perform operations comprising observing a presence broadcast by the IoT device, wherein the presence broadcast is human-readable.

23. The non-transitory computer-readable storage medium of claim 21, further comprising data that, when accessed by the machine, cause the machine to perform operations comprising assigning the agreed-upon semantic tag to a remotely exposed property of the IoT device.

24. The non-transitory computer-readable storage medium of claim 21, further comprising data that, when accessed by the machine, cause the machine to perform operations comprising, in response to observing the human-readable indication of the presence of the IoT device, mapping a user interface for the IoT device to a programmatic interface.

25. The non-transitory computer-readable storage medium of claim 21, further comprising data that, when accessed by the machine, cause the machine to perform operations comprising observing the human-readable indication of the presence of the IoT device includes observing the human-readable indication of the presence of the IoT device at at least one of a user interface, application layer interface, or a presentation layer interface.

26. The non-transitory computer-readable storage medium of claim 21, wherein the human-readable indication includes at least one of text, video, audio, haptics, and images.

27. An apparatus for mapping data from an Internet of Things (IoT) device to a programmatic interface, the apparatus comprising:

means for observing, at a computing device, a human-readable indication of an identity of the IoT device;

means for determining a property of the IoT device to be controlled;

means for transmitting, from the apparatus to a server, a request for a semantic tag associated with the property to be controlled, wherein the request includes the property of the IoT device and the identity of the IoT device;

means for receiving from the server, at the apparatus, the semantic tag associated with the property; and

means for transmitting, from the computing device to the IoT device, a command to set the property of the IoT device, wherein the command includes the semantic tag.

28. The apparatus of claim 27, wherein the means for observing the human-readable indication of the presence of the IoT device includes a supervisor device.

29. The apparatus of claim 27, wherein the means for assigning the agreed-upon semantic tag to the associated information includes a semantic mapper.

30. The apparatus of claim 27, further comprising means for observing the human-readable indication of the presence of the IoT device at at least one of a user interface, application layer interface, or a presentation layer interface.