Virtualizing sensors

• US 10,108,462 B2
• Filed: 08/12/2016
• Issued: 10/23/2018
• Est. Priority Date: 02/12/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Choe, Sang, Karivaradaswamy, Sathyanarayanan, Wilson, Mei, Shen, Fabin, Li, Yin
• Primary Examiner(s): Lee, Adam
• Application Number:
  US15/235,748
• Publication Number:
  US 20170235614A1
• Time in Patent Office: 802 Days
• Field of Search: None
• CPC Class Codes: G06F 12/10 Address translation
• CPC Class Codes: G06F 2212/65 Details of virtual memory and virtual address translation
• CPC Class Codes: G06F 9/5016 the resource being the memory
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06F 9/5061 Partitioning or combining of resources
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

Technology related to virtualizing sensors is disclosed. In one example of the disclosed technology, a method can be used to allocate resources of a computing system. The method can include enumerating hardware sensors and software modules that are capable of interacting with one another. A topology can be negotiated that is compatible with capabilities of the enumerated hardware sensors and software modules. A first request can be received from a first requestor to configure at least one of the enumerated hardware sensors and software modules. The at least one of the enumerated hardware sensors and software modules can be configured in response to the received first request.

Claims

1. One or more computer-readable storage media storing computer-executable instructions, which when executed by a computer, cause the computer to perform a sensor virtualization method, the method comprising:

generating a plurality of topologies in a data structure stored on the one or more computer-readable storage media, the plurality of topologies including different ways to configure and connect hardware sensors, software modules, or both hardware sensors and software modules that are installed on the computer, a respective topology representing a particular configuration and connection of the hardware sensors, the software modules, or both the hardware sensors and the software modules, wherein at least one of the hardware sensors or software modules is shareable among different processes executing on the computer;

receiving a first request from a first process executing on the computer, the first request requesting to configure and connect the hardware sensors, the software modules, or both the hardware sensors and the software modules according to a first topology of the generated plurality of topologies;

granting the first request;

in response to granting the first request, configuring and connecting the hardware sensors, the software modules, or both the hardware sensors and the software modules according to the first topology;

updating the data structure in response to granting the first request to represent which topologies of the plurality of topologies are to remain available to be used by subsequent requests after the first request is granted; and

mapping a first set of virtual memory addresses in an a virtual memory address space of the first process to a first set of physical memory addresses of the computer in response to receiving the first request to use the first topology.

2. The one or more computer-readable storage media of claim 1, wherein the method further comprises:

probing and locking physical memory addressed by the first set of physical memory addresses in response to receiving the first request to configure and connect the hardware sensors, the software modules, or both the hardware sensors and the software modules according to the first topology.

3. The one or more computer-readable storage media of claim 1, wherein the first set of physical memory addresses include memory addresses of embedded memory of a given hardware sensor installed on the computer.

4. The one or more computer-readable storage media of claim 1, wherein the first set of physical memory addresses include memory addresses of graphics memory in communication with a graphics processing unit installed on the computer.

5. The one or more computer-readable storage media of claim 1, wherein the first process is a producer process, and executing the first process comprises using the hardware sensors, the software modules, or both the hardware sensors and the software modules according to the first topology to generate data to store in physical memory addressed by the first set of physical memory addresses.

6. The one or more computer-readable storage media of claim 5, wherein the first set of physical memory addresses is mapped to multiple sets of virtual memory addresses in a virtual memory address space of the producer process.

7. The one or more computer-readable storage media of claim 1, wherein the method further comprises:

receiving a second request from a second process executing on the computer, the second request requesting to use a second topology of the generated plurality of topologies, the second topology being incompatible with the first topology;

unmapping the first set of virtual memory addresses in the virtual memory address space of the first process in response to receiving the second request; and

mapping a second set of virtual memory addresses in a virtual memory address space of the second process to a second set of physical memory addresses of the computer in response to receiving the second request.

8. The one or more computer-readable storage media of claim 7, wherein the first request is a sharing mode request and the second request is a controlling mode request, wherein the controlling mode gives the requesting process exclusive control of the hardware sensors, the software modules, or both the hardware sensors and the software modules of the first topology, and the sharing mode allows other processes to take control of the hardware sensors, the software modules, or both the hardware sensors and the software modules of the first topology.

9. The one or more computer-readable storage media of claim 7, wherein the method further comprises:

in response to the first request, changing a power state of a hardware sensor installed on the computer.

10. A method comprising:

generating a data structure comprising a plurality of topologies, the plurality of topologies including different ways to configure and connect hardware sensors and software modules that are installed on a computer, a respective topology representing a particular configuration and connection of the hardware sensors and the software modules, wherein at least one of the hardware sensors or software modules is shareable among different processes executing on the computer;

receiving a first request from a first process executing on the computer, the first request requesting to configure and connect the hardware sensors and the software modules according to a first topology of the generated plurality of topologies;

granting the first request;

in response to granting the first request, configuring and connecting the hardware sensors and the software modules according to the first topology; and

updating the data structure in response to granting the first request to represent which topologies of the plurality of topologies are to remain available to be used by subsequent requests after the first request is granted.

11. The method of claim 10, wherein the method further comprises:

mapping a first set of virtual memory addresses in a virtual memory address space of the first process to a first set of physical memory addresses of the computer in response to receiving the first request to use the first topology.

12. The method of claim 11, wherein the method further comprises:

probing and locking physical memory addressed by the first set of physical memory addresses in response to receiving the first request to configure and connect the hardware sensors and the software modules according to the first topology.

13. The method of claim 11, wherein the first set of physical memory addresses include memory addresses of embedded memory of a given hardware sensor installed on the computer.

14. The method of claim 11, wherein the first set of physical memory addresses include memory addresses of graphics memory in communication with a graphics processing unit installed on the computer.

15. The method of claim 11, wherein executing the first process comprises using the hardware sensors and the software modules according to the first topology to generate data to store in physical memory addressed by the first set of physical memory addresses.

16. The method of claim 11, wherein the method further comprises:

receiving a second request from a second process executing on the computer, the second request requesting to use a second topology of the generated plurality of topologies, the second topology being incompatible with the first topology;

unmapping the first set of virtual memory addresses in the virtual memory address space of the first process in response to receiving the second request; and

mapping a second set of virtual memory addresses in a virtual memory address space of the second process to a second set of physical memory addresses of the computer in response to receiving the second request.

17. The method of claim 16, wherein the first request is a sharing mode request and the second request is a controlling mode request, wherein the controlling mode gives the requesting process exclusive control of the hardware sensors and the software modules of the first topology, and the sharing mode allows other processes to take control of the hardware sensors and the software modules of the first topology.

18. An apparatus comprising:

a plurality of hardware sensors;

a processor in communication with the plurality of hardware sensors; and

a computer-readable storage media in communication with the processor and the plurality of hardware sensors, the computer-readable storage media storing;

a data buffer;

a sensor group data structure; and

computer-executable instructions, which when executed by the processor, cause the processor to perform a method comprising;

storing a plurality of topologies in the sensor group data structure, the plurality of topologies including different ways to configure and connect the plurality of hardware sensors to software modules that are executable by the processor, a respective topology representing a particular configuration and connection of the hardware sensors and the software modules, wherein at least one of the hardware sensors is shareable among different processes executing on the processor;

receiving a request, from a process executing on the processor, to configure and connect a particular hardware sensor of the plurality of hardware sensors to a particular software module of the software modules according to a particular topology of the stored plurality of topologies;

granting the request and configuring and connecting the particular hardware sensor to the particular software module according to the particular topology;

updating the sensor group data structure in response to granting the request to represent which topologies of the plurality of topologies are to remain available to be used by subsequent requests after the request is granted; and

mapping a set of virtual memory addresses in a virtual memory address space of the process executing on the processor to a first set of physical memory addresses mapped to the data buffer in response to receiving the request to use the particular topology.

19. The apparatus of claim 18, wherein the request is a controlling mode request that gives the requesting process exclusive control of the hardware sensor and the software module in response to the request being granted.

20. The apparatus of claim 19, wherein topologies incompatible with the particular topology are marked as unavailable within the plurality of topologies in response to the request being granted.