Sensor Fusion Interface for Multiple Sensor Input
First Claim
1. In a computing environment, a method performed at least in part on at least one processor, comprising, processing requests received via a sensor fusion interface to enable interaction between one or more entities and an computerized device component, including, accessing a shared library that is coupled to a plurality of sensor modules corresponding to at least two input modalities for the one or more entities, the shared library comprising a schematized version of multiple sensor input data to represent a cross-sensor synthesis, transforming the schematized version of the multiple sensor input data into entity state data, and providing the computerized device component with access to the entity state data.
2 Assignments
0 Petitions
Accused Products
Abstract
The subject disclosure is directed towards a sensor fusion interface that enables interaction between one or more entities of a physical environment and a computerized device component. A plurality of sensor modules generate multiple sensor input data associated with one or more entities in an environment and store such data in a shared library in accordance with a uniform and common schema. The multiple sensor input data is refined until a certain level of accuracy is achieved. Using the sensor fusion interface, entity state data is extracted from the shared library and exposed to the computerized device component.
-
Citations
20 Claims
- 1. In a computing environment, a method performed at least in part on at least one processor, comprising, processing requests received via a sensor fusion interface to enable interaction between one or more entities and an computerized device component, including, accessing a shared library that is coupled to a plurality of sensor modules corresponding to at least two input modalities for the one or more entities, the shared library comprising a schematized version of multiple sensor input data to represent a cross-sensor synthesis, transforming the schematized version of the multiple sensor input data into entity state data, and providing the computerized device component with access to the entity state data.
-
12. In a computing environment, a system, comprising, at least one processor, a memory communicatively coupled to the at least one processor and including components comprising:
an interaction mechanism configured to provide a sensor fusion interface to an computerized device component, wherein, for each entity in an environment, the sensor fusion interface is configured to expose a profile comprising entity state data to the computerized device component, and to instruct a common knowledge data component to update the profile in response to entity activity, wherein the common knowledge data component is configured to integrate multi-modal input data from a plurality of sensor modules according to a uniform schema, to refine the multi-modal input data until a level of accuracy is achieved, and to identify the entity activity based on the refined multi-modal input data. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
19. One or more computer-readable storage media having computer-executable instructions, which when executed perform steps, comprising:
-
processing a request for entity state data associated with the an entity in a physical environment; selecting at least two input modes among a plurality of input modes for producing the entity state data based on configuration data from a computerized device component, including processing a type system to format sensor input data corresponding to the plurality of input modes; fusing the sensor input data to generate the entity state data; and communicating the entity state data to the computerized device component. - View Dependent Claims (20)
-
Specification