Detecting, representing, and interpreting three-space input: gestural continuum subsuming freespace, proximal, and surface-contact modes
First Claim
1. A method comprising:
- collating input data from a plurality of sources, wherein the input data is semantically uncorrelated three-space data of an instantaneous spatial and geometric state of an object in a frame of reference of the object;
conforming the input data into a stream of spatiotemporal data, wherein the spatiotemporal data of the stream is uniformly represented;
generating gestural events from the spatiotemporal data using a plurality of gesture descriptions;
representing the gestural events in a protoevent comprising a data format that is application-neutral and fully articulated; and
distributing the gestural events and providing access to the gestural events via corresponding protoevents by at least one event consumer in a spatial-semantic frame of reference of the at least one event consumer.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for detecting, representing, and interpreting three-space input are described. Embodiments of the system, in the context of an SOE, process low-level data from a plurality of sources of spatial tracking data and analyze these semantically uncorrelated spatiotemporal data and generate high-level gestural events according to dynamically configurable implicit and explicit gesture descriptions. The events produced are suitable for consumption by interactive systems, and the embodiments provide one or more mechanisms for controlling and effecting event distribution to these consumers. The embodiments further provide to the consumers of its events a facility for transforming gestural events among arbitrary spatial and semantic frames of reference.
-
Citations
60 Claims
-
1. A method comprising:
-
collating input data from a plurality of sources, wherein the input data is semantically uncorrelated three-space data of an instantaneous spatial and geometric state of an object in a frame of reference of the object; conforming the input data into a stream of spatiotemporal data, wherein the spatiotemporal data of the stream is uniformly represented; generating gestural events from the spatiotemporal data using a plurality of gesture descriptions; representing the gestural events in a protoevent comprising a data format that is application-neutral and fully articulated; and distributing the gestural events and providing access to the gestural events via corresponding protoevents by at least one event consumer in a spatial-semantic frame of reference of the at least one event consumer. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59)
-
-
60. A method comprising:
-
collating input data from a plurality of sources, wherein the input data is semantically uncorrelated three-space data corresponding to an object, wherein the plurality of sources comprise disparate sources; rendering a plurality of spatial events of the object from the input data, wherein the plurality of spatial events comprise a conformed-coordinate representation relative to a global room space; generating aggregates of the spatial events from the spatial events, wherein the aggregates are logical aggregates including literal geometric and semantic characteristics of the object; detecting and disambiguating gestures from the aggregates of the spatial events; generating data bundles representing the gestures, wherein the data bundles are neutrally descriptive; and distributing the data bundles for consumption by a plurality of disparate applications.
-
Specification