Predictive information for free space gesture control and communication
First Claim
Patent Images
1. A method of accurately capturing gestural motion of a control object in a three-dimensional (3D) sensory space, the method including:
- determining observation information characterizing gestural motion of a control object in a three-dimensional (3D) sensory space from at least one image captured at time t0;
constructing a 3D solid model to represent the control object by fitting one or more 3D solid subcomponents to a construct of the control object defined by the observation information based on the image captured at time t0;
responsive to modifications in the observation information based on another image captured at time t1, wherein the control object moved between t0 and t1, improving conformance of the 3D solid model to the modifications in the observation information by;
interpolating multiple intermediate 3D solid model poses across time, which are interpolated well with other interpolations based on expected continuity in motion and deformation of the control object, the interpolated multiple 3D solid model poses including at least one of joint angle, pitch and yaw; and
using the 3D solid model as adjusted to control a machine.
11 Assignments
0 Petitions
Accused Products
Abstract
Free space machine interface and control can be facilitated by predictive entities useful in interpreting a control object'"'"'s position and/or motion (including objects having one or more articulating members, i.e., humans and/or animals and/or machines). Predictive entities can be driven using motion information captured using image information or the equivalents. Predictive information can be improved applying techniques for correlating with information from observations.
383 Citations
28 Claims
-
1. A method of accurately capturing gestural motion of a control object in a three-dimensional (3D) sensory space, the method including:
-
determining observation information characterizing gestural motion of a control object in a three-dimensional (3D) sensory space from at least one image captured at time t0; constructing a 3D solid model to represent the control object by fitting one or more 3D solid subcomponents to a construct of the control object defined by the observation information based on the image captured at time t0; responsive to modifications in the observation information based on another image captured at time t1, wherein the control object moved between t0 and t1, improving conformance of the 3D solid model to the modifications in the observation information by; interpolating multiple intermediate 3D solid model poses across time, which are interpolated well with other interpolations based on expected continuity in motion and deformation of the control object, the interpolated multiple 3D solid model poses including at least one of joint angle, pitch and yaw; and using the 3D solid model as adjusted to control a machine. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A non-transitory computer readable storage medium impressed with computer program instructions to accurately capture gestural motion of a control object in a three-dimensional (3D) sensory space, which computer program instructions, when executed on a processor, implement a method including:
-
determining observation information characterizing gestural motion of a control object in a three-dimensional (3D) sensory space from at least one image captured at time t0; constructing a 3D solid model to represent the control object by fitting one or more 3D solid subcomponents to a construct of the control object defined by the observation information based on the image captured at time t0; responsive to modifications in the observation information based on another image captured at time t1, wherein the control object moved between t0 and t1, improving conformance of the 3D solid model to the modifications in the observation information by; interpolating multiple intermediate 3D solid model poses across time, which are interpolated well with other interpolations based on expected continuity in motion and deformation of the control object, the interpolated multiple 3D solid model poses including at least one of joint angle, pitch and yaw; and using the 3D solid model as adjusted to control a machine.
-
-
28. A system to accurately capture gestural motion of a control object in a three-dimensional (3D) sensory space, comprising:
a processor and a computer readable storage medium storing computer instructions configured to cause the processor to; determine observation information characterizing gestural motion of a control object in a three-dimensional (3D) sensory space from at least one image captured at time t0; construct a 3D solid model to represent the control object by fitting one or more 3D solid subcomponents to a construct of the control object defined by the observation information based on the image captured at time t0; responsive to modifications in the observation information based on another image captured at time t1, wherein the control object moved between t0 and t1, improve conformance of the 3D solid model constructed to the modifications in the observation information by; interpolating multiple intermediate 3D solid model poses across time, which are interpolated well with other interpolations based on expected continuity in motion and deformation of the control object, the interpolated multiple 3D solid model poses including at least one of joint angle, pitch and yaw; and using the 3D solid model as adjusted to control a machine.
Specification