OBJECT DETECTION AND TRACKING FOR PROVIDING A VIRTUAL DEVICE EXPERIENCE
First Claim
1. A method of operating a motion-capture system, the method including:
- monitoring at least three vibration sensors coupled to a motion-capture system; and
in response to detection of vibrations generated by contact of an object with a surface of a solid medium, tracking a position of the object by;
detecting a first vibration through a first medium by a first sensor;
detecting a second vibration through a second medium by at least a second and a third sensor;
measuring a time difference of arrival (TDOA) of the second vibration at the at least second and third sensors with respect to a TDOA of the first vibration at the first sensor and mapping surface locations that satisfy the TDOA;
calculating a distance from the object to the second and third sensor based on the respective TDOAs; and
determining location information for the object relative to the sensors based on the mapped TDOA surface locations.
11 Assignments
0 Petitions
Accused Products
Abstract
The technology disclosed can provide capabilities such as using vibrational sensors and/or other types of sensors coupled to a motion-capture system to monitor contact with a surface that a user can touch. A virtual device can be projected onto at least a portion of the surface. Location information of a user contact with the surface is determined based at least in part upon vibrations produced by the contact. Control information is communicated to a system based in part on a combination of the location on the surface portion of the virtual device and the detected location information of the user contact. The virtual device experience can be augmented in some implementations by the addition of haptic, audio and/or visual projectors.
-
Citations
20 Claims
-
1. A method of operating a motion-capture system, the method including:
-
monitoring at least three vibration sensors coupled to a motion-capture system; and in response to detection of vibrations generated by contact of an object with a surface of a solid medium, tracking a position of the object by; detecting a first vibration through a first medium by a first sensor; detecting a second vibration through a second medium by at least a second and a third sensor; measuring a time difference of arrival (TDOA) of the second vibration at the at least second and third sensors with respect to a TDOA of the first vibration at the first sensor and mapping surface locations that satisfy the TDOA; calculating a distance from the object to the second and third sensor based on the respective TDOAs; and determining location information for the object relative to the sensors based on the mapped TDOA surface locations. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method of creating a virtual device experience in a three-dimensional (3D) sensory environment, the method including:
-
monitoring at least two contact microphones coupled to an optical motion-capture system in a three-dimensional (3D) sensory environment, wherein the contact microphones are in contact with a surface that a user touches; projecting a virtual device onto at least a portion of a surface; and in response to detection of audio signals generated by contact of an object with the surface that the user touches, tracking a position of the object in with contact with the virtual device by; measuring a time difference of arrival (TDOA) of the audio signals at the contact microphones and mapping surface locations that satisfy the TDOA; analyzing at least one image, captured by a camera of the optical motion-capture system, of the object in contact with the virtual device; using the image analysis to select among the mapped TDOA surface locations as location on the surface portion of the virtual device; detecting location information of the user contact with the surface based at least in part upon audio signals produced by the contact; and communicating control information to a system based in part on a combination of the location on the surface portion of the virtual device and the detected location information of the user contact. - View Dependent Claims (11, 12, 13, 14, 15)
-
-
16. An acoustical motion-capture system, the system including:
-
a plurality of vibrational sensors in contact with a surface that a user touches; and a control module for tracking a position of an object responsive to detection of vibrations generated by contact of the object with the surface that the user touches, by; measuring a time difference of arrival (TDOA) of the vibrations at the vibrational sensors and mapping surface locations that satisfy the TDOA; analyzing at least one contact, captured by the sensors, of the object in contact with the surface; and using the analysis to select among mapped TDOA surface locations as a surface location of the contact. - View Dependent Claims (17, 18, 19, 20)
-
Specification