Magnetic tracking of glove fingertips

• US 9,652,038 B2
• Filed: 04/15/2015
• Issued: 05/16/2017
• Est. Priority Date: 02/20/2015
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Osman, Steven
• Primary Examiner(s): Amadiz, Rodney
• Application Number:
  US14/687,527
• Publication Number:
  US 20160246369A1
• Time in Patent Office: 762 Days
• CPC Class Codes: A63F 13/212 using sensors worn by the player, e.g. for measuring heart beat or leg activity
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A glove interface object is provided, comprising: a plurality of electromagnets positioned at a wrist area of the glove interface object; a plurality of magnetic sensors respectively positioned at fingertip areas of the glove interface object, wherein each magnetic sensor is configured to generate data indicating distances to each of the electromagnets when each of the electromagnets is activated; a controller configured to control activation of the electromagnets and reading of the magnetic sensors in a time-division multiplexed arrangement, wherein each of the magnetic sensors is read during activation of a single magnetic sensor; a transmitter configured to transmit data derived from the reading of the magnetic sensors to a computing device for processing to generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display.

Claims

1. A glove interface object, comprising:

a plurality of electromagnets positioned at a wrist area of the glove interface object;

a plurality of magnetic sensors respectively positioned at fingertip areas of the glove interface object, wherein each magnetic sensor is configured to generate data indicating distances to each of the electromagnets when each of the electromagnets is activated;

a controller configured to control activation of the electromagnets and reading of the magnetic sensors in a time-division multiplexed arrangement, wherein each of the magnetic sensors is read during activation of a single electromagnet;

a transmitter configured to transmit data derived from the reading of the magnetic sensors to a computing device for processing to generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display.

2. The glove interface object of claim 1, wherein the time-division multiplexed arrangement is defined by a repeated pattern of activation of the electromagnets that provides for activation of each of the electromagnets during separate time periods, and reading of each of the magnetic sensors during the time period of activation of a given one of the electromagnets.

3. The glove interface object of claim 1, wherein the plurality of electromagnets defines at least three electromagnets that are positioned on the wrist area in a non-collinear arrangement.

4. The glove interface object of claim 1, wherein the plurality of magnetic sensors defines five magnetic sensors respectively positioned at five fingertip areas of the glove interface object.

5. The glove interface object of claim 1, wherein each of the plurality of magnetic sensors is configured to generate a voltage in response to a magnetic field generated by one of the electromagnets.

6. The glove interface object of claim 1, further comprising:

an illuminated trackable object that is configured to be tracked based on analysis of captured images of the glove interface object in an interactive environment, the tracking of the illuminated trackable object defining a location of the virtual hand in a virtual environment.

7. The glove interface object of claim 1, further comprising:

at least one inertial sensor selected from the group consisting of an accelerometer, a gyroscope, and a magnetometer.

8. A method, comprising:

serially activating and deactivating a plurality of electromagnets that are positioned at a wrist portion of a glove interface object, so as to define periods of activation for each of the electromagnets that are substantially non-overlapping;

during the activation of each one of the electromagnets, using a plurality of magnetic sensors to sense a strength of a magnetic field generated by the electromagnet that is activated, the plurality of magnetic sensors being respectively positioned at fingertip portions of the glove interface object;

processing the sensed strengths of the magnetic fields to generate data derived from the sensed strengths of the magnetic fields;

sending the data derived from the sensed strengths of the magnetic fields to a computing device for processing generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display, such that the pose of the virtual hand is substantially similar to a physical pose of the glove interface object.

9. The method of claim 8, wherein processing the sensed strengths of the magnetic fields includes determining distances from each of the magnetic sensors to each of the electromagnets, and determining a relative location of each magnetic sensor to the plurality of electromagnets based on the determined distances.

10. The method of claim 9, wherein the processing to define the pose of the virtual hand includes processing the relative location of each magnetic sensor to define a pose for a corresponding virtual finger on the virtual hand.

11. The method of claim 9, wherein the plurality of electromagnets includes at least three electromagnets positioned on the wrist portion of the glove interface object in a non-collinear arrangement.

12. The method of claim 11, wherein the relative location of a given magnetic sensor to the plurality of electromagnets is defined by an intersection of radii, the radii having origins defined by each of the electromagnets and magnitudes defined by the determined distances from the given magnetic sensor to each of the electromagnets.

13. The method of claim 8, wherein serially activating and deactivating the plurality of electromagnets defines a repetitive cycle of the periods of activation of the electromagnets.

14. The method of claim 8, wherein each of the plurality of magnetic sensors is configured to generate a voltage in response to a magnetic field generated by one of the electromagnets.

15. A method, comprising:

activating a first electromagnet positioned on a wrist portion of a glove interface object, the activation of the first electromagnet producing a first magnetic field;

measuring a strength of the first magnetic field at each of a plurality of fingertip portions of the glove interface object;

deactivating the first electromagnet;

activating a second electromagnet positioned on the wrist portion of the glove interface object, the activation of the second electromagnet producing a second magnetic field;

measuring a strength of the second magnetic field at each of the plurality of fingertip portions of the glove interface object;

deactivating the second electromagnet;

activating a third electromagnet positioned on a wrist portion of the glove interface object, the activation of the third electromagnet producing a third magnetic field;

measuring a strength of the third magnetic field at each of the plurality of fingertip portions of the glove interface object;

deactivating the third electromagnet;

for each of the fingertip portions of the glove interface object, generating location data that indicates a location of the fingertip portion based on the measured strength of the first, second, and third magnetic fields at the fingertip portion;

sending the location data to a computing device for processing to generate data representing a configuration of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display, such that the configuration of the virtual hand is substantially similar to a physical configuration of the glove interface object.

16. The method of claim 15,

wherein the activating and deactivating of the first electromagnet defines a period of activation for the first electromagnet during which the measuring of the strength of the first magnetic field is performed;

wherein the activating and deactivating of the second electromagnet defines a period of activation for the second electromagnet during which the measuring of the strength of the second magnetic field is performed;

wherein the activating and deactivating of the third electromagnet defines a period of activation for the third electromagnet during which the measuring of the strength of the third magnetic field is performed;

wherein the periods of activation for the first, second, and third electromagnets are substantially non-overlapping.

17. The method of claim 15, further comprising:

cyclically performing each of the operations of the method, so as to provide real-time correspondence between the configuration of the virtual hand and the physical configuration of the glove interface object.

18. The method of claim 15, wherein the location of a given fingertip portion is defined by an intersection of radii, the radii having origins defined by each of the electromagnets and magnitudes defined by distances from the given fingertip portion to each of the electromagnets that are determined from the measured strengths of the magnetic fields.

19. The method of claim 15, wherein the first, second, and third electromagnets are positioned on the wrist portion of the glove interface object in a non-collinear arrangement.

20. The method of claim 15, measuring the strength of the magnetic fields at each of the plurality of fingertip portions is performed by Hall effect sensors positioned at the plurality of fingertip portions.