Tracking bimanual movements

• US 8,515,132 B2
• Filed: 08/01/2012
• Issued: 08/20/2013
• Est. Priority Date: 04/15/2004
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Shamaie, Atid
• Primary Examiner(s): LE, BRIAN Q
• Application Number:
  US13/564,492
• Publication Number:
  US 20120293408A1
• Time in Patent Office: 384 Days
• Field of Search: 382/103, 382/106, 382/107, 348/169, 715/863
• US Class Current: 382/103
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Hands may be tracked before, during, and after occlusion, and a gesture may be recognized. Movement of two occluded hands may be tracked as a unit during an occlusion period. A type of synchronization characterizing the two occluded hands during the occlusion period may be determined based on the tracked movement of the occluded hands. Based on the determined type of synchronization, it may be determined whether directions of travel for each of the two occluded hands change during the occlusion period. Implementations may determine that a first hand and a second hand are occluded during an occlusion period, the first hand having come from a first direction and the second hand having come from a second direction. The first hand may be distinguished from the second hand after the occlusion period based on a determined type of synchronization characterizing the two hands, and a behavior of the two hands.

Claims

1. A device comprising:

a memory, and

a computing device coupled with the memory and configured to;

determine that a first hand and a second hand are occluded, the first hand having come from a first direction and the second hand having come from a second direction;

track movement of the occluded hands, the occluded hands being tracked as a unit;

determine a type of synchronization characterizing the occluded hands based on the tracked movement of the occluded hands;

determine that the first hand and the second hand are no longer occluded; and

distinguish, after determining that the first hand and the second hand are no longer occluded, the first hand from the second hand based on the determined type of synchronization.

2. The device of claim 1, wherein the computing device is further configured to recognize a gesture based on the tracked movement of the occluded hands.

3. The device of claim 1, wherein the computing device is further configured to execute instructions that cause the device to determine whether the first hand and the second hand change their direction of travel during a period in which the first hand and the second hand are occluded.

4. The device of claim 3, wherein:

tracking the movement of the occluded hands comprises tracking movement of a rectangle formed to surround the occluded hands, and

determining whether the first hand and the second hand change their direction of travel comprises determining a measure of the occluded hands'"'"' velocities based on velocities of one or more sides of the rectangle.

5. The device of claim 4, wherein determining whether the first hand and the second hand change their direction of travel is based on one or more probability distributions of the measure of the occluded hands'"'"' velocities.

6. The device of claim 4, wherein determining whether the first hand and the second hand change their direction of travel is based on whether the measure of the occluded hands'"'"' velocities goes below a threshold.

7. The device of claim 1, wherein determining the type of synchronization comprises determining a measure of the occluded hands'"'"' velocities.

8. The device of claim 7 wherein the measure of the occluded hands'"'"' velocities comprises a standard deviation of a difference of velocities of sides of a shape formed to surround the occluded hands.

9. A non-transitory computer-readable storage medium encoded with executable instructions that, when executed, cause a computing device to perform operations comprising:

determining that a first hand and a second hand are occluded, the first hand having come from a first direction and the second hand having come from a second direction;

tracking movement of the occluded hands, the occluded hands being tracked as a unit;

determining a type of synchronization characterizing the occluded hands based on the tracked movement of the occluded hands;

determining that the first hand and the second hand are no longer occluded; and

distinguishing, after determining that the first hand and the second hand are no longer occluded, the first hand from the second hand based on the determined type of synchronization.

10. The non-transitory computer-readable storage medium of claim 9, further comprising instructions for recognizing a gesture based on the tracked movement of the occluded hands.

11. The non-transitory computer-readable storage medium of claim 9, further comprising instructions for determining whether the first hand and the second hand change their direction of travel during a period in which the first hand and the second hand are occluded.

12. The non-transitory computer-readable storage medium of claim 11, wherein:

the instructions for tracking the movement of the occluded hands include instructions for tracking movement of a rectangle formed to surround the occluded hands, and the instructions for determining whether the first hand and the second hand change their direction of travel include instructions for determining a measure of the occluded hands'"'"' velocities based on velocities of one or more sides of the rectangle.

13. The non-transitory computer-readable storage medium of claim 12, wherein the instructions for determining whether the first hand and the second hand change their direction of travel are configured to cause the determination to be based on whether the measure of the occluded hands'"'"' velocities goes below a threshold.

14. The non-transitory computer-readable storage medium of claim 9, wherein the instructions for determining the type of synchronization include instructions for determining a measure of the occluded hands'"'"' velocities.

15. An apparatus comprising:

means for determining that a first hand and a second hand are occluded, the first hand having come from a first direction and the second hand having come from a second direction;

means for tracking movement of the occluded hands, the occluded hands being tracked as a unit;

means for determining a type of synchronization characterizing the occluded hands based on the tracked movement of the occluded hands;

means for determining that the first hand and the second hand are no longer occluded; and

means for distinguishing, after determining that the first hand and the second hand are no longer occluded, the first hand from the second hand based on the determined type of synchronization.

16. The apparatus of claim 15, further comprising means for recognizing a gesture based on the tracked movement of the occluded hands.

17. The apparatus of claim 15, further comprising means for determining whether the first hand and the second hand change their direction of travel during a period in which the first hand and the second hand are occluded.

18. The apparatus of claim 17, wherein:

the means for tracking movement of the occluded hands include means for tracking movement of a rectangle formed to surround the occluded hands, and

the means for determining whether the first hand and the second hand change their direction of travel include means for determining a measure of the occluded hands'"'"' velocities based on velocities of one or more sides of the rectangle.

19. The apparatus of claim 18, wherein the means for determining whether the first hand and the second hand change their direction of travel are configured to cause the determination to be based on whether the measure of the occluded hands'"'"' velocities goes below a threshold.

20. The apparatus of claim 15, wherein the means for determining the type of synchronization include instructions for determining a measure of the occluded hands'"'"' velocities.