Object detection and selection using gesture recognition
First Claim
Patent Images
1. A method of object selection for use in a device having digital camera functionality, the method comprising:
- detecting the occurrence of a gesture by a pointing member in an image frame captured by an image sensor;
recognizing the gesture and determining an object pointed to thereby; and
selecting the object as a result of the gesture recognition,wherein gesture recognition comprises;
capturing a first image using infrared (IR) illumination turned oncapturing a second image using infrared (IR) illumination turned off;
calculating a third image as the difference between the first and second images;
performing a union find on the third image to identify one or more distinct objects located in the third image;
discarding from consideration those of the one or more distinct objects that are smaller than a threshold size;
discarding from consideration those of the one or more distinct objects that are not along an edge of the third image; and
determining vectors and points for each of the one or more distinct objects that has not been discarded from consideration.
4 Assignments
0 Petitions
Accused Products
Abstract
Object detection and selection for use in a device having digital camera functionality is described. The mechanism detects the occurrence of a gesture by a pointing member in an image frame captured by an IR image sensor. The gesture is then recognized and an object pointed to is detected. The object detected is then selected as a result of the gesture recognition.
37 Citations
22 Claims
-
1. A method of object selection for use in a device having digital camera functionality, the method comprising:
-
detecting the occurrence of a gesture by a pointing member in an image frame captured by an image sensor; recognizing the gesture and determining an object pointed to thereby; and selecting the object as a result of the gesture recognition, wherein gesture recognition comprises; capturing a first image using infrared (IR) illumination turned on capturing a second image using infrared (IR) illumination turned off; calculating a third image as the difference between the first and second images; performing a union find on the third image to identify one or more distinct objects located in the third image; discarding from consideration those of the one or more distinct objects that are smaller than a threshold size; discarding from consideration those of the one or more distinct objects that are not along an edge of the third image; and determining vectors and points for each of the one or more distinct objects that has not been discarded from consideration. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method of identifying a desired area of focus for use in a device having digital camera functionality, the method comprising:
-
performing gesture recognition to detect a gesture by a pointing member in an image captured by an image sensor; recognizing the gesture; and determining the area pointed to by the recognized gesture, wherein gesture recognition comprises; capturing a first image using infrared (IR) illumination turned on; capturing a second image using infrared (IR) illumination turned off; calculating a third image as the difference between the first and second images; performing a union find on the third image to identify one or more distinct objects located in the third image; discarding from consideration those of the one or more distinct objects that are smaller than a threshold size; discarding from consideration those of the one or more distinct objects that are not along an edge of the third image; and determining vectors and points for each of the one or more distinct objects that has not been discarded from consideration. - View Dependent Claims (7, 8, 9, 10, 11)
-
-
12. A method of object selection for use in a device having digital camera functionality, the method comprising:
-
performing gesture recognition to detect the occurrence of a gesture by a pointing member in an image frame captured by an image sensor; and identifying that the pointing member points to a particular object and selecting the object in response thereto, wherein gesture recognition comprises; capturing a first image using infrared (IR) illumination turned on; capturing a second image using infrared (IR) illumination turned off; calculating a third image as the difference between the first and second images; performing a union find on the third image to identify one or more distinct objects located in the third image; discarding from consideration those of the one or more distinct objects that are smaller than a threshold size; discarding from consideration those of the one or more distinct objects that are not along an edge of the third image; and determining vectors and points for each of the one or more distinct objects that has not been discarded from consideration. - View Dependent Claims (13, 14, 15, 16, 17, 18)
-
-
19. A mobile communications device, comprising:
-
a digital camera subsystem; a cellular subsystem; a memory; a processor coupled to the one or more radio circuits and the memory, the processor operative; to perform gesture recognition to detect the occurrence of a gesture by a pointing member in an image captured by an image sensor; to recognize the gesture; and to determine an area pointed to by the recognized gesture, wherein gesture recognition comprises; capturing a first image using infrared (IR) illumination turned on; capturing a second image using infrared (IR) illumination turned off; calculating a third image as the difference between the first and second images; performing a union find on the third image to identify one or more distinct objects located in the third image; discarding from consideration those of the one or more distinct objects that are smaller than a threshold size; discarding from consideration those of the one or more distinct objects that are not along an edge of the third image; and determining vectors and points for each of the one or more distinct objects that has not been discarded from consideration. - View Dependent Claims (20, 21, 22)
-
Specification