APPARATUS AND SYSTEM FOR INTERFACING WITH COMPUTERS AND OTHER ELECTRONIC DEVICES THROUGH GESTURES BY USING DEPTH SENSING AND METHODS OF USE
First Claim
1. An apparatus for 3D mapping images of one or more objects, comprising:
- a. an illumination device having a light source that modulates frequency, duty cycle, and intensity, for illuminating the one or more objects;
b. an optical device for projecting one or more object images onto an image sensing device;
c. the image sensing device;
d. a reconfigurable architecture hardware comprising an image capturing device for capturing images of one or more objects from the image sensing device, an information storage device, the reconfigurable hardware for controlling the illumination device and implementing a 3D mapping formula generating a 3D map of one or more objects; and
e. a processor comprising an information storage device, for processing the 3D map of one or more objects.
0 Assignments
0 Petitions
Accused Products
Abstract
Disclosed herein are systems and methods for gesture capturing, detection, recognition, and mapping them into commands that allow one or more users to interact with electronic games or any electronic device interfaces. Gesture recognition methods, apparatus and system are disclosed from which application developers can incorporate gesture-to-character inputs into their gaming, learning or the like applications. Also herein are systems and methods for receiving 3D data reflecting hand, fingers or other body parts movements of a user, and determining from that data whether the user has performed gesture commands for controlling electronic devices, or computer applications such as games or others.
-
Citations
18 Claims
-
1. An apparatus for 3D mapping images of one or more objects, comprising:
-
a. an illumination device having a light source that modulates frequency, duty cycle, and intensity, for illuminating the one or more objects; b. an optical device for projecting one or more object images onto an image sensing device; c. the image sensing device; d. a reconfigurable architecture hardware comprising an image capturing device for capturing images of one or more objects from the image sensing device, an information storage device, the reconfigurable hardware for controlling the illumination device and implementing a 3D mapping formula generating a 3D map of one or more objects; and e. a processor comprising an information storage device, for processing the 3D map of one or more objects. - View Dependent Claims (2, 3, 5)
-
-
4. A system for using a 3D mapping image of one or more objects for controlling electronic devices, comprising:
-
a. an illumination device having a light source that modulates frequency, duty cycle, and intensity for illuminating one or more objects; b. an optical device for projecting one or more object images onto an image sensing device; c. the image sensing device which produces images based on controlled-modulated light illumination of one or more objects situated in a field of view of the optical device;
a reconfigurable architecture hardware controlling the illumination device comprising an image capturing device for capturing images of one or more object from the image sensing devices, implementing a 3D mapping formula for generating a 3D map of the one or more objects; andd. a processor for processing the 3D map of one or more objects for analyzing gestures in order to interpret them through special image processing methods for mapping them into desired commands to control electronic devices. - View Dependent Claims (6, 7, 8, 9)
-
-
10. A method of illuminating one or more objects, comprising the steps of:
-
a. controlling an illumination device to project a controlled train of pulses that are modulated for frequency, duty cycle, and intensity onto the one or more objects; b. adapting the pulses to the distance of one or more objects from the center of the optical device; and c. controlling image sensing device parameters according to parameters of the modulated pulses. - View Dependent Claims (11)
-
-
12. A method, comprising the steps of:
-
a. detecting and recognizing representative features of a face of one or more objects where the object placed in front of the imaging device is a human, which is executed by the reconfigurable architecture hardware; and b. identifying the face of one or more humans present in the field of view and using the identified part of the human to further process other parts of interest from the body of the human object. - View Dependent Claims (13, 14, 15, 16, 17)
-
-
18. The method of claim 18, further comprising the steps of;
-
a. allowing the user to define its own gesture or body parts movements comprising the steps of; b. detecting, identifying, interpreting, and extracting the cue of the new gesture as defined by the user; c. integrating the new gesture in the language parser; and d. storing the new gesture in information storage device.
-
Specification