APPARATUS AND SYSTEM FOR INTERFACING WITH COMPUTERS AND OTHER ELECTRONIC DEVICES THROUGH GESTURES BY USING DEPTH SENSING AND METHODS OF USE
First Claim
1. An apparatus for 3D mapping images of one or more objects, comprising:
- a. an illumination device having a controlled-modulated light source for illuminating the one or more objects;
b. an image sensing device;
c. an optical device for projecting one or more object images onto the image sensing device;
d. a reconfigurable architecture hardware comprising an image capturing device for capturing images of one or more objects from the image sensing device, an information storage device, the hardware for controlling the illumination device and implementing a 3D mapping formula generating a 3D map of one or more objects; and
,e. a processor comprising an information storage device, for processing the 3D map of one or more objects to analyze gestures.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed herein are systems and methods for gesture capturing, detection, recognition, and mapping them into commands which allow one or many users to interact with electronic games or any electronic device interfaces. Gesture recognition methods, apparatus and system are disclosed from which application developers can incorporate gesture-to-character inputs into their gaming, learning or the like applications. Also herein are systems and methods for receiving 3D data reflecting hand, fingers or other body parts movements of a user, and determining from that data whether the user has performed gesture commands for controlling electronic devices, or computer applications such as games or others.
77 Citations
19 Claims
-
1. An apparatus for 3D mapping images of one or more objects, comprising:
-
a. an illumination device having a controlled-modulated light source for illuminating the one or more objects; b. an image sensing device; c. an optical device for projecting one or more object images onto the image sensing device; d. a reconfigurable architecture hardware comprising an image capturing device for capturing images of one or more objects from the image sensing device, an information storage device, the hardware for controlling the illumination device and implementing a 3D mapping formula generating a 3D map of one or more objects; and
,e. a processor comprising an information storage device, for processing the 3D map of one or more objects to analyze gestures. - View Dependent Claims (2, 3, 5)
-
-
4. A system for using a 3D mapping image of one or more objects for controlling electronic devices, comprising:
-
a. an illumination device having a controlled-modulated light source for illuminating one or more objects; b. an optical device for projecting one or more object images onto an image sensing device; c. the image sensing device which produces images based on controlled-modulated light illumination of one or more objects situated in a field of view of the optical device;
a reconfigurable architecture hardware controlling the illumination device comprising an image capturing device for capturing images of one or more object from the image sensing devices, implementing a 3D mapping formula for generating a 3D map of the one or more objects; and
,d. a processor for processing the 3D map of one or more objects for analyzing gestures in order to interpret them through special image processing methods for mapping them into desired commands to control electronic devices. - View Dependent Claims (6, 7, 8, 9)
-
-
10. A method of illuminating one or more objects comprising the steps of:
-
a. controlling an illumination device to project a controlled train of modulated pulses onto the one or more objects; b. adapting the pulses to the distance of one or more objects from the center of the optical device; and
,c. controlling image sensing device parameters according to parameters of the modulated pulses. - View Dependent Claims (11)
-
-
12. A method comprising the steps of:
-
a. detecting and recognizing representative features of a face of one or more objects where the object placed in front of the imaging device is a human, which is executed by the reconfigurable architecture hardware; and b. identifying the face of one or more humans present in the field of view and using the identified part of the human to further process other parts of interest from the body of the human object. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
Specification