Real time perception of and response to the actions of an unencumbered participant/user
First Claim
1. A device for perceiving, processing and responding in real time to a demonstrative behavior of at least one unmarked participant, said device comprising:
- means spaced from at least one unmarked participant for distinguishing the participant from a background;
means for imaging each distinguished participant and providing an image thereof;
means for digitizing said image provided by said means for imaging;
means connected to said means for digitizing for ascertaining features of the digitized image;
means connected to said means for ascertaining for identifying at least one characteristic of at least one of said ascertained features, each of the identified characteristics being a selected one of a location and a movement of a respective ascertained feature, said means for identifying providing a control parameter in response to the at least one identified characteristic;
means responsive to said control parameter for processing said ascertained features of said digitized image to provide a signal indicative of a demonstrative behavior of said participant; and
means for responding in real time to said signal indicative of a demonstrative behavior of said participant.
0 Assignments
0 Petitions
Accused Products
Abstract
Apparatus and method for using an image of the human body to control real time computer events wherein data regarding a participant are acquired through any means of imaging without marking the participant or requiring that he or she use or wear a stimulus source, sensing device or special clothing. Perception and feature analysis are carried out by specialized circuitry and computer software, and response to perception is expressed using any device controllable by a computer. Participants generally are unaware of processing delays between action and reaction, and their perception of an event is similar to dealing with a human being or animate creature. Perception and response occur in real time with action and reaction closely coupled.
-
Citations
39 Claims
-
1. A device for perceiving, processing and responding in real time to a demonstrative behavior of at least one unmarked participant, said device comprising:
-
means spaced from at least one unmarked participant for distinguishing the participant from a background; means for imaging each distinguished participant and providing an image thereof; means for digitizing said image provided by said means for imaging; means connected to said means for digitizing for ascertaining features of the digitized image; means connected to said means for ascertaining for identifying at least one characteristic of at least one of said ascertained features, each of the identified characteristics being a selected one of a location and a movement of a respective ascertained feature, said means for identifying providing a control parameter in response to the at least one identified characteristic; means responsive to said control parameter for processing said ascertained features of said digitized image to provide a signal indicative of a demonstrative behavior of said participant; and means for responding in real time to said signal indicative of a demonstrative behavior of said participant. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A process for controlling a device adapted to perform a plurality of operations to perceive, process and respond in real time to a plurality of demonstrative behaviors of at least one unmarked participant, said process comprising:
-
associating each of a plurality of demonstrative behaviors of at least one unmarked participant with a respective operation of said device; generating low level code associated with said operations, said low level code including at least one independent primitive module; controlling a plurality of special purpose processors of said device in accordance with said low level code; and sequencing the control of said special purpose processors in accordance with a performed sequence of said demonstrative behaviors so as to realize real time performance of a corresponding sequence of said operations.
-
-
21. A device for representing graphically, in real time, at least one unmarked participant in a demonstrative activity associated with said participant, said device comprising:
-
means for obtaining a contrasting image of said unmarked participant; means for digitizing said contrasting image to provide a digitized image; means for timing control of said means for obtaining said contrasting image; means for ascertaining features of said digitized image; means connected to said means for timing control for storing ascertained features of said digitized image and for processing said stored ascertained features of said digitized image; means for identifying at least one characteristic of at least one of said ascertained features, each of the identified characteristics being a selected one of a location and a movement of a respective ascertained feature of said digitized image; means responsive to said means for identifying for controlling said means for storing and for processing so as to provide information indicative of a demonstrative activity of said participant; and means responsive to said information for updating a selected one of a graphic and a manipulatable image representation, in real time, of a demonstrative behavior of said participant. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A method for perceiving, processing and responding, in real time, to a demonstrative behavior of at least one unmarked participant, the method comprising the steps of:
-
imaging said unmarked participant to obtain an analog image of the same; converting said image from analog to digital form to obtain a digitized form of said image; first processing said digitized form of said image to obtain desired features from said digitized form of said image; storing said obtained desired features; synchronizing said first processing and storing by establishing at least one characteristic of said desired features for identification and comparison with said stored desired features, each of the characteristics being a selected one of a location and a movement of a respective feature; further processing, in real time, said stored desired features and said at least one characteristic to provide processed features; and projecting, in an imaged environment, a processed image of said processed features, in real time. - View Dependent Claims (35, 36, 37, 38, 39)
-
Specification