NOVEL MAN MACHINE INTERFACES AND APPLICATIONS
First Claim
1. Apparatus for input by a person of data to a computer having a display comprising One or more Datum means provided on said person, said datum means distinguishable in reflected light At least one TV Camera having an output Means for determining from said TV camera output, the position of said datums and/or the orientation of a portion of said person Means for creating on said display, a representation of at least one object, and;
- Means for modifying, manipulating, or positioning said at least one object representation on said screen as a function of the position or orientation of datums or person
0 Assignments
0 Petitions
Accused Products
Abstract
The invention is aimed at providing affordable methods and apparatus for inputting position, attitude(orientation) or other object characteristic data to computers for the purpose of Computer Aided learning, Teaching, Gaming, Toys, Simulations, Aids to the disabled, Word Processing and other applications.
Preferred embodiments of the invention utilize electro-optical sensors, and particularly TV Cameras, providing optically inputted data from specialized datum'"'"'s on objects and/or natural features of objects. Objects can be both static and in motion, from which individual datum positions and movements can be derived, also with respect to other objects both fixed and moving. Real-time photogrammetry is preferably used to determine relation ships of portions of one or more datums with respect to a plurality of cameras or a single camera processed by a conventional PC.
-
Citations
62 Claims
-
1. Apparatus for input by a person of data to a computer having a display comprising
One or more Datum means provided on said person, said datum means distinguishable in reflected light At least one TV Camera having an output Means for determining from said TV camera output, the position of said datums and/or the orientation of a portion of said person Means for creating on said display, a representation of at least one object, and; Means for modifying, manipulating, or positioning said at least one object representation on said screen as a function of the position or orientation of datums or person - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
18. A method by which a person may input data to a computer, the method comprising:
-
providing a target on said person providing a source of light to create an illumination field;
providing at least one TV camera proximate said light source such that the camera can detect reflection of light from said object in said illumination field detecting radiation reflected from said within the illumination field to create at least one tv image containing an image of said person determining from said tv image information concerning the position and/or orientation of said target, and providing a desired input to said computer using said determined information
-
-
22. A Method for input of information by a person to a computer having a display representing at least one object comprising the steps of
Providing a datum associated with said person Electro-optically determining, the position of at least one datum on said person in 3 dimensions Providing a representation of at least one computer generated virtual object on said display, and Using said determined position or orientation data, manipulating said object displayed by said computer to provide a desired visual display or audio response
-
39. Means for aiding the determination of locations of points on a human, comprising
means providing decoration for said human, said means easily visible by a TV camera or other electro-optical device, and Means for temporarily providing said decoration means on said human
-
43. A Method for producing a display based experience for a user comprising the steps of;
-
Providing a computer Providing a large screen TV display of size greater than 42 inches diagonal, the display being controlled by said computer Providing at least one electro-optical sensor having an output Processing in said computer said sensor output From said processing, determining the position or orientation of a portion of a person and/or object camera, and using said computer, Modifying said display to create a response to an action of said person.
-
- 44. A method according to claim 44 wherein said display is approximately lifesize.
-
48. Method for activity involving an object, comprising the steps of
-
49. Providing an object
-
50. Determining if features can be sensed by a tv camera
-
51. Affixing special datums to said object where features are required for best sensing results,
-
52. Recording the locations of features and special datums into a data base.
-
57. A method of providing a game or other human activity comprising
Providing an object Providing a member attached to said object and movable with respect thereto Determining the position or orientation, or change therein, of said member with an electro-optical sensing system From said determined position or orientation, or change therein, determining an input parameter to a computer program, and Using said program, provide said game or other activity
Specification