Process for Providing and Editing Instructions, Data, Data Structures, and Algorithms in a Computer System
First Claim
1. A method of computer programming comprising:
- interpreting hand gestures as programming input; and
interpreting spoken utterances as programming input.
0 Assignments
0 Petitions
Accused Products
Abstract
A method and system for computer programming using speech and one or two hand gesture input is described. The system generally uses a plurality of microphones and cameras as input devices. A configurable event recognition system is described allowing various software objects in a system to respond to speech and hand gesture and other input. From this input program code is produced that can be compiled at any time. Various speech and hand gesture events invoke functions within programs to modify programs, move text and punctuation in a word processor, manipulate mathematical objects, perform data mining, perform natural language interne search, modify project management tasks and visualizations, perform 3D modeling, web page design and web page data entry, and television and DVR programming.
-
Citations
64 Claims
-
1. A method of computer programming comprising:
-
interpreting hand gestures as programming input; and interpreting spoken utterances as programming input. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method of data and event processing comprising:
-
allocation of computer system resources to sensor input; transforming sensor data into broadcast or narrowcast application data for event recognition; recognizing events from transformed sensor data; and sending of event notifications and data to a plurality of objects. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30)
-
- 31. A method comprising finding parts of hands on one or more hands using light patterns from one or more cameras.
-
39. A system comprising:
-
at least one image sensor and at least one microphone; a module to transform sensor data into broadcast or narrowcast application data for event recognition; a set of speech and hand gesture recognizers; a set of computer applications enabled to receive speech and hand gesture event input. - View Dependent Claims (40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64)
-
Specification