System and method for integrating gesture and sound for controlling device
First Claim
1. A system for integrating gestures and sounds, comprising one or more processors configured to embody a plurality of functionalities including:
- a gesture recognition unit that extracts gesture feature information corresponding to user commands from image information and acquires gesture recognition information from the gesture feature information;
a sound recognition unit that extracts sound feature information corresponding to user commands in a sound section selected by using the gesture recognition information from sound information and acquires sound recognition information from the sound feature information; and
an integration unit that generates integration information by integrating the gesture recognition information and the sound recognition information.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed is a system for integrating gestures and sounds including: a gesture recognition unit that extracts gesture feature information corresponding to user commands from image information and acquires gesture recognition information from the gesture feature information; a background recognition unit acquiring background sound information using the predetermined background sound model from the sound information; a sound recognition unit that extracts the sound feature information corresponding to user commands from the sound information and extracts the sound feature information based on the background sound information and acquires the sound recognition information from the sound feature information; and an integration unit that generates integration information by integrating the gesture recognition information and the sound recognition information.
-
Citations
13 Claims
-
1. A system for integrating gestures and sounds, comprising one or more processors configured to embody a plurality of functionalities including:
-
a gesture recognition unit that extracts gesture feature information corresponding to user commands from image information and acquires gesture recognition information from the gesture feature information; a sound recognition unit that extracts sound feature information corresponding to user commands in a sound section selected by using the gesture recognition information from sound information and acquires sound recognition information from the sound feature information; and an integration unit that generates integration information by integrating the gesture recognition information and the sound recognition information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for integrating gestures and sounds, wherein the method is performed by one or more processors, comprising:
-
extracting gesture feature information corresponding to user commands from image information and acquiring gesture recognition information from the gesture feature information; extracting sound feature information corresponding to user commands in a sound section selected by using the gesture recognition information from sound information and acquiring sound recognition information from the sound feature information; and generating integration information by integrating the gesture recognition information and the sound recognition information. - View Dependent Claims (11, 12, 13)
-
Specification