Information processing method and apparatus
First Claim
1. An information processing method for recognizing a user'"'"'s instruction on the basis of a plurality of pieces of input information which are input by a user using a plurality of types of input modalities, said method having a description including correspondence between input contents and a semantic attribute for each of the plurality of types of input modalities, said method comprising:
- an acquisition step of acquiring an input content by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and acquiring semantic attributes of the acquired input contents from the description; and
an integration step of integrating the input contents acquired in the acquisition step on the basis of the semantic attributes acquired in the acquisition step.
1 Assignment
0 Petitions
Accused Products
Abstract
In an information processing method for processing a user'"'"'s instruction on the basis of a plurality of pieces of input information which are input by a user using a plurality of types of input modalities, each of the plurality of types of input modalities has a description including correspondence between the input contents and semantic attributes. Each input content is acquired by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and semantic attributes of the acquired input contents are acquired from the description. A multimodal input integration unit integrates the acquired input contents on the basis of the acquired semantic attributes.
-
Citations
20 Claims
-
1. An information processing method for recognizing a user'"'"'s instruction on the basis of a plurality of pieces of input information which are input by a user using a plurality of types of input modalities,
said method having a description including correspondence between input contents and a semantic attribute for each of the plurality of types of input modalities, said method comprising: - an acquisition step of acquiring an input content by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and acquiring semantic attributes of the acquired input contents from the description; and
an integration step of integrating the input contents acquired in the acquisition step on the basis of the semantic attributes acquired in the acquisition step. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 19, 20)
- an acquisition step of acquiring an input content by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and acquiring semantic attributes of the acquired input contents from the description; and
-
16. An information processing apparatus for recognizing a user'"'"'s instruction on the basis of a plurality of pieces of input information which are input by a user using a plurality of types of input modalities, comprising:
-
a holding unit for holding a description including correspondence between input contents and a semantic attribute for each of the plurality of types of input modalities, an acquisition unit for acquiring an input content by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and acquiring semantic attributes of the acquired input contents from the description; and
an integration unit for integrating the input contents acquired by said acquisition unit on the basis of the semantic attributes acquired by said acquisition unit.
-
-
17. A description method of describing a GUI, characterized by describing semantic attributes corresponding to respective GUI components using a markup language.
-
18. A grammar rule for recognizing speech input information input by speech, characterized by describing semantic attributes corresponding to respective speech inputs in the grammar rule.
Specification