Tap to initiate a next action for user requests
First Claim
1. A method carried out by a head-mountable device comprising:
- sending, a speech-segment message to a hybrid response system in response to detecting a first singular touch gesture on a touchpad of the head-mountable device (HMD),wherein the HMD comprises a near-eye display, and wherein the touchpad is located on a side-arm of the HMD,wherein the speech-segment message is indicative of a speech-segment detected in audio data captured at the HMD by at least one microphone, wherein the speech-segment is associated with a first user-account with the hybrid response system, and wherein the speech-segment message comprises an initial query;
receiving, at the HMD, a response message from the hybrid response system, wherein the response message comprises;
both (a) an answer to the initial query and (b) an indication of a next action to be cued in anticipation of the initial query, wherein the next action is an anticipated actionable follow-up request related to the answer of the initial query; and
in response to receiving the response message;
displaying, on the HMD, a first card interface that includes an indication of the answer to the initial query; and
while displaying the first card interface that indicates the answer to the initial query, detecting touchpad data corresponding to a second singular touch gesture on the touchpad and responsively initiating the next action corresponding to the anticipated follow-up request originally indicated in the response message by displaying a second card interface of a cued next action.
3 Assignments
0 Petitions
Accused Products
Abstract
Embodiments may relate to intuitive user-interface features for a head-mountable device (HMD), in the context of a hybrid human and computer-automated response system. An illustrative method may involve a head-mountable device (HMD) that comprises a touchpad: (a) sending a speech-segment message to a hybrid response system, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at the HMD, and wherein the speech-segment is associated with a first user-account with the hybrid response system, (b) receiving a response message that includes a response to the speech-segment message and an indication of a next action corresponding to the response to the speech-segment message, (c) displaying a card interface that includes an indication of the response, and (d) while displaying the response, detecting a singular touch gesture and responsively initiating the at least one next action.
43 Citations
23 Claims
-
1. A method carried out by a head-mountable device comprising:
-
sending, a speech-segment message to a hybrid response system in response to detecting a first singular touch gesture on a touchpad of the head-mountable device (HMD), wherein the HMD comprises a near-eye display, and wherein the touchpad is located on a side-arm of the HMD, wherein the speech-segment message is indicative of a speech-segment detected in audio data captured at the HMD by at least one microphone, wherein the speech-segment is associated with a first user-account with the hybrid response system, and wherein the speech-segment message comprises an initial query; receiving, at the HMD, a response message from the hybrid response system, wherein the response message comprises;
both (a) an answer to the initial query and (b) an indication of a next action to be cued in anticipation of the initial query, wherein the next action is an anticipated actionable follow-up request related to the answer of the initial query; andin response to receiving the response message; displaying, on the HMD, a first card interface that includes an indication of the answer to the initial query; and while displaying the first card interface that indicates the answer to the initial query, detecting touchpad data corresponding to a second singular touch gesture on the touchpad and responsively initiating the next action corresponding to the anticipated follow-up request originally indicated in the response message by displaying a second card interface of a cued next action. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 19)
-
-
13. A head-mountable device system comprising:
-
at least one microphone configured to provide an audio signal based on speech detected at the head-mountable device (HMD), wherein the HMD comprises a near-eye display and a touchpad that is located on a side-arm of the HMD;
a network interface;a control system configured to;
detect a speech segment in the audio signal with the at least one microphone in response to detecting a first singular touch gesture on the touchpad, wherein the speech segment comprises an initial query;send a speech-segment message to a hybrid human and automated response system, wherein the speech-segment message is indicative of the speech segment, and wherein the speech-segment message is associated with a first user-account with the hybrid human and automated response system; receive, by the HMD, a response message from the hybrid response system, wherein the response message comprises;
both (a) an answer to the initial query and (b) an indication of a next action to be cued in anticipation of the initial query, wherein the next action is responsive to an anticipated actionable follow-up request related to the answer to the initial query; andin response to receipt of the response message; display a first card interface that includes an indication of the answer to the initial query; and while displaying the first card interface that indicates the answer to the initial query, detecting touchpad data corresponding to a second singular touch gesture on the touchpad and responsively initiate the next action corresponding to the anticipated follow-up request initially indicated in the response message by displaying a second card interface of a cued next action. - View Dependent Claims (14, 15, 16)
-
-
17. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device of a head-mountable device to perform functions comprising:
-
sending a speech-segment message to a hybrid human and automated response system, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at least one microphone in response to detecting a first singular touch gesture on a touchpad on a head-mountable device (HMD) that comprises a near-eye display and a touchpad that is located on a side-arm of the HMD, wherein the speech segment is associated with a first user-account with the hybrid human and automated response system, and wherein the speech-segment message comprises an initial query; receiving, by the HMD, a response message from the hybrid response system, wherein the response message comprises;
both (a) an answer to the initial query, and (b) an indication of a next action to be cued in anticipation of the initial query, wherein the next action is responsive to an anticipated actionable follow-up request related to the answer to the initial query;in response to receipt of the response message;
displaying a first card interface that includes an indication of the answer to the initial query; andwhile displaying the first card interface that indicates the answer to the initial query, detecting touchpad data corresponding to a second singular touch gesture on the touchpad and responsively initiating the next action corresponding to the anticipated follow-up request initially indicated in the response message by displaying a second card interface of a cued next action. - View Dependent Claims (18)
-
-
20. A method carried out by a wearable computing device comprising:
-
receiving, by a hybrid response computing system, a speech-segment message generated by the wearable computing device comprising a touchpad, wherein the speech-segment message is indicative of a speech segment that is detected in audio data captured at the wearable computing device by at least one microphone in response to detecting a first singular touch gesture on the touchpad; determining, by the hybrid response computing system, that the speech-segment is associated with a first user-account and comprises a query, determining, by the hybrid response computing system, an answer to the query; determining, by the hybrid response computing system, an anticipated follow-up request related to the answer; determining, by the hybrid response computing system, a singular next action responsive to the anticipated follow-up request; after determining both the answer and the next action, sending a response message from the hybrid response system to the wearable computing device, wherein the response message comprises;
both (a) the answer to the query and (b) an indication of the next action corresponding to the response to the anticipated follow-up request to be cued in anticipation of the query; andreceiving an indication to initiate the next action, wherein the indication corresponds to detecting a second singular touch gesture on the touchpad of the wearable computing device during display of a first card interface that includes the indication of the response message; and responsively initiating the next action indicated in the response message by displaying a second card interface of a cued next action. - View Dependent Claims (21, 22, 23)
-
Specification