×

Multimodal natural language query system for processing and analyzing voice and proximity-based queries

  • US 9,223,776 B2
  • Filed: 10/18/2012
  • Issued: 12/29/2015
  • Est. Priority Date: 03/27/2012
  • Status: Active Grant
First Claim
Patent Images

1. A query system, comprising:

  • a computing device communicatively coupled to a network and configured to receive a plurality of inputs;

    wherein at least one of said inputs is an audio query and another of said inputs is a visual input;

    a speech server communicatively coupled to the computing device via the network, wherein the speech server is configured to receive the audio query from the computing device, convert the audio query into a text query and return the text query to said computing device;

    a mediated reality server communicatively coupled to the computing device via the network, wherein the mediated reality server is configured to receive and process the visual input to determine data relevant to said visual input and return said data relevant to said visual input to said computing device; and

    a remote server communicatively coupled to the computing device via the network, wherein the remote server is configured to receive said text query and at least a portion of said data relevant to said visual input and based on the received text query and the at least a portion of said data relevant to said visual input determine a response to the query.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×