×

Multimodal stream processing-based cognitive collaboration system

  • US 10,257,241 B2
  • Filed: 12/21/2016
  • Issued: 04/09/2019
  • Est. Priority Date: 12/21/2016
  • Status: Active Grant
First Claim
Patent Images

1. A system comprising:

  • a stream processing engine including a plurality of processor modules configured to perform cognitive processing of multimodal input streams including input audio, input video, and input text, originated at one or more user devices associated with a communication session supported by a collaboration service, wherein the plurality of processor modules includes a speech-to-text module to convert speech in the input audio to converted text, and a natural language processor to derive user intent from the input text and the converted text is available, and wherein the stream processing engine is further configured to derive user requests associated with the communication session based on the user intent and to transmit the user requests over one or more networks; and

    a Bot subsystem configured to communicate with the stream processing engine, the collaboration service, and the one or more user devices over the one or more networks, the Bot subsystem including a collection of Bots configured as computer programs that run automated tasks over the one or more networks to implement;

    a stream receptor to receive the multimodal input streams from the one or more user devices and direct the multimodal input streams to an appropriate one or ones of the plurality of processor modules of the stream processing engine to enable the stream processing engine to derive the user requests;

    a cognitive action interpreter to translate the user requests to corresponding action requests and issue the action requests to the collaboration service so as to initiate actions with respect to the communication session; and

    a cognitive responder to transmit, in response to the user requests, multimodal user responses, including audio, video, and text user responses to the one or more user devices.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×