Intelligent governance controls based on real-time contexts

• US 9,886,591 B2
• Filed: 02/10/2015
• Issued: 02/06/2018
• Est. Priority Date: 02/10/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Clark, Adam T., Mysak, John S., Payton, Aspen L., Petri, John E., Pfeifer, Michael D.
• Primary Examiner(s): Gortayo, Dangelino
• Application Number:
  US14/618,094
• Publication Number:
  US 20160232368A1
• Time in Patent Office: 1,092 Days
• Field of Search: 707785, 707912, 707942, 707608, 707722, 434236, 434350, 434322, 434326, 434362, 434365, 434434, 715741, 715753
• CPC Class Codes: G06F 16/3334 Selection or weighting of terms from queries, including natural language queries
• CPC Class Codes: G06F 16/367 Ontology
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06F 2221/2149 Restricted operating environment
• CPC Class Codes: G09B 7/00 Electrically-operated teaching apparatus or devices working with questions and answers mechanically operated G09B3/00; computing arrangements G06F
• CPC Class Codes: G09B 7/02 of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

Systems, methods, and computer program products to perform an operation comprising receiving, from a set of input devices, data of an environment surrounding a computing device, determining a current context of a discussion based on the data and a timing schedule specifying a list of planned contexts, receiving a request to perform an operation on the computing device, determining a context of the requested operation, determining a measure of relatedness between the contexts, and upon determining the measure of relatedness does not exceed a predefined threshold, restricting execution of the operation.

Claims

1. A system, comprising:

one or more computer processors; and

a memory containing a program, which when executed by the one or more computer processors, performs an operation comprising;

receiving, from a set of input devices, data of an environment surrounding a computing device, wherein the received data comprises a captured image depicting an object in the environment;

determining a current context of a discussion based on the object depicted in the captured image and a timing schedule specifying a list of planned contexts;

receiving a request to perform an operation on the computing device;

determining a context of the requested operation;

determining a measure of relatedness between the current context of the discussion and the context of the requested operation;

and upon determining the measure of relatedness does not exceed a predefined threshold, restricting execution of the operation.

2. The system of claim 1, wherein the requested operation comprises one of:

(i) accessing an application, (ii) accessing a feature of the application, (iii) accessing a network resource, (iv) submitting a search query, (v) accessing a result of the search query, and (vi) opening a document.

3. The system of claim 2, wherein the requested operation comprises submitting a search query, wherein the context of the operation comprises a context of the query, wherein submission of the search query is restricted upon determining the context of the query does not match the current context.

4. The system of claim 2, wherein the requested operation comprises accessing a result of the search query, wherein the context of the operation comprises a context of the result, wherein access to the result is restricted upon determining the context of the result does not match the current context.

5. The system of claim 1, the operation further comprising:

determining that the current context has changed to an updated context based on updated data received from the input devices;

receiving a second request to perform the requested operation on the computing device; and

upon determining the updated context matches the context of the requested operation, allowing execution of the requested operation on the computing device responsive to receiving the second request.

6. The system of claim 5, wherein a first input device of the set of input devices comprises a camera, wherein the image is captured by the camera, wherein the object comprises a first text, the operation further comprising:

analyzing the captured image to identify the object in the environment; and

identifying a first concept associated with the first text by performing natural language processing on the first text, wherein the current context is further determined based on the first concept.

7. The system of claim 6, wherein restricting execution of the requested operation is further based on a set of rules, wherein the environment comprises at least one of:

(i) a classroom, (ii) a virtual classroom, and (iii) a testing center, wherein the set of rules specify;

(i) a set of restricted operations associated with the current context, and (ii) a set of permitted operations associated with the current context, wherein a second input device of the set of input devices comprises a microphone, wherein the received data further comprises audio data of speech in the environment captured by the microphone, the operation further comprising;

converting the audio data of the speech in the environment to a second text;

identifying a second concept in the audio data of speech in the environment by performing natural language processing on the second text, wherein the current context is further determined based on the second concept.

16. The system of claim 1, wherein a first input device of the set of input devices comprises a camera, wherein the received data further comprises a video of the environment captured by the camera, and wherein the current context is further determined based on the video of the environment.

8. A computer program product, comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to;

receive, from a set of input devices, data of an environment surrounding a computing device, wherein the received data comprises a captured image depicting an object in the environment;

determine a current context of a discussion based on the object depicted in the captured image and a timing schedule specifying a list of planned contexts;

receive a request to perform an operation on the computing device;

determine a context of the requested operation;

determining a measure of relatedness between the current context of the discussion and the context of the requested operation;

and upon determining the measure of relatedness does not exceed a predefined threshold, restrict execution of the operation.

9. The computer program product of claim 8, wherein the requested operation comprises one of:

(i) accessing an application, (ii) accessing a feature of the application, (iii) accessing a network resource, (iv) submitting a search query, (v) accessing a result of the search query, and (vi) opening a document.

10. The computer program product of claim 9, wherein the requested operation comprises submitting a search query, wherein the context of the operation comprises a context of the query, wherein submission of the search query is restricted upon determining the context of the query does not match the current context.

11. The computer program product of claim 9, wherein the requested operation comprises accessing a result of the search query, wherein the context of the operation comprises a context of the result, wherein access to the result is restricted upon determining the context of the result does not match the current context.

12. The computer program product of claim 9, wherein the computer-readable program code is further executable to:

determine that the current context has changed to an updated context based on updated data received from the input devices;

receive a second request to perform the requested operation on the computing device; and

upon determining the updated context matches the context of the requested operation, allow execution of the requested operation on the computing device responsive to receiving the second request.

13. The computer program product of claim 12, wherein a first input device of the set of input devices comprises a camera, wherein the image is captured by the camera, wherein the object comprises a first text, wherein the computer-readable program code is further executable to:

analyze the captured image to identify the object in the environment; and

identify a first concept associated with the first text by performing natural language processing on the first text, wherein the current context is further determined based on the first concept.

14. The computer program product of claim 13, wherein restricting execution of the requested operation is further based on a set of rules, wherein the environment comprises at least one of:

(i) a classroom, (ii) a virtual classroom, and (iii) a testing center, wherein the set of rules specify;

(i) a set of restricted operations associated with the current context, and (ii) a set of permitted operations associated with the current context, wherein a second input device of the set of input devices comprises a microphone, wherein the received data further comprises audio data of speech in the environment captured by the microphone, wherein the computer-readable program code is further executable to;

convert the audio data of the speech in the environment to a second text;

identify a second concept in the audio data of speech in the environment by performing natural language processing on the second text, wherein the current context is further determined based on the second concept.

15. The computer program product of claim 8, wherein a first input device of the set of input devices comprises a camera, wherein the received data further comprises a video of the environment captured by the camera, and wherein the current context is further determined based on the video of the environment.