Filtering document search results using contextual metadata

• US 10,169,342 B1
• Filed: 03/02/2018
• Issued: 01/01/2019
• Est. Priority Date: 06/29/2017
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ben-Yair, Yoav, Fuchs, Gil, Gordon, Itai, Prager, Ilan D.
• Primary Examiner(s): Jami, Hares
• Application Number:
  US15/910,129
• Publication Number:
  US 20190005034A1
• Time in Patent Office: 305 Days
• Field of Search: 707722, 707732, 707754, 707758
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1114 Tracking parts of the body
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 40/174 Facial expression recognition
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Receiving contextual data including a facial movement associated with an active document. A response associated with the active document is detected and associated with the received contextual data. A contextual metadata tag is generated based on the detected response to the active document. A contextual keyword is created that corresponds to the contextual metadata tag. Search results received in response to the query are filtered based on the contextual metadata tag.

Claims

1. A computer-implemented method for filtering document search results, the computer-implemented method comprising:

receiving contextual data comprising a facial movement associated with an active document, an image of a face of a user reading the active document, a location where the user read the active document, a timestamp indicating when the user read the active document; and

a timestamp indicating when the user edited the active document, wherein the contextual data is based, at least in part, on physical contexts of the user, wherein the physical contexts include movement of hands, movement of eyes, posture of the user, motion of the user'"'"'s body, location of the user, facial expressions, identities of people proximate the user, and environmental characteristics;

detecting an emotional response associated with the active document based on the contextual data, wherein the emotional response is detected based, at least in part, on the shape and position of the mouth, nose, eyebrows, and facial lines in the forehead in relation to one another;

generating a contextual metadata tag based on the contextual data and the detected response to the active document, the contextual metadata tag including a movement tag indicating a movement of a device while the active document was read by the user and a movement of the device while the active document was edited by the user;

receiving a query comprising a contextual keyword corresponding to the contextual metadata tag;

filtering search results received in response to the query based on the contextual metadata tag; and

displaying a list of the filtered search results.