Query generation from displayed text documents using virtual magnets

• US 8,756,503 B2
• Filed: 02/21/2011
• Issued: 06/17/2014
• Est. Priority Date: 02/21/2011
• Status: Expired due to Fees

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Privault, Caroline, O'Neill, Jacki, Hoppenot, Yves, Guillot, Fabien
• Primary Examiner(s): Kumar, Anil N
• Application Number:
  US13/031,336
• Publication Number:
  US 20120216114A1
• Time in Patent Office: 1,212 Days
• Field of Search: None
• US Class Current: 715/702
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40

Abstract

A system and method are provided for dynamically generating a query using touch gestures. A virtual magnet is movable on a display device of a tactile user interface in response to touch. A user selects one of a set of text documents for review, which is displayed on the display. The system is configured for recognizing a highlighting gesture on the tactile user interface over the displayed document as a selection of a text fragment from the document text. The virtual magnet is populated with a query which is based on the text fragment selected with the highlighting gesture. The populated magnet is able to cause a subset of displayed graphic objects to exhibit a response to the magnet as a function of the query and the text content of the respective documents which the objects represent and/or to cause responsive instances in a text document to be displayed.

Claims

1. A method for dynamically generating a query comprising:

displaying a set of graphic objects on the display device, each graphic object representing one of a set of text documents;

providing a virtual magnet which is movable on a display device of a tactile user interface in response to touching on the tactile user interface, the virtual magnet being capable of drawing graphic objects in the set of graphic objects towards it or repelling them;

providing for a user to select one of the set of text documents, including providing for the user to select one of the graphic objects;

displaying the selected text document on the display device;

recognizing a highlighting gesture on the tactile user interface over the displayed document as a selection of a text fragment from text content of the document; and

populating the virtual magnet with a query which is based on the text fragment selected from the displayed text document by the highlighting gesture, whereby the populated magnet is configured for causing at least one of;

at least a subset of displayed graphic objects to exhibit a response to the magnet as a function of the query and text content of respective documents which the graphic objects represent, the response including the virtual magnet drawing the subset of graphic objects towards it or repelling them; and

responsive instances of the query to be displayed in a text document.

2. The method of claim 1, wherein the populating is performed with a computer processor.

3. The method of claim 1, wherein the providing for the user to select one of the set of text documents includes causing a subset of the graphic objects to exhibit a response to the magnet as a function of an attribute of each of the items represented by the graphic objects in the subset.

4. The method of claim 1, wherein the recognizing includes detecting a first touch contact on the displayed text document as a highlighting gesture and extracting a corresponding highlighted text fragment.

5. The method of claim 4, further comprising detecting a second touch contact on the virtual magnet as generating a virtual bridge between the first and second contacts which updates the query based on the highlighted text fragment.

6. The method of claim 1, further providing a plurality of populating modes including:

a basic mode in which the populating is based on the selected text fragment; and

an advanced mode in which an entity class or parser rule is identified which is satisfied by the selected text fragment, the populating being based on the entity class or parser rule.

7. The method of claim 6, wherein in the advanced mode, an entity class is identified, which is satisfied by the selected text fragment, to generate the query, the entity class being a named entity class which identifies named entities in a named entity class.

8. The method of claim 7, wherein the named entity class is selected from a predefined set of named entity classes.

9. The method of claim 8, wherein the set of named entity classes includes a plurality of named entity classes selected from the group consisting of:

a PERSON NAME class, an ORGANIZATION class, a DATE class, a LOCATION class, and subclasses thereof.

10. The method of claim 1, further comprising at least one of:

displaying responsive instances in a displayed text document when the populated magnet is positioned below a threshold distance from the displayed text document; and

moving the subset of displayed graphic objects towards the magnet as a function of the query and text content of respective documents which the graphic objects represent when the populated magnet is positioned below a threshold distance from the displayed graphic objects.

11. The method of claim 1, wherein the populating of the virtual magnet with a query comprises applying a parser to at least a portion of the text document including the selected text fragment to identify an entity or entity class and the method further comprises applying the same parser with the entity or entity class to a displayed text document and displaying responsive instances of the entity or entity class in the displayed text document.

12. The method of claim 1, wherein the populating of the virtual magnet with a query comprises applying a parser to at least a portion of the text document including the selected text fragment to identify an entity or entity class and the method further comprises applying the parser with the entity or entity class to a set of text documents to identify instances of the entity or entity class and automatically moving the subset of displayed graphic objects towards the magnet as a function of the query and parsed text content of respective documents, whereby one or more of the displayed graphic objects is separated from others of the displayed graphic objects.

13. The method of claim 1, wherein the populating comprises:

providing for a first virtual magnet to be populated with a first part of a query based on a text fragment of a displayed document;

providing for a second virtual magnet to be populated with a second part of the query based on a text fragment of a displayed document;

whereby the query is applied to a displayed document by positioning the first and second magnets so that they are, at the same time, within a threshold distance of the document.

14. The method of claim 13, wherein the query comprises an event query and the first part of the query comprises a first named entity or entity class and the second part of the query comprises a second named entity or entity class, whereby by positioning the first and second magnets in an arrangement with a displayed document, events which include the first named entity or entity class and second named entity or entity class are identified.

15. The method of claim 1, wherein the magnet is populated with the query without using any key entry device.

16. The method of claim 1, wherein the virtual magnet moves position on the display device in response to touching on the touch-screen with at least one of a finger and another physical implement.

17. The method of claim 1, wherein the highlighting gesture is performed with a finger or other physical implement.

18. The method of claim 1, wherein the populating of the virtual magnet with the query further includes providing for a user to select a query term from a finite set of displayed query terms, the query being based on the text fragment selected from the displayed text document and the selected query term.

19. The method of claim 1, further comprising providing a glance mode in which a predefined gesture implemented with a tangible object or one or more fingers over a displayed graphic object causes a respective text document to be displayed only temporarily.

20. A computer program product comprising a non-transitory recording medium encoding instructions which, when executed by a computer, perform the method of claim 1.

21. A system for dynamically generating a query comprising:

instructions stored in memory for performing the method of claim 1;

a processor in communication with the memory for executing the instructions; and

a tactile user interface in communication with the processor for receiving touch commands and for displaying the graphic objects, text documents, and virtual magnet.

26. The method of claim 1, wherein the populated magnet is configured for automatically causing responsive instances of the query to be displayed in the text document.

22. A tactile user interface comprising:

a display device comprising a touch-screen;

instructions stored in memory for;

displaying a set of graphic objects on the display, each graphic object representing a respective text document,

causing a virtual magnet to move on the display device in response to touching on the touch-screen, the virtual magnet being capable of drawing graphic objects in the set of graphic objects towards it or repelling them,

displaying one of the text documents in response to selection of a respective one of the graphic objects,

recognizing a highlighting gesture over the displayed text document as selection of a fragment of the text in the displayed text document,

populating the magnet with a query based on the selected text fragment; and

causing the magnet populated with the query to move close to a displayed document in response to touching on the touch-screen and displaying responsive instances of the query in the displayed text document; and

a processor in communication with the memory and display device for executing the instructions.

23. The tactile user interface of claim 22, wherein the virtual magnet comprises a plurality of virtual magnets which are displayed on the display.

24. The tactile user interface of claim 23, wherein each of a plurality of the virtual magnets is populatable with a respective query part which in combination form a combined query.

25. The tactile user interface of claim 22, wherein the instructions comprise a parser configured for recognizing named entities and wherein the query includes a named entity class of which the selected text fragment is an instance.