Gestural indicators for selecting graphic objects

• US 5,485,565 A
• Filed: 08/04/1993
• Issued: 01/16/1996
• Est. Priority Date: 08/04/1993
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Becker, Craig D., Saund, Eric, Moran, Thomas P.
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US08/101,645
• Time in Patent Office: 895 Days
• Field of Search: 395/133, 395/155, 395/161, 395/142, 395/113, 395/117, 395/118, 395/122
• US Class Current: 345/442
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A graphical imaging system, wherein the rough location, size and shape of objects in the image is summarized by a first characteristic descriptor, representing a parametric "pose" computed for each object. A second characteristic descriptor, i.e. a "gesture matching" function, is provided in order to select the single object, or else the set of objects, that best comports with the user'"'"'s selection gesture. When most closely matched, these key characteristic descriptors permit simple and natural user gestures to distinguish among a large set of graphic objects that may overlap both spatially. User gestures can be simple slashes passing through the object, or quick, coarse approximations of objects'"'"' shapes.

Claims

1. A display editing system for selecting one image object from a plurality of image objects for editing, comprising

first means for entering a plurality of image objects on a display surface,

second means responsive to each entered object for creating and storing a first characteristic descriptor representative of said object, said first characteristic descriptor including the general shape and location on the display surface of said object,

third means for entering a selection gesture for selecting at least one of said objects,

fourth means responsive to said selection gesture for creating and storing a second characteristic descriptor representative of said selection gesture, said second characteristic descriptor including the general shape and location on the display surface of said selection gesture,

fifth means for choosing the one of said first characteristic descriptors which is most similar in general shape and location to that of said second characteristic descriptor, thereby selecting said one image object.

2. A display editing system for selecting one image object from a plurality of image objects for editing, comprising

first means for entering a plurality of overlapping objects on a display surface,

second means responsive to each object for creating and storing a first characteristic descriptor representative of each of said objects, said first characteristic descriptor including the general shape and location on the display surface of said object,

third means for entering a selection gesture for selecting one of said objects from said overlapping objects,

fourth means responsive to said selection gesture for creating and storing a second characteristic descriptor representative of said selection gesture, said second characteristic descriptor including the general shape and location on the display surface of said selection gesture,

fifth means for choosing the one of said first characteristic descriptors which is most similar in general shape and location to that of said second characteristic descriptor, and thereby selecting said one image object.

3. The system of claim 2, wherein said second means includes means with respect to a fixed location on said display surface for determining the X-Y location of said object, for determining the orientation of said object, for determining a function of the length of said object, and for determining the aspect ratio of said object, and means for generating, from said foregoing determinations, said first characteristic descriptor.

4. The system of claim 3 wherein said fourth means, with respect to a fixed location on said display surface for determining the X-Y location of said gesture, for determining the orientation of said gesture, for determining the function of the length of said gesture, and for determining the aspect ratio of said gesture, and means for generating, from said foregoing determinations, said second characteristic descriptor.

5. The system of claim 2, wherein said fifth means includes means for calculating a difference factor between each said first characteristic descriptor and that of said gesture, and means for selecting that one of said first characteristic descriptors which represents the least difference factor between said one first characteristic descriptor and that of said gesture.

6. A method of display editing for selecting one image object from a plurality of image objects for editing, comprising the steps of

entering a plurality of overlapping objects on a display surface,

creating and storing a first characteristic descriptor representative of said object, said first characteristic descriptor including the general shape and location on the display surface of said object,

entering a selection gesture for selecting one of said objects,

creating and storing a second characteristic descriptor representative of said selection gesture, said second characteristic descriptor including the general shape and location on the display surface of said selection gesture,

choosing the one of said first characteristic descriptors which is most similar in general shape and location to that of said second characteristic descriptor, and thereby selecting one image object from said plurality of overlapping objects.

7. The method of claim 6, wherein creating said first characteristic descriptor include, with respect to a fixed location on the display surface, determining the X-Y location of said object, determining the orientation of said object, determining a function of the length of said object, determining the aspect ratio of said object, and generating, from said foregoing determinations, said first characteristic descriptor.

8. The method of claim 7 wherein creating said second characteristic descriptor includes, with respect to a fixed location on the display surface, determining the X-Y location of said gesture, determining the orientation of said gesture, determining the function of the length of said gesture, determining the aspect ratio of said gesture, and generating, from said foregoing determinations, said second characteristic descriptor.

9. The method of claim 6 wherein choosing the one of said first characteristic descriptors includes calculating a difference factor between each said first characteristic descriptor and that of said gesture, and selecting that one of said first characteristic descriptors which represents the least difference factor between said one first characteristic descriptor and that of said gesture.

10. A display editing system for selecting a path formed of a collection of primitive objects suitably related to each other of an image, from a plurality of paths formed of line segments, comprising:

first means for entering said plurality of primitive objects on a display surface,

second means for entering a selection gesture curve,

third means for generating a path list corresponding to a plurality of incomplete paths representing a sequence of primitive objects;

fourth means responsive to entry of said selection gesture curve for comparing the general shape and location of said entered selection gesture curve with partial curves of said path list,

fifth means for choosing one of said paths which is most similar in general shape and location to that of said entered selection gesture curve.

11. A display editing system for selecting a chain of objects from a plurality of objects displayed on a display screen wherein the objects are represented by a path formed of a sequence of primitive line segments approximately linked together, said primitive line segments each having no crossing, junctions or sharp corners, comprising:

first means for entering said plurality of primitive line segments for each of said objects on a display surface,

second means for entering a selection gesture curve,

third means for generating a path list corresponding to a plurality of incomplete paths representing a sequence of the primitive line segments representative of said plurality of objects;

fourth means responsive to entry of said selection gesture curve for comparing said entered selection gesture curve with partial curves of said path list,

fifth means for choosing one of said paths from said path list which is most similar to said entered selection gesture curve to thereby select the chain of objects represented by said path.

12. The combination of claim 11, wherein said fifth means includes means for adding chosen paths from the list of paths until the final line of paths represents the best of all chosen paths.

13. A method of selecting a graphical object most closely related to a selection gesture, comprising the steps of

inputting a selection gesture;

creating a characteristic descriptor representative of the general shape and location for said input gesture;

providing a plurality of gesture-based selection modes;

testing the characteristic descriptor of the input gesture for a similarity to a property of each graphical object by each of the gesture-based selection modes using the corresponding property of the selection mode;

assigning a score to each object or set of objects based on the said testing; and

selecting the object or set of objects with the highest score.

14. The method of claim 13, wherein the testing step includes assignment thereto of a confidence score, and further including the step of gating each selected object with a confidence score and selecting that object with the highest confidence score.