User interface high-lighter function to provide directed input for image processing

• US 6,385,351 B1
• Filed: 02/24/1999
• Issued: 05/07/2002
• Est. Priority Date: 10/01/1998
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Company (HP Inc.)
• Inventors: Simske, Steven J., Lesser, Richard R.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): SHERALI, ISHRAT I
• Application Number:
  US09/257,167
• Time in Patent Office: 1,168 Days
• Field of Search: 382/309-315, 382/318, 382/319, 382/305, 382/306, 382/190-191, 382/173-176, 382/180, 382/282, 358/537, 358/538, 358/462, 358/464, 345/769, 345/770, 345/773, 345/780, 345/788, 345/794, 345/163, 345/164, 345/168, 345/179, 345/180, 345/781, 345/804, 707/531, 707/527, 707/517, 707/530
• US Class Current: 382/312
• CPC Class Codes: H04N 1/3872 Repositioning or masking
• CPC Class Codes: H04N 1/3873 defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
• CPC Class Codes: H04N 1/40062 Discrimination between different image types, e.g. two-tone, continuous tone

Abstract

A user interface high-lighter function for scanner software that allows a user to automatically select a portion or several disjoint portions of text within a region of text in a preview scan of a document. When activated, the high-lighter function causes the normal mouse cursor to be replaced with a high-lighter icon having an active edge. Using the mouse, the active edge of the high-lighter icon is moved across a desired portion of text, and background pixels traversed are displayed in a different color. The traversed pixels are then used as input for an image processing routine. Text regions are generated from the traversed pixels. The beginning and ending of lines not high-lighted are cropped. A polygonal bounding box is then displayed around the selected text. An un-highlight mode can be activated to reduce the selected text. An optimized re-scan of the to selected text can now be performed.

Claims

1. A user interface high-lighter method, within a computer system, for selecting at least one portion of text comprising the steps of:

(a) displaying, on a monitor connected to said computer system, a scanned image containing at least one region of text;

(b) receiving a first input in said computer system to activate said user interface high-lighter method;

(c) displaying, in said monitor, a high-lighter icon in place of a cursor for a graphical input device, wherein said graphical input device is connected to said computer system;

(d) receiving a first button down input from said graphical input device, wherein said first button down input identifies, from a first starting location of said high-lighter icon displayed on said monitor, a first beginning line of at least two pixels within said at least one region of text;

(e) receiving a first button drag input from said graphical input device, wherein said first button drag input identifies, from a first interim movement of said high-lighter icon displayed on said monitor, a first interim region of pixels within said at least one region of text;

(f) receiving a first button up input from said graphical input device, wherein said first button up input identifies, from a first ending location of said high-lighter icon displayed on said monitor, a first ending line of at least two pixels within said at least one region of text, wherein said first beginning line of at least two pixels, said first interim region of pixels, and said first ending line of at least two pixels comprise a first highlight area;

(g) receiving a first select input to select said first highlight area as a first data input for an image processing routine; and

(h) processing, by said image processing routine, a first portion of bitmapped data represented by said first data input to determine a first selected bitmapped data area, wherein said at least one portion of text from said at least one region of text within said scanned image is represented by said first selected bitmapped data area.

2. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 wherein step (a) further comprises step (a0) performed before step (a):

(a0) scanning at least one document with a scanner device connected to said computer system, wherein said scanning of said at least one document produces said scanned image containing said at least one region of text displayed on said monitor, and further wherein said scanned image is a variable resolution preview scan of said at least one document.

3. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 wherein said high-lighter icon further comprises an active edge, wherein said active edge identifies said first beginning line of said at least two pixels from said first button down input from said graphical input device, said active edge identifies said first interim region of pixels from said first button drag input from said graphical input device, and said active edge identifies said first ending line of said at least two pixels from said first button up input from said graphical input device.

4. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 wherein step (d) further comprises step (d1), step (e) further comprises step (e1), and step (f) further comprises step (f1):

(d1) when said first beginning line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said first beginning line of at least two pixels in a different color from a current background color for said all of said at least one background pixels;

(e1) when said first interim region of pixels contains at least one background pixel, displaying all of said at least one background pixels from said first interim region of pixels in said different color from said current background color for said all of said at least one background pixels; and

(f1) when said first ending line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said first ending line of at least two pixels in said different color from said current background color for said all of said at least one background pixels.

5. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 4 further comprising the steps of:

(i) displaying said all of said at least one background pixels from said first beginning line of at least two pixels in said current background color;

(j) displaying said all of said at least one background pixels from said first interim region of pixels in said current background color;

(k) displaying said all of said at least one background pixels from said first ending line of at least two pixels in said current background color; and

(l) displaying a polygonal bounding box around said at least one portion of text.

6. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 5 further comprising the steps of:

(m) receiving a second input in said computer system to activate an un-highlight mode of said user interface high-lighter method;

(n) receiving a second button down input from said graphical input device from within said at least one portion of text, wherein said second button down input identifies, from a second starting location of said high-lighter icon displayed on said monitor, a second beginning line of at least two pixels within said at least one portion of text;

(o) receiving a second button drag input from said graphical input device from within said at least one portion of text, wherein said second button drag input identifies, from a second interim movement of said high-lighter icon displayed on said monitor, a second interim region of pixels within said at least one portion of text;

(p) receiving a second button up input from said graphical input device from within said at least one portion of text, wherein said second button up input identifies, from a second ending location of said high-lighter icon displayed on said monitor, a second ending line of at least two pixels within said at least one portion of text, wherein said second beginning line of at least two pixels, said second interim region of pixels, and said second ending line of at least two pixels comprise a second highlight area;

(q) receiving said second highlight area as a second data input for said image processing routine;

(r) processing, by said image processing routine, a second portion of bitmapped data represented by said second data input to determine a second selected portion of bitmapped data contained within said first selected bitmapped data area;

(s) deleting said second selected portion of bitmapped data from said first selected bitmapped data area to form a reduced selected bitmapped data area, wherein said at least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area; and

(t) displaying an altered polygonal bounding box around said reduced said at least one portion of text.

7. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 6 wherein step (n) further comprises step (n1), step (o) further comprises step (o1), and step (f) further comprises step (p1):

(n1) when said second beginning line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said second beginning line of at least two pixels in said different color from said current background color for said all of said at least one background pixels;

(o1) when said second interim region of pixels contains at least one background pixel, displaying all of said at least one background pixels from said second interim region of pixels in said different color from said current background color for said all of said at least one background pixels; and

(p1) when said second ending line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said second ending line of at least two pixels in said different color from said current background color for said all of said at least one background pixels.

8. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 4 further comprising the steps of:

(i) displaying a polygonal bounding box around said at least one portion of text.

9. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 8 further comprising the steps of:

(j) receiving a second input in said computer system to activate an un-highlight mode of said user interface high-lighter method;

(k) receiving a second button down input from said graphical input device from within said at least one portion of text, wherein said second button down input identifies, from a second starting location of said high-lighter icon displayed on said monitor, a second beginning line of at least two pixels within said at least one portion of text;

(l) receiving a second button drag input from said graphical input device from within said at least one portion of text, wherein said second button drag input identifies, from a second interim movement of said high-lighter icon displayed on said monitor, a second interim region of pixels within said at least one portion of text;

(m) receiving a second button up input from said graphical input device from within said at least one portion of text, wherein said second button up input identifies, from a second ending location of said high-lighter icon displayed on said monitor, a second ending line of at least two pixels within said at least one portion of text, wherein said second beginning line of at least two pixels, said second interim region of pixels, and said second ending line of at least two pixels comprise a second highlight area;

(n) receiving said second highlight area as a second data input for said image processing routine;

(o) processing, by said image processing routine, a second portion of bitmapped data represented by said second data input to determine a second selected portion of bitmapped data contained within said first selected bitmapped data area;

(p) deleting said second selected portion of bitmapped data from said first selected bitmapped data area to form a reduced selected bitmapped data area, wherein said at least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area; and

(q) displaying an altered polygonal bounding box around said reduced said at least one portion of text.

10. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 9 wherein step (n) further comprises step (n1), step (o) further comprises step (o1), and step (f) further comprises step (p1):

(k1) when said second beginning line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said second beginning line of at least two pixels in said current background color for said all of said at least one background pixels;

(l1) when said second interim region of pixels contains at least one background pixel, displaying all of said at least one background pixels from said second interim region of pixels in said current background color for said all of said at least one background pixels; and

(m1) when said second ending line of at least two pixels contains at least one background pixel, displaying all of said at least one background pixels from said second ending line of at least two pixels in said current background color for said all of said at least one background pixels.

11. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 further comprising the steps of:

(i) repeating steps (d) through (f) for receiving a second button down input from said graphical input device identifying, from a second starting location of said high-lighter icon displayed on said monitor, a second beginning line of at least two pixels, receiving a second button drag input from said graphical input device identifying, from a second interim movement of said high-lighter icon displayed on said monitor, a second interim region of pixels, and receiving a second button up input identifying, from a second ending location of said high-lighter icon displayed on said monitor, a second ending line of at least two pixels, within said at least one region of text, wherein said second beginning line of at least two pixels, said second interim region of pixels, and said second ending line of at least two pixels comprise a second highlight area; and

(j) repeating steps (g) and (h), receiving said second highlight area as a second data input for said image processing routine, wherein said processing by said image processing routine of a second portion of bitmapped data represented by said second data input determines a second selected portion of bitmapped data, wherein said second selected portion of bitmapped data represents a next portion of text from said at least one region of text within said scanned image.

12. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 further comprising the steps of:

(i) receiving a second input in said computer system to perform an optimized re-scan of said at least one portion of text from said at least one region of text within said scanned image;

(j) performing, with scanner software loaded into a memory in said computer system, said optimized re-scan of said at least one portion of text from said at least one region of text within said scanned image; and

(k) displaying a result of said optimized re-scan in said monitor.

13. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 1 wherein said graphical input device is a mouse.

14. A user interface high-lighter method, within a computer system, for selecting at least one portion of text comprising the steps of:

(a) displaying, on a monitor connected to said computer system, a scanned image containing at least one region of text;

(b) receiving a first input in said computer system to activate said user interface high-lighter method;

(c) displaying, in said monitor, a high-lighter icon in place of a cursor for a graphical input device, wherein said graphical input device is connected to said computer system;

(d) receiving a first button down, button drag, and button up input from said graphical input device, wherein said high-lighter icon, further comprising an active edge, is moved by said graphical input device within said at least one region of text, and further wherein a first plurality of pixels are traversed by said active edge of said high-lighter icon from said first button down, button drag, and button up input associated with said moving by said graphical input device;

(e) receiving a first select input to select said first plurality of pixels as a first data input for an image processing routine; and

(f) processing, by said image processing routine, a first portion of bitmapped data represented by said first plurality of pixels to select said at least one portion of text from said at least one region of text within said scanned image.

15. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 wherein step (a) further comprises step (a0) performed before step (a):

(a0) scanning at least one document with a scanner device connected to said computer system, wherein said scanning of said at least one document produces said scanned image containing said at least one region of text displayed on said monitor, and further wherein said scanned image is a variable resolution preview scan of said at least one document.

16. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 wherein step (d) further comprises step (d1):

(d1) displaying in said monitor a first plurality of background pixels within said first plurality of pixels in a different color from a current background color for said first plurality of background pixels.

17. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 16 further comprising the steps of:

(g) displaying said first plurality of background pixels within said first plurality of pixels in said current background color; and

(h) displaying a polygonal bounding box around said at least one portion of text.

18. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 17 further comprising the steps of:

(i) receiving a second input in said computer system to activate an un-highlight mode of said user interface high-lighter method;

(j) receiving a second button down, button drag, and button up input from moving said graphical input device within said at least one portion of text, wherein a second plurality of pixels are traversed by said active edge of said high-lighter icon from said second button down, button drag, and button up input associated with said moving of said graphical input device;

(k) receiving said second plurality of pixels as a second data input for said image processing routine;

(l) processing, by said image processing routine, a second portion of bitmapped data represented by said second plurality of pixels to select a portion of said at least one portion of text;

(m) deleting said second portion of bitmapped data from said first portion of bitmapped data to form a reduced selected bitmapped data area, wherein said at least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area; and

(n) displaying an altered polygonal bounding box around said reduced said at least one portion of text.

19. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 18 wherein step (j) further comprises step (j1):

(j1) displaying in said monitor a second plurality of background pixels within said second plurality of pixels in said different color from said current background color for said second plurality of background pixels.

20. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 16 further comprising the step of:

(g) displaying a polygonal bounding box around said at least one portion of text.

21. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 20 further comprising the steps of:

(h) receiving a second input in said computer system to activate an un-highlight mode of said user interface high-lighter method;

(i) receiving a second button down, button drag, and button up input from moving said graphical input device within said at least one portion of text, wherein a second plurality of pixels are traversed by said active edge of said high-lighter icon from said second button down, button drag, and button up input associated with said moving of said graphical input device;

(j) receiving said second plurality of pixels as a second data input for said image processing routine;

(k) processing, by said image processing routine, a second portion of bitmapped data represented by said second plurality of pixels to select a portion of said at least one portion of text;

(l) deleting said second portion of bitmapped data from said first portion of bitmapped data to form a reduced selected bitmapped data area, wherein said at least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area; and

(m) displaying an altered polygonal bounding box around said reduced said at least one portion of text.

22. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 21 wherein step (i) further comprises the step (i1):

(i1) displaying in said monitor a second plurality of background pixels within said second plurality of pixels in said current background color.

23. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 wherein said first button down, button drag, and button up input further comprises a first button down input, a first button drag input, and a first button up input, and step (d) further comprises steps (d1) through (d3):

(d1) identifying, from a first starting location on said monitor with said active edge of said high-lighter icon from said first button down input, a first beginning line of at least two pixels of said plurality of pixels;

(d2) identifying, from a first interim movement on said monitor with said active edge of said high-lighter icon from said first button drag input, a first interim region of pixels of said plurality of pixels; and

(d3) identifying, from a first ending location on said monitor with said active edge of said high-lighter icon from said first button up input, a first ending line of at least two pixels of said plurality of pixels.

24. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 further comprising the steps of.

(g) repeating steps (d) and (e) for receiving a second button down, button drag, and button up input from said graphical input device, wherein a second plurality of pixels are traversed by said active edge of said high-lighter icon, and receiving a second select input to select said second plurality of pixels as a second data input for said image processing routine;

and

(h) repeating step (f), wherein said processing by said image processing routine of a second portion of bitmapped data represented by said second plurality of pixels selects a next portion of text from said at least one region of text within said scanned image.

25. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 further comprising the steps of:

(g) receiving a second input in said computer system to perform an optimized re-scan of said at least one portion of text from said at least one region of text within said scanned image;

(h) performing, with scanner software loaded into a memory in said computer system, said optimized re-scan of said at least one portion of text from said at least one region of text within said scanned image; and

(i) displaying a result of said optimized re-scan in said monitor.

26. A user interface high-lighter method, within a computer system, for selecting at least one portion of text according to claim 14 wherein said graphical input device is a mouse.

27. A system for selecting at least one portion of text, said system comprising:

a computer system for receiving a first input to activate a user interface high-lighter function;

a scanner device, connected to said computer system, for scanning at least one document placed in a position to be scanned by said scanner device;

a graphical input device connected to said computer system; and

a monitor, connected to said computer system, for displaying a scanned image of said at least one document from said scanner device, wherein said scanned image contains at least one region of text, and for displaying a high-lighter icon in place of a cursor for said graphical input device, wherein said high-lighter icon has an active edge;

wherein, said computer system receives a first button down, button drag, and button up input from said graphical input device moving said high-lighter icon within said at least one region of text, and further wherein said computer system processes, by an image processing routine, a first portion of bitmapped data represented by a first plurality of pixels, wherein said first plurality of pixels are traversed by said active edge of said high-lighter icon from said first button down, button drag, and button up input associated with said moving of said high-lighter icon within said at least one region of text, generating a first selected bitmapped data area, wherein said at least one portion of text from said at least one region of text within said scanned image is represented by said first selected bitmapped data area.

28. A system for selecting at least one portion of text according to claim 27 wherein said scanned image is a variable resolution preview scan of said at least one document.

29. A system for selecting at least one portion of text according to claim 27 wherein a first plurality of background pixels within said first plurality of pixels are displayed in said monitor in a different color from a current background color for said first plurality of background pixels.

30. A system for selecting at least one portion of text according to claim 29 wherein after said processing by said image processing routine, said first plurality of background pixels within said first plurality of pixels are displayed in said current background color, and further wherein a polygonal bounding box is displayed around said at least one portion of text.

31. A system for selecting at least one portion of text according to claim 30 wherein said computer system receives a second input to activate an un-highlight mode of said user interface high-lighter method, wherein when said active edge of said high-lighter icon is moved over a portion of said at least one portion of text within said polygonal bounding box traversing a second plurality of pixels from a second button down, button drag, and button up input, said image processing routine processes a second portion of bitmapped data derived from said second plurality of pixels, and further wherein a second selected bitmapped data area generated from said processing of said second portion of bitmapped data is deleted from said first portion of bitmapped data, forming a reduced selected bitmapped data area, wherein said di least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area, and further wherein an altered polygonal bounding box is displayed around said reduced said at least one portion of text.

32. A system for selecting at least one portion of text according to claim 31 wherein a second plurality of background pixels within said second plurality of pixels are displayed in said monitor in said different color from said current background color for said second plurality of background pixels.

33. A system for selecting at least one portion of text according to claim 29 wherein a polygonal bounding box is displayed around said at least one portion of text.

34. A system for selecting at least one portion of text according to claim 33 wherein said computer system receives a second input to activate an un-highlight mode of said user interface high-lighter method, wherein when said active edge of said high-lighter icon is moved over a portion of said at least one portion of text within said polygonal bounding box traversing a second plurality of pixels from a second button down, button drag, and button up input, said image processing routine processes a second portion of bitmapped data derived from said second plurality of pixels, and further wherein a second selected bitmapped data area generated from said processing of said second portion of bitmapped data is deleted from said first portion of bitmapped data, forming a reduced selected bitmapped data area, wherein said at least one portion of text is reduced to form a reduced said at least one portion of text from said at least one region of text within said scanned image, and further wherein said reduced said at least one portion of text is represented by said reduced selected bitmapped data area, and further wherein an altered polygonal bounding box is displayed around said reduced said at least one portion of text.

35. A system for selecting at least one portion of text according to claim 34 wherein a second plurality of background pixels within said second plurality of pixels are displayed in said monitor in said current background color.

36. A system for selecting at least one portion of text according to claim 27 wherein a second button down, button drag, and button up input is received from said graphical input device, wherein a second plurality of pixels are traversed by said active edge of said high-lighter icon, and further wherein said image processing routine processes a second portion of bitmapped data represented by said second plurality of pixels to select a next portion of text from said at least one region of text within said scanned image.

37. A system for selecting at least one portion of text according to claim 27 wherein said first button down, button drag, and button up input further comprises a first button down input, a first button drag input, and a first button up input, and further wherein said first button down input identifies, from a first starting location on said monitor with said active edge of said high-lighter icon, a first beginning line of at least two pixels of said plurality of pixels, and further wherein said first button drag input identifies, from a first interim movement on said monitor with said active edge of said high-lighter icon, a first interim region of pixels of said plurality of pixels, and further wherein said first button up input identifies, from a first ending location on said monitor with said active edge of said high-lighter icon, a first ending line of at least two pixels of said plurality of pixels.

38. A system for selecting at least one portion of text according to claim 27 further comprising scanner software loaded into a memory of said computer system, wherein said scanner software performs an optimized re-scan of said at least one portion of text from said at least one region of text within said scanned image, and further wherein a result of said optimized re-scan is displayed in said monitor.

39. A system for selecting at least one portion of text according to claim 27 wherein said graphical input device is a mouse.