Computer user interface for manipulating image fragments using drag, drop and merge operations

• US 5,732,230 A
• Filed: 05/19/1995
• Issued: 03/24/1998
• Est. Priority Date: 05/19/1995
• Status: Expired due to Term

• Current Assignee: Ricoh Company Limited, Ricoh Corporation (Ricoh Company Limited)
• Original Assignee: Richo Company, Ltd.
• Inventors: Hart, Peter E., Peairs, Mark, Cullen, John F.
• Primary Examiner(s): Bayerl, Raymond J.
• Assistant Examiner(s): KATBAB, ABDOLLAH
• Application Number:
  US08/446,196
• Time in Patent Office: 1,040 Days
• Field of Search: 395/155, 395/157, 395/159, 395/161, 395/135, 395/339, 395/133, 395/138, 358/450
• US Class Current: 715/764
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image

Abstract

A system for manipulating image fragments so that image processing devices such as copiers, fax machines and scanners may efficiently process oversize images. The system provides a user interface so that when an oversize image is scanned in multiple parts to produce multiple image fragments the user can manipulate the image fragments by performing drag, drop and merge operations on the image fragments. Embodiments of the invention include the use of a touch screen or mouse to allow the user to perform the operations. Other operations are selectable such as rotating an image fragment, zooming in or out on portions of the displayed fragments, merging the fragments into an integrated image and storing or printing the image fragments.

Claims

1. A method for registering image fragments in a computer system, the computer system including a processor coupled to a user input device and display screen, the method comprising the following steps:

using the processor to display at least a portion of the first image fragment and at least a portion of the second image fragment simultaneously on the display screen;

accepting signals from the user input device to select the first image fragment displayed on the display screen;

dragging, in response to signals from the user input device, the first image fragment on the display screen to a new location;

dropping, in response to signals from the user input device, the first image fragment at the new location on the display screen so that a portion of the first image fragment is adjacent to and aligned with a portion of the second image fragment; and

merging, by using the processor, the first and second image fragments into a combined image by using the adjacency and alignment from the "dragging" step.

2. The method of claim 1, wherein the computer system is coupled to a scanning device, the method further comprising the steps of:

using the scanning device to input two or more image fragments of an original image into the computer system, wherein the first and second image fragments are fragments from the original image; and

wherein the step of merging includes the substep of registering the first and second image fragments into a combined image by using the adjacency and alignment from the "dragging" step so that the merged image closely approximates at least a portion of the original image.

3. The method of claim 1, wherein the user input device comprises a mouse having a button, the method further comprising the steps of:

wherein the step of "accepting signals from the user input device to select the first image" includes the substep of accepting signals from the mouse to select the first image; and

wherein the step of "dragging the first image fragment" includes the substep of accepting signals from the mouse to indicate a new position for the first image fragment on the display screen.

4. The method of claim 1, wherein the user input device comprises a touch screen, the method further comprising the steps of:

wherein the step of "accepting signals from the user input device to select the first image" includes the substep of accepting signals from the touch screen to select the first image; and

wherein the step of "dragging the first image fragment" includes the substep of accepting signals from the touch screen to indicate a new position for the first image fragment on the display screen.

5. The method of claim 2, wherein the computer system further comprises a printing device coupled to the processor for generating printed paper output, the method further comprising the steps of:

printing, by using the processor and merged image, a reproduction of at least a portion of the original image on one or more sheets of paper.

6. The method of claim 1, further comprising the step of:

making at least a portion of one or more of the image fragments transparent.

7. The method of claim 1, further comprising the step of:

enlarging the size of the image fragment on the display.

8. The method of claim 1, further comprising the step of:

using a polygonal outline to crop an image fragment.

9. The method of claim 1, further comprising the step of:

using an arbitrary outline to crop an image fragment.

10. A method for registering image fragments in a facsimile machine, wherein the machine includes a processor coupled to a user input device, memory and display screen, the method comprising the following steps:

storing two image fragments in the memory, wherein the image fragments are portions of a single original image;

using the processor to display at least a portion of the first image fragment and at least a portion of the second image fragment simultaneously on the display screen;

accepting signals from the user input device to select the first image fragment displayed on the display screen;

moving the first image fragment on the display screen according to the signals from the user obtained in the step of accepting signals so that a portion of the first image fragment is adjacent to, and aligned with, a portion of the second image fragment; and

registering, by using the processor, the first and second image fragments into a combined image that approximates at least a portion of the single original image, wherein the registering step uses the adjacency and alignment from the previous step.

11. The method of claim 10, wherein the facsimile machine includes a printing device, wherein the processor is further coupled to a communication line, the method further comprising the steps of:

receiving data defining the two image fragments over the communication line;

wherein the step of storing two image fragments in the memory includes the substep of storing the received data in the memory; and

using the printing device to output the combined image.

12. The method of claim 11, further comprising the steps of:

reducing the combined image so that the combined image, when printed, fits on a single sheet of paper.

13. The method of claim 10, wherein the processor is further coupled to a communication line, the method further comprising the step of:

transmitting the combined image over the communication line.

14. The method of claim 13, the method further comprising the step of:

reducing the combined image so that the image, when printed, fits on a single sheet of paper.

15. The method of claim 13, the method further comprising the step of:

transmitting information describing the relative positions of the first and second image fragments over the communication line.

16. A method for registering image fragments in a computer system, the computer system including a processor coupled to a memory, user input device, scanning device and display screen, the method comprising the following steps:

scanning an original document having an image shape to produce two or more image fragments, wherein the image fragments each include a part of the image shape;

inputing the two or more image fragments into the computer system;

using the processor to display the image fragments simultaneously on the display screen;

selecting an image fragment in response to signals from the user input device;

dragging the selected image fragment in response to signals from the user input device;

redisplaying the selected and moved image fragment at a new position on the display screen, wherein the new position shows the selected and moved image fragment adjacent to, and aligned with, one or more of the image fragments;

repeating the above selecting, dragging and redisplaying steps, to produce an orientation for the image fragments so that the image shape is displayed on the display screen; and

registering the image fragments by defining an integrated image that includes portions of the image fragments and the relative orientations of the image fragments as displayed on the display screen at the time the registration is made.

17. An apparatus for registering image fragments in a computer system, the apparatus comprising:

a processor;

a memory coupled to the processor;

a user input device coupled to the processor;

a display screen coupled to the processor;

a data input device for storing representations of two or more image fragments of an original image into the memory;

display means for displaying at least a portion of the first image fragment and at least a portion of the second image fragment simultaneously on the display screen;

selection means for accepting signals from the user input device to select the first image fragment displayed on the display screen;

redisplay means for moving the first image fragment on the display screen in response to signals from the user input device;

position determining means for generating one or more parameters describing the locations of the moved first image fragment relative to the second image fragment when the moved first image fragment is adjacent to, and aligned with, a portion of the second image fragment; and

registration means coupled to the redisplay means for receiving the parameters and for registering the first and second image fragments into a combined image based on the parameters.