Method and system for scanning images in a photo kiosk

• US 6,791,723 B1
• Filed: 03/17/1999
• Issued: 09/14/2004
• Est. Priority Date: 09/11/1998
• Status: Expired

• Current Assignee: Callstat Solutions LLC (Jeffrey M. Gross)
• Original Assignee: ROXIO Incorporated (MelodyVR Group Plc)
• Inventors: Vallmajo, Patrice, Bossut, Philippe Joseph Ghislain
• Primary Examiner(s): Lee, Cheukfan
• Application Number:
  US09/271,030
• Time in Patent Office: 2,008 Days
• Field of Search: 358/488, 358/401, 358/486, 358/296, 358/527, 358/474, 358/487, 358/506, 358/505, 358/448, 358/444, 382/199, 382/289, 382/195, 382/206, 382/205, 382/286, 382/319, 382/318, 382/260, 382/266, 382/283, 382/282, 382/294-296
• US Class Current: 358/488
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00135 Scanning of a photographic original
• CPC Class Codes: H04N 1/00167 Processing or editing H04N1/00196 - H04N1/00201 take precedence
• CPC Class Codes: H04N 1/00188 Printing, e.g. prints or reprints H04N1/0019, H04N1/00196 take precedence
• CPC Class Codes: H04N 1/00286 with studio circuitry, devices or equipment, e.g. television cameras television studio circuitry, devices or equipment per se H04N5/222
• CPC Class Codes: H04N 1/00289 in a video photo booth or the like
• CPC Class Codes: H04N 1/3873 defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
• CPC Class Codes: H04N 1/3877 Image rotation
• CPC Class Codes: H04N 2201/0416 Performing a pre-scan

Abstract

A method and system for determining the orientation of an image of a picture within a scanned image, including the steps of locating in the scanned image the contour of the image of the picture, determining a plurality of bounding boxes confining the contour of the image of the picture, selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture, and calculating an angle of rotation of the picture based on the selected bounding box.

Claims

1. A method for determining the orientation of an image of a picture within a scanned image, comprising the steps of:

locating in the scanned image a contour of the image of the picture;

determining a plurality of bounding boxes confining the contour of the image of the picture;

selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and

calculating an angle of rotation of the picture based on the selected bounding box.

2. The method of claim 1 and also including the step of applying edge detection to the scanned image, to locate edges of the image of the picture.

3. The method of claim 2 wherein the edge detection includes use of a Gaussian filter.

4. The method of claim 2 wherein the edge detection includes use of a Laplace filter.

5. The method of claim 2 wherein the edge detection includes use of a Laplacian of Gaussian filter.

6. The method of claim 2 and also including the step of identifying a bounding area of pixel locations that surrounds the image of the picture.

7. The method of claim 6 and also including the step of pre-scanning the picture at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding area of pixel locations.

8. The method of claim 6 wherein said locating step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area that are nearest to the border of the bounding area.

9. The method of claim 1 wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

10. The method of claim 1 wherein said determining step comprises:

providing a reference box; and

rotating the reference box about its center through multiple angles of rotation.

11. The method of claim 10 wherein said providing step comprises:

finding a region that bounds the contour of the image of the picture; and

generating a box that encloses within it a circle, the circle being large enough to enclose the region.

12. The method of claim 11 wherein the center of the circle is coincident with the center of the reference box.

13. The method of claim 11 wherein the center of the reference box is coincident with the centroid of the image of the picture.

14. The method of claim 1 wherein said selecting step includes:

determining for each of the bounding boxes an average distance between the bounding box and the contour of the image of the picture; and

choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.

15. The method of claim 14 wherein said choosing step includes choosing a bounding box for which the average distance between the bounding box and the contour of the image of the picture is smallest among the respective average distances between the plurality of bounding boxes and the contour of the image of the picture.

16. A method for operating a scanner, comprising:

detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner;

scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures; and

automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and

identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, such that identifying bounding areas includes,

initializing a plurality of expandable groups of pixel locations;

expanding each of the expandable groups of pixel locations until none of the pixel locations on its boundary are situated at edges.

17. The method of claim 16 wherein the edge detection includes use of a Gaussian filter.

18. The method of claim 16 wherein the edge detection includes use of a Laplace filter.

19. The method of claim 16 wherein the edge detection includes use of a Laplacian of Gaussian filter.

20. The method of claim 16 and also including the step of pre-scanning the plurality of pictures at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding areas.

21. The method of claim 16 further comprising the step of coalescing two expandable groups of pixel locations when they overlap as a result of said expanding step.

22. The method of claim 16 further comprising the steps of:

determining a separation between two expandable groups of pixel locations; and

coalescing the two expandable groups of pixel locations when their separation is smaller than a prescribed threshold.

23. A method for operating a scanner, comprising:

detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner;

scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures;

automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and

identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, wherein said automatically determining the orientation comprises, for each image of a picture from among the plurality of images of pictures, the steps of;

detecting a contour of the image of the picture;

determining a plurality of bounding boxes enclosing the contour of the image of the picture;

selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and

calculating an angle of rotation of the picture based on the selected bounding box.

24. The method of claim 23 wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

25. The method of claim 23 wherein said detecting step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area of the image of the picture that are nearest to the border of the bounding area.

26. The method of claim 23 wherein said determining step comprises:

providing a reference box; and

rotating the reference box about its center through multiple angles of rotation.

27. The method of claim 26 wherein said providing step comprises:

finding a region that bounds the contour of the image of the picture; and

generating a reference box that encloses within it a circle, the circle being large enough to enclose the region.

28. The method of claim 27 wherein the center of the circle is coincident with the center of the center of the reference box.

29. The method of claim 27 wherein the center of the box is coincident with the centroid of the picture.

30. The method of claim 23 wherein said selecting step includes:

determining for each of the bounding boxes, an average distance between the bounding box and the contour of the image of the picture; and

choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.

31. The method of claim 30 wherein said choosing step includes choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is smallest among the respective average distances between the bounding boxes and the contour of the image of the picture.

32. A system for determining the orientation of an image of a picture within a scanned image, comprising:

an image processor locating in the scanned image a contour of the image of the picture;

a box generator determining a plurality of bounding boxes confining the contour of the image of the picture;

a box processor selecting one of the plurality of bounding boxes that is significantly aligned with the contour of the image of the picture; and

an angle processor calculating an angle of rotation of the picture based on the selected bounding box.