Method and system for scanning images in a photo kiosk

• US RE42,881 E1
• Filed: 09/13/2006
• Issued: 11/01/2011
• Est. Priority Date: 09/11/1998
• Status: Expired due to Term

• Current Assignee: Callstat Solutions LLC (Jeffrey M. Gross)
• Original Assignee: Intellectual Ventures I LLC (Intellectual Ventures LLC)
• Inventors: Bossut, Phillippe Joseph Ghislain, Vallmajo, Patrice
• Primary Examiner(s): Lee; Cheukfan
• Application Number:
  US11/521,620
• Time in Patent Office: 1,875 Days
• Field of Search: 358/488, 358/486, 358/478, 358/401, 358/444, 358/452, 358/453, 358/464, 358/465, 358/448, 358/296, 358/506, 358/505, 382/199, 382/289, 382/195, 382/206, 382/205, 382/286, 382/319, 382/318, 382/260, 382/266, 382/283, 382/282, 382294-296
• US Class Current: 358/488
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00135 Scanning of a photographic original
• CPC Class Codes: H04N 1/00167 Processing or editing H04N1/00196 - H04N1/00201 take precedence
• CPC Class Codes: H04N 1/00188 Printing, e.g. prints or reprints H04N1/0019, H04N1/00196 take precedence
• CPC Class Codes: H04N 1/00286 with studio circuitry, devices or equipment, e.g. television cameras television studio circuitry, devices or equipment per se H04N5/222
• CPC Class Codes: H04N 1/00289 in a video photo booth or the like
• CPC Class Codes: H04N 1/3873 defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
• CPC Class Codes: H04N 1/3877 Image rotation
• CPC Class Codes: H04N 2201/0416 Performing a pre-scan

Abstract

A method and system for determining the orientation of an image of a picture within a scanned image, including the steps of locating in the scanned image the contour of the image of the picture, determining a plurality of bounding boxes confining the contour of the image of the picture, selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture, and calculating an angle of rotation of the picture based on the selected bounding box.

Claims

1. A method for determining the orientation of an image of a picture within a scanned image, comprising the steps of:

locating in the scanned image a contour of the image of the picture;

determining a plurality of bounding boxes confining the contour of the image of the picture;

selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and

calculating an angle of rotation of the picture based on the selected bounding box.

2. The method of claim 1 and also including the step of applying edge detection to the scanned image, to locate edges of the image of the picture.

3. The method of claim 2 wherein the edge detection includes use of a Gaussian filter.

4. The method of claim 2 wherein the edge detection includes use of a Laplace filter.

5. The method of claim 2 wherein the edge detection includes use of a Laplacian of Gaussian filter.

6. The method of claim 2 and also including the step of identifying a bounding area of pixel locations that surrounds the image of the picture.

7. The method of claim 6 and also including the step of pre-scanning the picture at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding area of pixel locations.

8. The method of claim 6 wherein said locating step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area that are nearest to the border of the bounding area.

9. The method of claim 1 wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

10. The method of claim 1 wherein said determining step comprises:

providing a reference box; and

rotating the reference box about its center through multiple angles of rotation.

11. The method of claim 10 wherein said providing step comprises:

finding a region that bounds the contour of the image of the picture; and

generating a box that encloses within it a circle, the circle being large enough to enclose the region.

12. The method of claim 11 wherein the center of the circle is coincident with the center of the reference box.

13. The method of claim 11 wherein the center of the reference box is coincident with the centroid of the image of the picture.

14. The method of claim 1 wherein said selecting step includes:

determining for each of the bounding boxes an average distance between the bounding box and the contour of the image of the picture; and

choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.

15. The method of claim 14 wherein said choosing step includes choosing a bounding box for which the average distance between the bounding box and the contour of the image of the picture is smallest among the respective average distances between the plurality of bounding boxes and the contour of the image of the picture.

16. A method for operating a scanner, comprising:

detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner;

scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures; and

automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and

identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, such that identifying bounding areas includes,

initializing a plurality of expandable groups of pixel locations;

expanding each of the expandable groups of pixel locations until none of the pixel locations on its boundary are situated at edges.

17. The method of claim 16 wherein the edge detection includes use of a Gaussian filter.

18. The method of claim 16 wherein the edge detection includes use of a Laplace filter.

19. The method of claim 16 wherein the edge detection includes use of a Laplacian of Gaussian filter.

20. The method of claim 16 and also including the step of pre-scanning the plurality of pictures at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding areas.

21. The method of claim 16 further comprising the step of coalescing two expandable groups of pixel locations when they overlap as a result of said expanding step.

22. The method of claim 16 further comprising the steps of:

determining a separation between two expandable groups of pixel locations; and

coalescing the two expandable groups of pixel locations when their separation is smaller than a prescribed threshold.

23. A method for operating a scanner, comprising:

detecting that a user has placed a plurality of pictures in arbitrary orientations on a scanner bed of the scanner;

scanning the plurality of pictures to generate a scanned image containing a plurality of images of the pictures;

automatically determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

applying edge detection to the scanned image to locate edges of the plurality of images of the pictures, and

identifying bounding areas of pixel locations for each image of a picture from among the plurality of images of pictures, each bounding area surrounding one image of a picture from among the plurality of images of pictures, wherein said automatically determining the orientation comprises, for each image of a picture from among the plurality of images of pictures, the steps of;

detecting a contour of the image of the picture;

determining a plurality of bounding boxes enclosing the contour of the image of the picture;

selecting one of the plurality of bounding boxes that is substantially aligned with the contour of the image of the picture; and

calculating an angle of rotation of the picture based on the selected bounding box.

24. The method of claim 23 wherein each of the plurality of bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

25. The method of claim 23 wherein said detecting step comprises locating pixel locations situated at edges of the image of the picture and within the bounding area of the image of the picture that are nearest to the border of the bounding area.

26. The method of claim 23 wherein said determining step comprises:

providing a reference box; and

rotating the reference box about its center through multiple angles of rotation.

27. The method of claim 26 wherein said providing step comprises:

finding a region that bounds the contour of the image of the picture; and

generating a reference box that encloses within it a circle, the circle being large enough to enclose the region.

28. The method of claim 27 wherein the center of the circle is coincident with the center of the center of the reference box.

29. The method of claim 27 wherein the center of the box is coincident with the centroid of the picture.

30. The method of claim 23 wherein said selecting step includes:

determining for each of the bounding boxes, an average distance between the bounding box and the contour of the image of the picture; and

choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.

31. The method of claim 30 wherein said choosing step includes choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is smallest among the respective average distances between the bounding boxes and the contour of the image of the picture.

32. A system for determining the orientation of an image of a picture within a scanned image, comprising:

an image processor locating in the scanned image a contour of the image of the picture;

a box generator determining a plurality of bounding boxes confining the contour of the image of the picture;

a box processor selecting one of the plurality of bounding boxes that is significantly aligned with the contour of the image of the picture; and

an angle processor calculating an angle of rotation of the picture based on the selected bounding box.

33. An apparatus, comprising:

means for locating in the scanned image a contour of the image of the picture;

means for determining one or more bounding boxes confining the contour of the image of the picture;

means for selecting one of the bounding boxes that is substantially aligned with the contour of the image of the picture; and

means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.

34. An apparatus as claimed in claim 33, further comprising means for applying edge detection to the scanned image, to locate edges of the image of the picture.

35. An apparatus as claimed in claim 34, wherein said means for applying edge detection comprises a Gaussian filter.

36. An apparatus as claimed in claim 34, said means for applying edge detection comprises a Laplace filter.

37. An apparatus as claimed in of claim 34, said means for applying edge detection comprises a Laplacian of Gaussian filter.

38. An apparatus as claimed in claim 34, further comprising means for identifying a bounding area of pixel locations that surrounds the image of the picture.

39. An apparatus as claimed in claim 38, further comprising means for pre-scanning the picture at a low resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding area of pixel locations.

40. An apparatus as claimed in claim 38, said means for locating comprises means for locating pixel locations situated at edges of the image of the picture and within the bounding area that are nearest to the border of the bounding area.

41. An apparatus as claimed in claim 33, wherein one or more of the bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

42. An apparatus as claimed in claim 33 wherein said means for determining comprises:

means for providing a reference box; and

means for rotating the reference box about its center through multiple angles of rotation.

43. An apparatus as claimed in claim 42 wherein said means for providing comprises:

means for finding a region that bounds the contour of the image of the picture; and

means for generating a box that encloses within it a circle, the circle being large enough to enclose the region.

44. An apparatus as claimed in claim 43, wherein the center of the circle is coincident with the center of the reference box.

45. An apparatus as claimed in claim 43, wherein the center of the reference box is coincident with the centroid of the image of the picture.

46. An apparatus as claimed in claim 33, said means for selecting comprising:

means for determining for one or more of the bounding boxes an average distance between the bounding box and the contour of the image of the picture; and

means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is small as compared to the respective average distances between others of the plurality of bounding boxes and the contour of the image of the picture.

47. An apparatus as claimed in claim 46 wherein said means for choosing comprises means for choosing a bounding box for which the average distance between the bounding box and the contour of the image of the picture is smallest among the respective average distances between the one or more bounding boxes and the contour of the image of the picture.

48. An apparatus, comprising:

means for detecting that a user has placed one or more pictures in arbitrary orientations on a scanner bed of a scanner;

means for scanning the one or more pictures to generate a scanned image containing one or more images of the pictures; and

means for determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

means for applying edge detection to the scanned image to locate edges of the one or more images of the pictures, and

means for identifying bounding areas of pixel locations for one or more image of a picture from among the one or more images of pictures, one or more bounding area surrounding one image of a picture from among the one or more images of pictures, such that said means for identifying bounding areas comprises;

means for initializing one or more expandable groups of pixel locations;

means for expanding one or more of the expandable groups of pixel locations until none, or nearly none, of the pixel locations on its boundary are situated at edges.

49. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Gaussian filter.

50. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Laplace filter.

51. An apparatus as claimed in claim 48, said means for applying edge detection comprising a Laplacian of Gaussian filter.

52. An apparatus as claimed in claim 48, further comprising means for pre-scanning the one or more pictures at a lower resolution to obtain a pre-scanned image, and wherein the pre-scanned image is used to identify the bounding areas.

53. An apparatus as claimed in claim 48, further comprising means for coalescing two or more expandable groups of pixel locations when the two or more expandable groups at least partially overlap as a result of said means for expanding.

54. An apparatus as claimed in claim 48, further comprising:

means for determining a separation between two or more expandable groups of pixel locations; and

means for coalescing the two or more expandable groups of pixel locations when their separation is smaller than a prescribed threshold.

55. An apparatus, comprising:

means for detecting that a user has placed one or more pictures in arbitrary orientations on a scanner bed of the scanner;

means for scanning the one or more pictures to generate a scanned image containing one or more images of the pictures;

means for determining an orientation of at least one of the images of the pictures relative to the scanner bed using the scanned image;

means for applying edge detection to the scanned image to locate edges of the one or more images of the pictures, and

means for identifying bounding areas of pixel locations for one or more image of a picture from among the one or more images of pictures, one or more bounding area surrounding one image of a picture from among the one or more images of pictures, wherein said means for determining the orientation comprises;

means for detecting a contour of the image of the picture;

means for determining a one or more bounding boxes enclosing the contour of the image of the picture;

means for selecting one of the one or more bounding boxes that is substantially aligned with the contour of the image of the picture; and

means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.

56. An apparatus as claimed in claim 55, wherein one or more of the bounding boxes is associated with an angle, and wherein the positioning angle is the angle associated with the selected bounding box.

57. An apparatus as claimed in claim 55, said means for detecting comprising means for locating pixel locations situated at edges of the image of the picture and within the bounding area of the image of the picture that are nearest to the border of the bounding area.

58. An apparatus as claimed in claim 55, said means for determining comprising:

means for providing a reference box; and

means for rotating the reference box about its center through multiple angles of rotation.

59. An apparatus as claimed in claim 58, said means for providing comprising:

means for finding a region that bounds the contour of the image of the picture; and

means for generating a reference box that encloses within it a circle, the circle being large enough to enclose the region.

60. An apparatus as claimed in claim 59, wherein the center of the circle is coincident with the center of the center of the reference box.

61. An apparatus as claimed in claim 59, wherein the center of the box is coincident with the centroid of the picture.

62. An apparatus as claimed in claim 55, said means for selecting comprising:

means for determining for one or more of the bounding boxes, an average distance between the bounding box and the contour of the image of the picture; and

means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is relatively small as compared to the respective average distances between others of the one or more bounding boxes and the contour of the image of the picture.

63. An apparatus as claimed in claim 62, said means for choosing comprising means for choosing a bounding box for which the average distance between the chosen bounding box and the contour of the image of the picture is smallest, or nearly smallest, among the respective average distances between the bounding boxes and the contour of the image of the picture.

64. An apparatus, comprising:

means for locating in a scanned image a contour of the image of a picture;

means for determining one or more bounding boxes confining the contour of the image of the picture;

means for selecting one or more of the bounding boxes that is significantly aligned with the contour of the image of the picture; and

means for calculating an angle of rotation of the picture based at least in part on the selected bounding box.