ENROLLMENT APPARATUS, SYSTEM, AND METHOD FEATURING THREE DIMENSIONAL CAMERA

• US 20140351073A1
• Filed: 05/11/2012
• Published: 11/27/2014
• Est. Priority Date: 05/11/2011
• Status: Abandoned Application

• Current Assignee: Proiam LLC
• Original Assignee: Proiam LLC
• Inventors: Murphy, Mike, Yarin, Paul, Crosby, Will, Pearce, Wilson, Durbin, Mark, Metois, Eric
• Application Number:
  US14/116,978
• Publication Number:
  US 20140351073A1
• Time in Patent Office: Days
• US Class Current: 705/23
• CPC Class Codes: G01B 11/02 for measuring length, width or thickness G01B11/08 takes precedence
• CPC Class Codes: G01G 19/002 for postal parcels and letters
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 10/083 Shipping
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G07B 17/00661 Sensing or measuring mailpieces weighing G01G19/00
• CPC Class Codes: G07B 2017/00685 Measuring the dimensions of mailpieces
• CPC Class Codes: G07B 2017/00701 Measuring the weight of mailpieces

Abstract

An apparatus for enrolling a package is disclosed including: a receiving surface for receiving the package; at least one weight sensor in communication with the receiving surface which generates a weight signal indicative of the weight of the package; at least one RGB video camera which generates a first video signal indicative of an image of the package on the receiving surface; at least one infrared three-dimensional camera which generates a second video signal indicative of an the dimensions of the package; and a processor in communication with the at least one weight sensor and the at least one video camera.

Claims

1-35. -35. (canceled)

36. An apparatus for enrolling a package positioned on a receiving surface, the apparatus comprising:

at least one weight sensor in communication with the receiving surface which generates a weight signal indicative of the weight of the package;

a camera unit located to view the receiving surface, the camera unit comprising at least one three dimensional camera configured to obtain a depth image of at least a portion of the receiving surface; and

a processor in communication with the at least one weight sensor and the camera unit, the processor comprising;

a weight module which produces, in response to the weight signal, weight data indicative of the weight of the package; and

a dimension capture module which processes the depth image to produce dimension data indicative of the size of the package.

37. The apparatus of claim 36, wherein the dimension capture module is configured to process the depth image to generate dimension data comprising:

length and width dimension data indicative of the size of the package along two axes lying in a plane parallel to the receiving surface, and

height dimension data indicative of the size of the package along an axis transverse to the plane parallel to the receiving surface.

38. The apparatus of claim 37, wherein the camera unit further comprises a two dimensional camera, and wherein the dimension capture module is configured to:

determine, based on the height dimension data, if the height of the package is below a threshold height; and

if the height of the package is below the threshold height;

acquire at least one two dimensional image of the package using the two dimensional camera;

process the two dimensional image to determine secondary length and width dimension data indicative of the size of the package along two axes lying in a plane parallel to the receiving surface.

39. The apparatus of claim 38, wherein the dimension capture module is configured to:

further process the depth image based on the secondary length and width dimension data to determined refined height dimension data indicative of the size of the package along an axis transverse to the plane parallel to the receiving surface.

40. The apparatus of claim 39, wherein the dimension capture module is configured to:

use the secondary length and width dimension data to determine a region of the depth image corresponding to the location of the package; and

process the region of the depth image corresponding to the location of the package to determine the refined height dimension data.

41. The apparatus of claim 38, wherein the threshold is greater than a depth noise of the depth image.

42. The apparatus of claim 37, wherein the dimension capture module is configured to:

process the depth image to determine information indicative of a region of the image corresponding to a face of the package located closest to the camera unit.

43. The apparatus of claim 42, wherein the dimension capture module is configured to:

process the depth image to generate the dimension data based on the information indicative of a region of the image corresponding to a face of the package located closest to the camera unit.

44. The apparatus of claim 43, wherein the dimension capture module is configured to:

when processing the depth image to generate the dimension data based on the information indicative of a region of the image corresponding to a face of the package located closest to the camera unit, exclude at least a portion of the depth image located outside of the region of the image corresponding to a face of the package located closest to the camera unit.

45. The apparatus of claim 44, wherein the excluded portion of the of the depth image has a corresponding depth value within a threshold amount of the depth value corresponding to the region of the image corresponding to a face of the package located closest to the camera unit.

46. The apparatus of claim 36, wherein the three dimension camera is an infrared camera.

47. The apparatus of claim 36, wherein the two dimensional camera is a visible light camera.

48. The apparatus of claim 36, wherein the camera unit generates a video signal of the package on the receiving surface.

49. The apparatus of claim 48, wherein the dimension capture module comprises an edge finder module that produces, in response to a video signal from the camera unit, edge data indicative of the location of one or more edges of the package.

50. The apparatus of claim 48, wherein the dimension capture module comprises a frame differencing module which generates two dimensional difference images from two or more images of the video signal

51. The apparatus of claim 48, wherein the dimension capture module comprises a color masking module configured to generate information indicative of the presence or location of the package based on color information from the video signal.

52. The apparatus of claim 48, wherein the dimension capture module comprises a Hough transformation module that applies the Hough transformation to one or more images from the video signal, and analyzes the transformed images to determine information indicative of the size or location of edges on the package.

53. The apparatus of claim 48, wherein the video signal comprises at least one of:

a stream of depth images generated by the three dimensional camera, and

a stream of images from a two dimensional camera.

54. The apparatus of claim 36, comprising an integrated housing comprising the camera unit and the processor.

55. The apparatus of claim 36, wherein the camera unit is mounted on a support arm extending over the receiving surface.

56. The apparatus of claim 55, wherein the support arm extends between a proximal end connected to a housing comprising the receiving surface and a distal end positioned above the receiving surface, the distal end supporting the camera unit.

57. The apparatus of claim 36, wherein the at least one weight sensor comprises at least one selected from the list consisting of:

a load cell, a MEMs device, a piezoelectric device, a spring scale, and a balance scale.

58. The apparatus of claim 36, further comprising a postal meter in communication with the processor.

59. The apparatus of claim 36, further comprising:

a package management system, wherein the enrollment apparatus is in communication with the package management system to provide information indicative of the weight and size if the package.

60. The apparatus of claim 59, wherein the package management system comprises at least one chosen from the list consisting of:

a package delivery system, a supply chain management system, an inventory management system, and a chain of custody management system.

61. The apparatus of claim 59, wherein the package management system comprises a point of sale unit, and wherein the point of sale unit generates and displays, in response to the information from the enrollment apparatus, information indicative of one or more available service options.

62. The apparatus of claim 61, wherein the point of sale unit comprises:

an input unit for receiving information from a user; and

a service unit for providing information indicative of one or more available service options based on the information from the user and information from the enrollment apparatus.

63. The apparatus of claim 62, wherein the input unit receives a series of instructions from the user, and the service unit comprises a backwards chaining logic unit which dynamically determines and displays available service options based on the series of instructions and based information from the enrollment apparatus.

64. The apparatus of claim 59, wherein the package management system comprises a point of service unit, and further comprising a handler module for facilitating communication between the enrollment apparatus and the point of service unit.

65. A method of enrolling a package comprising:

providing an enrollment apparatus;

generating, by at least one weight sensor in communication with a receiving surface, a weight signal indicative of the weight of the package;

obtaining, by a camera unit comprising a three dimensional camera, a depth image of at least a portion of the receiving surface;

producing, by a weight module in response to the weight signal, weight data indicative of the weight of the package;

processing, by a dimension capture module, the depth image to produce dimension data indicative of the size of the package; and

outputting information indicative of the weight, and the size of the package.

66. The method of claim 65, wherein the dimension capture module is configured to process the depth image to generate dimension data comprising:

length and width dimension data indicative of the size of the package along two axes lying in a plane parallel to the receiving surface, and

height dimension data indicative of the size of the package along an axis transverse to the plane parallel to the receiving surface.

67. The method of claim 66, wherein the camera unit further comprises a two dimensional camera, and wherein the dimension capture module is configured to:

determine, based on the height dimension data, if the height of the package is below a threshold height; and

if the height of the package is below the threshold height;

acquire at least one two dimensional image of the package using the two dimensional camera;

process the two dimensional image to determine secondary length and width dimension data indicative of the size of the package along two axes lying in a plane parallel to the receiving surface.

68. The method of claim 67, wherein the dimension capture module is configured to:

further process the depth image based on the secondary length and width dimension data to determined refined height dimension data indicative of the size of the package along an axis transverse to the plane parallel to the receiving surface.

69. The method of claim 68, wherein the dimension capture module is configured to:

use the secondary length and width dimension data to determine a region of the depth image corresponding to the location of the package; and

process the region of the depth image corresponding to the location of the package to determine the refined height dimension data.

70. The method of claim 66, wherein the dimension capture module is configured to:

process the depth image to determine information indicative of a region of the image corresponding to a face of the package located closest to the camera unit.

71. The method of claim 70, wherein the dimension capture module is configured to:

process the depth image to generate the dimension data based on the information indicative of a region of the image corresponding to a face of the package located closest to the camera unit.

72. The method of claim 71, wherein the dimension capture module is configured to:

when processing the depth image to generate the dimension data based on the information indicative of a region of the image corresponding to a face of the package located closest to the camera unit, exclude at least a portion of the depth image located outside of the region of the image corresponding to a face of the package located closest to the camera unit.

73. The method of claim 72, wherein the excluded portion of the of the depth image has a corresponding depth value within a threshold amount of the depth value corresponding to the region of the image corresponding to a face of the package located closest to the camera unit.

74. The method of claim 65, wherein the camera unit generates a video signal of the package on the receiving surface.

75. The method of claim 74, wherein the dimension capture module comprises an edge finder module that produces, in response to a video signal from the camera unit, edge data indicative of the location of one or more edges of the package.

76. The method of claim 74, wherein the dimension capture module comprises a frame differencing module which generates two dimensional difference images from two or more images of the video signal

77. The method of claim 74, wherein the dimension capture module comprises a color masking module configured to generate information indicative of the presence or location of the package based on color information from the video signal.

78. The method of claim 74, wherein the dimension capture module comprises a Hough transformation module that applies the Hough transformation to one or more images from the video signal, and analyzes the transformed images to determine information indicative of the size or location of edges on the package.