System and method of object tracking using weight confirmation

• US 11,436,553 B2
• Filed: 09/08/2016
• Issued: 09/06/2022
• Est. Priority Date: 09/08/2016
• Status: Active Grant

• Current Assignee: Position Imaging, Inc.
• Original Assignee: Position Imaging, Inc.
• Inventors: Kirmani, Shahzad Farooq, Seiger, Alex
• Primary Examiner(s): Tungate, Scott M
• Application Number:
  US15/259,474
• Publication Number:
  US 20180068266A1
• Time in Patent Office: 2,189 Days
• CPC Class Codes: G01G 19/005 with electric or electronic computing means
• CPC Class Codes: G06K 7/10861 sensing of data fields affixed to objects or articles, e.g. coded labels postal sorting B07C3/14, conveying articles B65G47/48
• CPC Class Codes: G06Q 10/0833 Tracking

Abstract

Methods and systems for tracking an object comprise a horizontal surface upon which objects are to be placed, a weight sensor disposed on one side of the horizontal surface, and a processor in communication with the weight sensor. The processor is adapted to detect a change in weight measured by the weight sensor, to associate the detected weight change with an identified object and with a location on the horizontal surface, and to confirm whether a cause of the weight change at the location on the horizontal surface corresponds to a proper handling of the identified object.

Claims

1. A method for tracking an object, comprising:

capturing images of a surface;

obtaining identification information associated with an object;

expecting, in response to obtaining the identification information associated with the object, activity involving placement of the object on or removal of the object from the surface to appear next in the captured images;

associating a change in the captured images that is first to be detected after obtaining the identification information with the activity involving placement of the object on or removal of the object from the surface;

measuring a change in weight at a location on the surface;

comparing where on the surface the change appears in the captured images with the location on the surface where the change in weight is measured; and

confirming, in response to the comparison, that the activity involving placement of the object on or removal of the object from the surface has appeared next in the captured images, as expected, and has occurred on the surface where the change appears in the captured images.

2. The method of claim 1, further comprising:

associating a measured decrease in weight with a removal of the object from the location on the surface; and

determining the removal to be a proper handling of the object if the object is expected to be the next object removed from the surface, otherwise the considering the cause of the weight change to be an improper handling of the object.

3. The method of claim 1, further comprising:

associating a measured increase in weight with placement of die object at the location on the surface; and

determining the placement to be a proper handling if the object is expected to be the next object placed on the surface, otherwise determining the cause of the weight change to be an improper handling of the object.

4. The method of claim 1, further comprising:

determining an absence of the object on the surface where the change appears in the captured images, accompanied by a decrease in the measured weight, to correspond to a removal of the object from the surface; and

determining the removal to be a proper handling of the object if the object is expected to be the next object removed from the surface, otherwise determining the cause of the weight change to be an improper handling of the object.

5. The method of claim 1, further comprising:

determining a presence of the object on the surface where the change appears in the captured images, accompanied by an increase in the measured weight, to correspond to a placement of the object at the location on the surface; and

determining the placement to be a proper handling if the object is expected to be a next object placed on the surface, otherwise determining the cause of the weight change to be an improper handling of the object.

6. The method of claim 1, further comprising calculating an overall weight placed on the surface based on weight measured by a plurality of weight sensors disposed on one or more sides of the surface.

7. The method of claim 1, further comprising determining a distribution of weight on the surface based on weight measured by a plurality of weight sensors disposed on one or more sides of the surface.

8. The method of claim 1, further comprising adjusting the weight measured by a sensor to compensate for temperature.

9. The method of claim 1, wherein the step of confirming, in response to the weight change measured at the location on the surface, that the object placed on or removed from the surface was the object associated with the obtained identification information, comprises:

detecting, in the captured images, the object at a second location on the surface; and

matching the location of the measured change in weight with the second location of the detected object.

10. An object tracking system comprising:

a camera that captures images of a surface;

a scanning device that obtains identification information associated with an object;

a processor configured to;

obtain the identification information associated with the object from the scanning device;

expect, in response to obtaining the identification information associated with the object, activity involving placement of the object on or removal of the object from the surface to appear next in the captured images; and

associate a change in the captured images that is first to be detected after the processor obtains the identification information with the activity involving placement of the object on or removal of the object from the surface; and

a sensor that measures a change in weight at a location on the surface, wherein;

the processor further configured to;

compare where on the surface the change appears in the captured images with the location on the surface where the change in weight is measured; and

confirm, in response to the comparison, that the activity involving placement of the object on or removal of the object from the surface has appeared next in the captured images, as expected, and has occurred on the surface where the change appears in the captured images.

11. The object tracking system of claim 10, wherein the processor is adapted to:

associate a measured decrease in weight with a removal of the object from the location on the surface; and

determine the removal to be a proper handling of the object if the object is expected to be the next object removed from the surface, otherwise the processor is adapted to consider the cause of the weight change to be an improper handling of the object.

12. The object tracking system of claim 10, wherein the processor is adapted to:

associate a measured increase in weight with placement of the object at the location on the surface; and

determine the placement to be a proper handling if the object is expected to be the next object placed on the surface, otherwise the processor is adapted to consider the cause of the weight change to be an improper handling of the object.

13. The object tracking system of claim 10, wherein the processor is adapted to:

determine an absence of the object on the surface where the change appears in the captured images, accompanied by a decrease in the measured weight, to correspond to a removal of the object from the surface; and

determine the removal to be a proper handling of the object if the object is expected to be the next object removed from the surface, otherwise the processor is adapted to consider a cause of the weight change to be an improper handling of the object.

14. The object tracking system of claim 10, wherein the processor is adapted to:

determine a presence of the object on the surface where the change appears in the captured images, accompanied by an increase in the measured weight, to correspond to a placement of the object at the location on the surface; and

determine the placement to be a proper handling if the object is expected to be the next object placed on the surface, otherwise the processor is adapted to determine the cause of the weight change to be an improper handling of the object.

15. The object tracking system of claim 10, wherein the sensor comprises a plurality of weight sensors disposed on one or both sides of the surface, and wherein the processor is adapted to calculate an overall weight placed on the surface based on weight measured by the plurality of weight sensors.

16. The object tracking system of claim 10, wherein the sensor comprises a plurality of weight sensors disposed on one or both sides of the surface, and wherein the processor is adapted to determine a distribution of weight on the surface based on weight measured the plurality of weight sensors.

17. The object tracking system of claim 10, wherein the processor is adapted to adjust the weight measured by the sensor to compensate for temperature.

18. The object tracking system of claim 10, wherein the weight measurements confirm that the images are reliable.

19. The object tracking system of claim 10, further comprising a database of known packages that is updated by detected changes in the field of view of the camera, which locates and disregards registered packages while identifying new packages placed in the field of view.

20. The object tracking system of claim 10, wherein the surface is part of a shelf of a plurality of shelves, and the objects are packages placed on or removed from the shelf.

21. A method for tracking an object, comprising:

acquiring identification information associated with an object;

expecting, in response to acquiring the identification information associated with the object, activity involving placement of the object on or removal of the object from the surface to appear next in the captured images;

associating a change in the captured images that is first to be detected after acquiring the identification information with the activity involving placement of the object on or removal of the object from the surface;

comparing where on the surface the change appears in the captured images with the location on the surface where a change in weight is measured;

confirming, in response to the comparison, that the activity involving placement of the object on or removal of the object from the surface has appeared next in the captured images, as expected, and has occurred on the surface where the change appears in the captured images.