Determining source lane of moving item merging into destination lane

• US 9,503,706 B2
• Filed: 09/10/2013
• Issued: 11/22/2016
• Est. Priority Date: 09/10/2013
• Status: Active Grant

• Current Assignee: Conduent Business Services, LLC (Conduent, Inc.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Loce, Robert P., Wu, Wencheng, Wade, Thomas F., Hann, Daniel S., Paul, Peter, Burry, Aaron M.
• Primary Examiner(s): Werner, David N
• Assistant Examiner(s): Hansell, Jr., Richard A
• Application Number:
  US14/022,488
• Publication Number:
  US 20150070471A1
• Time in Patent Office: 1,169 Days
• Field of Search: 348/47
• US Class Current: 1/1
• CPC Class Codes: G06Q 20/145 Payments according to the detected use or quantity
• CPC Class Codes: G06Q 20/38 Payment protocols; Details thereof
• CPC Class Codes: G06T 2207/30256 Lane; Road marking
• CPC Class Codes: G06T 7/285 using a sequence of stereo image pairs
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Methods and devices acquire images using a stereo camera or camera network aimed at a first location. The first location comprises multiple parallel primary lanes merging into a reduced number of at least one secondary lane, and moving items within the primary lanes initiate transactions while in the primary lanes and complete the transactions while in the secondary lane. Such methods and devices calculate distances of the moving items from the camera to identify in which of the primary lanes each of the moving items was located before merging into the secondary lane. These methods and devices then order the transactions in a merge order corresponding to a sequence in which the moving items entered the secondary lane from the primary lanes. Also, the methods and devices output the transactions in the merge.

Claims

1. An apparatus comprising:

a camera network comprising at least two imaging devices aimed at a first location, said imaging devices having field of views that are fixed, overlap said first location, and are positioned to obtain images of said first location from different angles to provide a stereo view of said first location, said first location comprising multiple parallel primary lanes merging into a reduced number of at least one secondary lane, and moving items within said primary lanes initiating transactions while in said primary lanes and completing said transactions while in said secondary lane;

a processor operatively connected to said camera network, said processor calculating distances of said moving items from said camera network based on differences between said images of each of said moving items obtained from said different angles to identify in which of said primary lanes each of said moving items was located before merging into said secondary lane, and said processor changes a transaction order by ordering said transactions in a merge order corresponding to a sequence in which said moving items entered said secondary lane from said primary lanes; and

an interface operatively connected to said processor, said interface outputting said transactions in said merge order.

2. The apparatus according to claim 1, said processor determining said sequence in which said moving items entered said secondary lane by detecting a relative position and relative distance of said moving items as said moving items pass said first location.

3. The apparatus according to claim 1, said processor calculating said distances of said moving items from a reference device of said imaging devices in said camera network by creating temporal depth profiles for each of said moving items that pass said first location.

4. The apparatus according to claim 1, said processor developing initial signature profile of said moving items comprising at least one of color, shape, height, and width of said moving items as said moving items pass said first location,

said apparatus further comprising a second camera at a second location of said secondary lane adjacent where said moving items complete said transactions,

said processor developing confirmation signature profile of said moving items comprising said at least one of color, shape, height, and width of said moving items as said moving items pass said second location,

said processor confirming said merge order before said interface outputs said transactions based on said confirmation signature profile matching said initial signature profile, and

said processor changing said merge order before said interface outputs said transactions based on said confirmation signature profile not matching said initial signature profile.

5. The apparatus according to claim 1, said processor calculating said distances when at least a portion of said moving items are within said first location.

6. The apparatus according to claim 1, said processor detecting a presence of said items within said first location based on at least one of motion detection and vision-based object recognition.

7. An apparatus comprising:

an optical stereo camera comprising multiple cameras aimed at a first location, said multiple cameras having field of views that are fixed, overlap said first location and are positioned to obtain images of said first location from different angles to provide a stereo view of said first location, said first location comprising multiple parallel primary lanes merging into a reduced number of at least one secondary lane, and moving items within said primary lanes initiating transactions while in said primary lanes and completing said transactions while in said secondary lane;

a processor operatively connected to said stereo camera, said processor calculating distances of said moving items from said stereo camera based on differences between images of each of said moving items obtained by said multiple cameras from said different angles to identify in which of said primary lanes each of said moving items was located before merging into said secondary lane, and said processor changes a transaction order by ordering said transactions in a merge order corresponding to a sequence in which said moving items entered said secondary lane from said primary lanes; and

an interface operatively connected to said processor, said interface outputting said transactions in said merge order.

8. The apparatus according to claim 7, said processor determining said sequence in which said moving items entered said secondary lane by detecting a relative position and relative distance of said moving items as said moving items pass said first location.

9. The apparatus according to claim 7, said processor calculating said distances of said moving items from said stereo camera by creating temporal depth profiles for each of said moving items that pass said first location.

10. The apparatus according to claim 7, said processor developing initial signature profile of said moving items comprising at least one of color, shape, height, and width of said moving items as said moving items pass said first location,

said apparatus further comprising a second stereo camera at a second location of said secondary lane adjacent where said moving items complete said transactions,

said processor developing confirmation signature profile of said moving items comprising said at least one of color, shape, height, and width of said moving items as said moving items pass said second location,

said processor confirming said merge order before said interface outputs said transactions based on said confirmation signature profile matching said initial signature profile, and

said processor changing said merge order before said interface outputs said transactions based on said confirmation signature profile not matching said initial signature profile.

11. The apparatus according to claim 7, said processor calculating said distances when at least a portion of said moving items are within said first location.

12. The apparatus according to claim 7, said processor detecting a presence of said items within said first location based on at least one of motion detection and vision-based object recognition.

13. An apparatus comprising:

an optical stereo camera comprising multiple cameras aimed at a first location, said multiple cameras having field of views that are fixed, overlap said first location and are positioned to obtain images of said first location from different angles to provide a stereo view of said first location, said first location comprising a horizontal surface having multiple parallel primary lanes merging into a reduced number of at least one secondary lane, said stereo camera being aimed in a horizontal direction parallel to said horizontal surface, and moving items within said primary lanes initiating transactions while in said primary lanes and completing said transactions while in said secondary lane;

a processor operatively connected to said stereo camera, said processor calculating distances of said moving items from said stereo camera in said horizontal direction based on differences between images of each of said moving items obtained by said multiple cameras from said different angles to identify in which of said primary lanes each of said moving items was located before merging into said secondary lane, and said processor changes a transaction order by ordering said transactions in a merge order corresponding to a sequence in which said moving items entered said secondary lane from said primary lanes; and

an interface operatively connected to said processor, said interface outputting said transactions in said merge order.

14. The apparatus according to claim 13, said processor determining said sequence in which said moving items entered said secondary lane by detecting a relative position and relative distance of said moving items as said moving items pass said first location.

15. The apparatus according to claim 13, said processor calculating said distances of said moving items from said stereo camera by creating temporal depth profiles for each of said moving items that pass said first location.

16. The apparatus according to claim 13, said processor developing initial signature profile of said moving items comprising at least one of color, shape, height, and width of said moving items as said moving items pass said first location,

said apparatus further comprising a second stereo camera at a second location of said secondary lane adjacent where said moving items complete said transactions,

said processor developing confirmation signature profile of said moving items comprising said at least one of color, shape, height, and width of said moving items as said moving items pass said second location,

said processor confirming said merge order before said interface outputs said transactions based on said confirmation signature profile matching said initial signature profile, and

said processor changing said merge order before said interface outputs said transactions based on said confirmation signature profile not matching said initial signature profile.

17. The apparatus according to claim 13, said processor calculating said distances when at least a portion of said moving items are within said first location.

18. The apparatus according to claim 13, said processor detecting a presence of said items within said first location based on at least one of motion detection and vision-based object recognition.

19. A method comprising:

acquiring images using an camera network comprising at least two imaging devices aimed at a first location, said imaging devices having field of views that are fixed, overlap said first location and are positioned to obtain images of said first location from different angles to provide a stereo view of said first location, said first location comprising multiple parallel primary lanes merging into a reduced number of at least one secondary lane, and moving items within said primary lanes initiating transactions while in said primary lanes and completing said transactions while in said secondary lane;

calculating distances of said moving items based on differences between said images of each of said moving items obtained from said different angles using a processor operatively connected to said camera network to identify in which of said primary lanes each of said moving items was located before merging into said secondary lane;

ordering said transactions in a merge order corresponding to a sequence in which said moving items entered said secondary lane from said primary lanes to change a transaction order, using said processor; and

outputting said transactions in said merge order using an interface operatively connected to said processor.

20. The method according to claim 19, further comprising determining said sequence in which said moving items entered said secondary lane by detecting a relative position and relative distance of said moving items as said moving items pass said first location, using said processor.

21. The method according to claim 19, further comprising calculating said distances of said moving items from said camera network by creating temporal depth profiles for each of said moving items that pass said first location, using said processor.

22. The method according to claim 19, further comprising:

developing initial signature profile of said moving items comprising at least one of color, shape, height, and width of said moving items as said moving items pass said first location at said first location, using said processor;

developing confirmation signature profile of said moving items comprising said at least one of color, shape, height, and width of said moving items as said moving items pass a second location of said secondary lane adjacent where said moving items complete said transactions, using said processor;

confirming said merge order before said interface outputs said transactions based on said confirmation signature profile matching said initial signature profile, using said processor; and

changing said merge order before said interface outputs said transactions based on said confirmation signature profile not matching said initial signature profile, using said processor.

23. The method according to claim 19, said processor calculating said distances when at least a portion of said moving items are within said first location.

24. The method according to claim 19, further comprising detecting a presence of said items within said first location based on at least one of motion detection and vision-based object recognition.