Method and apparatus for object identification and location correlation based on received images

• US 9,569,693 B2
• Filed: 12/31/2014
• Issued: 02/14/2017
• Est. Priority Date: 12/31/2014
• Status: Active Grant

• Current Assignee: HERE Global B.V. (HERE Holding Corporation)
• Original Assignee: HERE Global B.V. (HERE Holding Corporation)
• Inventors: Anastassov, Anton, Giurgiu, Gavril Adrian, Jang, Dongwook
• Primary Examiner(s): Yentrapati, Avinash
• Application Number:
  US14/587,350
• Publication Number:
  US 20160189004A1
• Time in Patent Office: 776 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: G06V 30/422 Technical drawings; Geographical maps

Abstract

A method, apparatus and computer program product are provided for object identification and location correlation based on received images. A method is provided including receiving identity data associated with an object derived from one or more of a plurality of images determining an identity of an object in one or more of the plurality of images, receiving location information associated with a camera which captured the plurality of images, and correlating the identified object with a location for each of the respective images of the plurality of images.

Claims

1. A method comprising:

receiving identity data associated with an object derived from at least one image of a sequence of two or more images;

receiving location information associated with a camera which captured the sequence of images;

correlating the identified object with a location for a respective image of the sequence of images;

determining an edge of a field of view of the camera by which the identified object exits the field of view in the sequence of two or more images; and

determining a location offset of the identified object relative to the camera based on the determined edge of the field of view.

2. The method of claim 1, wherein respective images of the sequence of images are associated with a time stamp and the location information are associated with a time stamp, wherein the method further comprises:

determining a location of the object based on the time stamp associated with the location information and the time stamp associated with a respective image.

3. The method of claim 1, further comprising determining the identity of the object by applying pattern recognition to the at least one image.

4. The method of claim 1 further comprising:

determining a probable object location based on one or more correlated identified object locations.

5. The method of claim 4 further comprising:

updating or generating map data associated with the probable location of the object.

6. The method of claim 1 further comprising:

receiving the sequence of images including at least one object; and

determining an identity of an object in one or more of the sequence of images.

19. The method of claim 1, wherein determining the location offset further comprises:

determining the location offset based at least in part on a focal length associated with the determined edge of the field of view.

20. The method of claim 19, wherein the field of view comprises two or more edges, and wherein a location offset associated with one of the two or more edges is different from a location offset associated with another of the two or more edges.

7. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and computer program code configured to, with the processor, cause the apparatus to at least:

receive identity data associated with an object derived from at least one image of a sequence of two or more images;

receive location information associated with a camera which captured the sequence of images;

correlate the identified object with a location for a respective image of the sequence of images;

determine an edge of a field of view of the camera by which the identified object exits the field of view in the sequence of two or more images; and

determine a location offset of the identified object relative to the camera based on the determined edge of the field of view.

8. The apparatus of claim 7, wherein the respective images of the plurality of images include a time stamp and the location information includes a time stamp, wherein the at least one memory and the computer program code are further configured to:

determine a location of the object based on the time stamp associated with the location information and the time stamp associated with a respective image.

9. The apparatus of claim 7, wherein the apparatus is further caused to determine the identity of the object by applying pattern recognition to the at least one image.

10. The apparatus of claim 7, wherein the at least one memory and the computer program code are further configured to:

determine a probable object location based on one or more correlated identified object locations.

11. The apparatus of claim 10, wherein the at least one memory and the computer program code are further configured to:

update or generate map data associated with the probable location of the object.

12. The apparatus of claim 7, wherein the at least one memory and the computer program code are further configured to:

receive the sequence of images including at least one object; and

determine an identity of an object in one or more of the sequence of images.

13. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions configured to:

receive identity data associated with an object derived from at least one image of a sequence of two or more images;

receive location information associated with a camera which captured the sequence of images;

correlate the identified object with a location for a respective image of the sequence of images;

determine an edge of a field of view of the camera by which the identified object exits the field of view in the sequence of two or more images; and

determine a location offset of the identified object relative to the camera based on the determined edge of the field of view.

14. The computer program product of claim 13, wherein the respective images of the sequence of images include a time stamp and the location information includes a time stamp, wherein the computer-executable program code portions further comprise program code instructions configured to:

determine a location of the object based on the time stamp associated with the location information and the time stamp associated with the image.

15. The computer program product of claim 13, further comprising program code instructions to determine the identity of the object further comprises applying pattern recognition to the at least one image.

16. The computer program product of any of claim 13, wherein the computer-executable program code portions further comprise program code instructions configured to:

determine a probable object location based on one or more correlated identified object locations.

17. The computer program product of claim 16, wherein the computer-executable program code portions further comprise program code instructions configured to:

update or generate map data associated with the probable location of the object.

18. The computer program product of claim 13, wherein the computer-executable program code portions further comprise program code instructions configured to:

receive the sequence of images including at least one object; and

determine an identity of an object in one or more of the sequence of images.