AUTOMATED TAGGING FOR LANDMARK IDENTIFICATION

• US 20110150348A1
• Filed: 12/17/2009
• Published: 06/23/2011
• Est. Priority Date: 12/17/2009
• Status: Active Grant

• Current Assignee: Deere & Company
• Original Assignee: Deere & Company
• Inventors: Anderson, Noel Wayne
• Granted Patent: US 8,340,438 B2
• Time in Patent Office: Days
• US Class Current: 382/224
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0251 extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593
• CPC Class Codes: G05D 1/0255 using acoustic signals, e.g. ultra-sonic singals sonar systems designed for anti-collision purposes G01S15/93
• CPC Class Codes: G05D 1/027 comprising intertial navigation means, e.g. azimuth detector inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165
• CPC Class Codes: G05D 1/0272 comprising means for registering the travel distance, e.g. revolutions of wheels measuring distance traversed on the ground by vehicles, e.g. using odometers G01C22/00
• CPC Class Codes: G05D 1/0274 using mapping information stored in a memory device navigation using map-matching G01C21/30
• CPC Class Codes: G06F 18/2178 based on feedback of a supervisor
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

The different illustrative embodiments provide a method for identifying landmarks in an image. An image of a worksite is received. The image is analyzed to determine a suggested identity of a worksite feature in the image. The suggested identity of the worksite feature is sent over a communications unit. A confirmation of the suggested identity of the worksite feature is received to form a confirmed identity. The confirmed identity and a number of attributes associated with the confirmed identity is stored in a database.

Claims

1. A method for identifying landmarks in an image, the method comprising:

receiving an image of a worksite;

analyzing the image to determine a suggested identity of a worksite feature in the image;

sending the suggested identity of the worksite feature over a communications unit;

receiving a confirmation of the suggested identity of the worksite feature to form a confirmed identity; and

storing the confirmed identity and a location associated with the worksite feature in a database.

2. The method of claim 1, wherein the image is received from an environmental data collection system which is moved to a plurality of environment data collection locations by at least one of an autonomous vehicle, a human, an animal, or a human controlled vehicle.

3. The method of claim 1, wherein the confirmation of the suggested identity of the worksite feature is received from a user via a user interface.

4. The method of claim 1, wherein the worksite feature is at least one of a landmark, vegetation, structure, wildlife, or building.

5. The method of claim 1, further comprising:

associating the confirmed identity and a number of attributes for the worksite feature with the location on a worksite map.

6. The method of claim 1, wherein analyzing the image to determine the suggested identity of the worksite feature in the image further comprises:

obtaining a number of worksite images;

identifying a common feature in at least two of the number of worksite images; and

identifying a relative location of the common feature identified in the at least two of the number of worksite images.

7. The method of claim 6, further comprising:

determining whether scaling information is available for the common feature identified; and

responsive to a determination that scaling information is available, applying the scaling information to provide distance information on the worksite and a size of the common feature.

8. A system for identifying landmarks in an image, the system comprising:

a worksite features database;

a user interface; and

a data processing system configured to execute a data classification process to analyze an image, determine a suggested identity of a worksite feature in the image using the worksite features database, send the suggested identity of the worksite feature over a communications unit, receive a confirmation of the suggested identity of the worksite feature to form a confirmed identity, and store the confirmed identity and a number of attributes associated with the confirmed identity in the worksite features database.

9. The system of claim 8, wherein the image is received from an environmental data collection system which is moved to a plurality of environment data collection locations by at least one of an autonomous vehicle, a human, an animal, or a human controlled vehicle.

10. The system of claim 8, wherein the confirmation of the suggested identity of the worksite feature is received from a user via the user interface.

11. The system of claim 8, wherein the worksite feature is at least one of a landmark, vegetation, structure, wildlife, or building.

12. The system of claim 8, wherein the data processing system is further configured to execute the data classification process to associate the confirmed identity and the number of attributes for the worksite feature with a location on a worksite map.

13. A method for identifying worksite features, the method comprising:

obtaining a number of worksite images;

identifying a common feature in at least two of the number of worksite images;

identifying a relative location of the common feature identified;

applying scaling information to a worksite map to provide distance information for the worksite and a size of the common feature identified.

14. The method of claim 13, further comprising:

determining whether there are any remaining common features in the number of worksite images; and

responsive to a determination that there are remaining common features, identifying a next common feature in at least two of the number of worksite images.

15. The method of claim 13, wherein the number of worksite images are compiled by an image sequencer to generate a three dimensional model of the worksite, and wherein the image sequencer extracts a three dimensional object from the three dimensional model as the common feature to identify a relative location of the common feature.

16. The method of claim 13, wherein the number of worksite images is obtained from a vision system of an autonomous vehicle.

17. The method of claim 13, wherein the number of worksite images is obtained from an operator over a user interface.