Apparatus, system and method for mapping information

• US 8,121,353 B2
• Filed: 10/23/2006
• Issued: 02/21/2012
• Est. Priority Date: 12/02/2005
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: Kim, Jay-woo, Kim, Kee-eung
• Primary Examiner(s): Bali, Vikkram
• Assistant Examiner(s): FUJITA, KATRINA R
• Application Number:
  US11/584,493
• Publication Number:
  US 20070127848A1
• Time in Patent Office: 1,947 Days
• Field of Search: 382/113, 701/213, 348/135
• US Class Current: 382/113
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59

Abstract

An apparatus, system and method for mapping information. The apparatus for mapping information includes an information input unit providing image information and position-view information in a specified area, a three-dimensional model database storing three-dimensional model data of a structure within the specified area and generating a two-dimensional image from the three-dimensional model data using the position-view information, an image processing unit comparing the two-dimensional image with the image information to analyze the image information, a related information acquiring unit acquiring structure related information within the specified area with reference to the analyzed image information, and an information mapping processing unit mapping the structure related information on the image information and outputting a mapping result.

Claims

1. An apparatus for mapping information, comprising:

an information input unit to provide image information and position-view information of a specified area;

a three-dimensional model database to store three-dimensional model data of a structure within the specified area and to generate a two-dimensional image from the three-dimensional model data using the position-view information;

an image processing unit to compare the two-dimensional image with the image information to analyze the image information;

a related information acquiring unit to acquire structure related information within the specified area with reference to the analyzed image information; and

an information mapping processing unit to map the structure related information on the image information and to output a mapping result,

wherein the three-dimensional model data include attribute information,

wherein the image processing unit compares the two-dimensional image with the image information provided from the information input unit by dividing the specified area around the structure and mapping the attribute information of the structure per divided area, thereby analyzing the image information, and

wherein the structure related information includes recognition information on Internet or information left from Internet users relating to the structure, or a main element in the structure, and the structure related information is drawn 2-dimensionally on the image information.

2. The apparatus of claim 1, wherein the information input unit includes:

a camera to capture an image of the specified area to detect the image information; and

a sensor to detect the position-view information on a whole coordinate system and a local coordinate system of the camera,

wherein the information input unit provides the detected image information and the detected position-view information to the image processing unit.

3. The apparatus of claim 2, wherein the sensor includes at least one of a global positioning system (GPS) receiver to detect position information of the camera, a geomagnetic sensor to detect directional information of the camera, a gyro sensor to detect angle information of the camera with respect to a horizontal plane, and an altitude sensor to detect altitude information of the camera.

4. The apparatus of claim 3, wherein the attribute information includes GPS information of the structure, a mail address and a structure name, and are comprised of data in which real images of the structure are texture mapped.

5. The apparatus of claim 4, wherein the three-dimensional model data base receives position-view information from the image processing unit or the information input unit.

6. The apparatus of claim 5, wherein the three-dimensional model database generates the two-dimensional image from the three-dimensional model data using perspective projection.

7. The apparatus of claim 5, wherein the related information acquiring unit acquires the structure related information through a menu selection or input text.

8. The apparatus of claim 7, wherein the related information acquiring unit acquires the structure related information from the Internet using a search engine for information retrieval.

9. A system for mapping information, comprising:

a portable terminal including an information input unit that provides image information and position-view information in a specified area;

a three-dimensional model database to store three-dimensional model data of a structure within the specified area and to generate a two-dimensional image from the three-dimensional model data using the position-view information; and

a server which includes an image processing unit that compares the two-dimensional image with the image information to analyze the image information, a related information acquiring unit to acquire structure related information within the specified area with reference to the analyzed image information, and an information mapping processing unit to map the structure related information on the image information and outputting a mapping result,

wherein the portable terminal displays the mapping result,

wherein the three-dimensional model data include attribute information,

wherein the image processing unit compares the two-dimensional image with the image information provided from the information input unit by dividing the specified area around the structure and mapping the attribute information of the structure per divided area, thereby analyzing the image information, and

wherein the structure related information includes recognition information on Internet or information left from Internet users relating to the structure, or a main element in the structure, and the structure related information is drawn 2-dimensionally on the image information.

10. The system of claim 9, wherein the information input unit includes:

a camera to capture an image of the specified area to detect the image information; and

a sensor to detect the position-view information on a whole coordinate system and a local coordinate system of the camera;

wherein the information input unit provides the detected image information and the detected position-view information to the image processing unit.

11. The system of claim 10, wherein the sensor includes at least one of a global positioning system (GPS) receiver to detect position information of the camera, a geomagnetic sensor to detect directional information of the camera, a gyro sensor to detect angle information of the camera with respect to a horizontal plane, and an altitude sensor to detect altitude information of the camera.

12. The system of claim 11, wherein the attribute information includes GPS information of the structure, a mail address and a structure name, and are comprised of data in which real images of the structure are texture mapped.

13. The system of claim 12, wherein the three-dimensional model data base receives position-view information from the image processing unit or the information input unit.

14. The system of claim 13, wherein the three-dimensional model database generates the two-dimensional image from the three-dimensional model data using perspective projection.

15. The system of claim 13, wherein the related information acquiring unit acquires the structure related information through a menu selection or input text.

16. The system of claim 15, wherein the related information acquiring unit acquires the structure related information on the Internet using a search engine for information retrieval.

17. A method of mapping information, comprising:

providing image information and position-view information of a specified area, and providing a two-dimensional image of three-dimensional model data of a structure within the specified area from a three-dimensional database that stores the three-dimensional model data;

comparing the two-dimensional image with the image information to analyze the image information;

acquiring structure related information with reference to the analyzed image information; and

mapping the structure related information on the image information and outputting a mapping result using at least one processor,

wherein the three-dimensional model data includes attribute information;

wherein the comparing the two-dimensional image with the image information includes dividing the specified area around the structure, and mapping the attribute information of the structure per divided area, thereby analyzing the image information; and

wherein the structure related information includes recognition information on Internet or information left from Internet users relating to the structure, or a main element in the structure, and the structure related information is drawn 2-dimensionally on the image information.

18. The method of claim 17, wherein the providing includes:

capturing an image of the specified area using a camera to detect the image information;

detecting the position-view information on a whole coordinate system and a local coordinate system of the camera by detecting position information of the camera using a GPS receiver, detecting directional information of the camera, detecting angle information of the camera with respect to a horizontal plane, and detecting altitude information of the camera; and

generating the two-dimensional image from the three-dimensional model data using the detected position-view information and providing the generated two-dimensional image.

19. The method of claim 18, wherein the attribute information includes global positioning system (GPS) information of the structure, a mail address and a structure name, and are comprised of data in which real images of the structure are texture mapped.

20. The method of claim 18, wherein the acquiring includes acquiring the structure related information through a menu selection or input text using a search engine for information retrieval.

21. A non-transitory computer readable recording medium recorded with a program code for causing a processor to execute the method of claim 17.