STREET VIEW CREATING SYSTEM AND METHOD THEREOF

• US 20130135446A1
• Filed: 12/17/2011
• Published: 05/30/2013
• Est. Priority Date: 11/28/2011
• Status: Abandoned Application

• Current Assignee: Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: LEE, HOU-HSIEN, LEE, CHANG-JUNG, LO, CHIH-PING
• Application Number:
  US13/329,228
• Publication Number:
  US 20130135446A1
• Time in Patent Office: Days
• US Class Current: 348/48
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

An exemplary street view creating method includes obtaining images captured by at least three cameras in close proximity. The method then extracts the distance information from the obtained images. Next, the method determines images captured by cameras in different orientations and at different precise locations. The method further creates virtual 3D models based on the determined images and the extracted distance information. Then, the method determines any overlapping portion between any two original images. The method aligns any portions of synchronous images which are determined as common or overlapping.

Claims

1. A street view creating device comprising:

a storage;

a processor;

one or more programs stored in the storage, executable by the processor, the one or more programs comprising;

an image obtaining module operable to obtain images captured by at least three cameras, each of the captured images comprising a distance information indicating a distance between one camera and objects captured by the one camera;

an object detecting module operable to extract the distance information from the obtained captured images;

an orientation information obtaining module operable to obtain an individual orientations of each of the at least three cameras detected by a compass;

a geographical information obtaining module operable to obtain geographical information of the captured images detected by a positioning device; and

a model creating module operable to;

determine images captured by cameras in different orientations and at different geographical positions according to the orientation and the geographical information associated with each of the images;

create 3D models based on the determined images and the extracted distance information;

determine any overlapping portions between the images contributed by each of the cameras; and

align any determined overlapping portion to create a virtual 3D model of the street.

2. The street view creating device as described in claim 1, further comprising an image analysis module, wherein the image analysis module is operable to determine which of the images include moving object(s) and which of the images do not, and the model creating module is operable to create virtual 3D models of the street based on the images which do not include moving object(s) and the extracted distance information.

3. The street view creating device as described in claim 2, wherein the image analysis module is operable to determine images captured in the same orientation and the same geographical information according to the orientation and the geographical information associated with each of the images, compare the distance information of the determined images, determine that moving object(s) is included in one or more image(s) when the relationship between the distance information from one captured image is different from the relationship between the different parts of distance information from another captured image, and further determine the images which do not include moving object(s) as those which do not include any moving object.

4. The street view creating device as described in claim 1, further comprising a model analysis module, the model analysis module is operable to obtain the pixel values of each of the pixels in each of the images captured at one geographical location, determine an average pixel value of each of the pixels of the all images captured at the same geographical information, and assign the determined average pixel value of each of the pixels of the images to the corresponding pixel of the single composite image which shows a virtual 3D model of the street to create a street view with color.

5. A street view creating method comprising:

obtaining images captured by at least three cameras, each of the captured images comprising a distance information indicating a distance between one camera and objects captured by the one camera;

extracting the distance information from the obtained captured images;

obtaining an individual orientations of each of the at least three cameras detected by a compass;

obtaining geographical information of the captured images detected by a positioning device; and

determining images captured by cameras in different orientations and at different geographical positions according to the orientation and the geographical information associated with each of the images;

creating 3D models based on the determined images and the extracted distance information;

determining any overlapping portions between the images contributed by each of the cameras; and

aligning any determined overlapping portion to create a virtual 3D model of the street.

6. The street view creating method as described in claim 5, wherein the method further comprises:

determining which of the images include any moving object(s) and which of the images do not; and

creating virtual 3D models of the street based on the images which do not include moving object(s) and the extracted distance information.

7. The street view creating method as described in claim 6, wherein the determining step further comprises:

determining images captured at the same orientation and the same geographical information according to the orientation and the geographical information associated with each of the images;

comparing the distance information of the determined images;

determining that moving object(s) is included in one or more image(s) when the relationship between the distance information from one captured image is different from the relationship between the different parts of distance information from another captured image; and

determining the images which do not include moving object(s) as those which do not include any moving object.

8. The street view creating method as described in claim 5, the method further comprises:

obtaining the pixel value of each of the pixels in each of the images captured at the one geographical location;

determining an average pixel value of each of the pixels of the all images captured at the same geographical information; and

assigning the determined average pixel value of each of the pixels of the images to the corresponding pixel of the single composite image which shows a virtual 3D model of the street to create a street view with color.

9. A non-transitory storage medium storing a set of instructions, the set of instructions capable of being executed by a processor of a street view creating device, cause the street view creating device to perform a street view creating method, the method comprising:

obtaining images captured by at least three cameras, each of the captured images comprising a distance information indicating a distance between one camera and objects captured by the one camera;

extracting the distance information from the obtained captured images;

obtaining an individual orientations of each of the at least three cameras detected by a compass;

obtaining geographical information of the captured images detected by a positioning device;

determining images captured by cameras in different orientations and at different geographical positions according to the orientation and the geographical information associated with each of the images;

creating 3D models based on the determined images and the extracted distance information;

determining any overlapping portions between the images contributed by each of the cameras; and

aligning any determined overlapping portion to create a virtual 3D model of the street.

10. The non-transitory storage medium as described in claim 9, wherein the method further comprises:

determining which of the images include moving object(s) and which of the images do not; and

creating virtual 3D models of the street based on the images which do not include moving object(s) and the extracted distance information.

11. The non-transitory storage medium as described in claim 10, wherein the determining step comprises:

determining images captured in the same orientation and the same geographical information according to the orientation and the geographical information associated with each of the images;

comparing the distance information of the determined images;

determining that moving object(s) is included in one or any image(s) when the relationship between the distance information from one captured image is different from the relationship between the different parts of distance information from another captured image; and

determining the images which do not include moving object(s) as those which do not include any moving object.

12. The non-transitory storage medium as described in claim 9, wherein the determining step comprises:

obtaining the pixel values of each of the pixels in each of the images captured at one geographical location;

determining an average pixel value of each of the pixels of the all images captured at the same geographical information; and

assigning the determined average pixel value of each of the pixels of the images to the corresponding pixel of the single composite image which shows a virtual 3D model of the street to create a street view with color.