Method and apparatus for analyzing image, and computer product

• US 20070122058A1
• Filed: 08/07/2006
• Published: 05/31/2007
• Est. Priority Date: 11/28/2005
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Morimatsu, Eishi, Shimizu, Seiya, Kitaura, Asako, Mizutani, Masami
• Granted Patent: US 8,194,912 B2
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: G06T 7/579 from motion

Abstract

In analysis of a panorama image that is created by processing a series of picture frames, a partial image to constitute a part of the panorama image is extracted from one picture frame among the picture frames, optical flows of the one picture frame is calculated, each of the optical flows with each pixel in the partial image are associated with each other, and a distance to a subject appearing in the partial image is calculated based on the associated optical flows.

Claims

1. A computer-readable recording medium that stores therein a computer program for analyzing a panorama image that is created by processing a series of picture frames, the computer program making a computer execute:

extracting a partial image to constitute a part of the panorama image, from one picture frame among the picture frames;

calculating optical flows of the one picture frame;

associating each of the optical flows with each pixel in the partial image; and

calculating a distance to a subject appearing in the partial image based on the associated optical flows.

2. The computer-readable recording medium according to claim 1, wherein the calculating optical flows includes calculating a large-area optical flow of the one picture frame.

3. The computer-readable recording medium according to claim 1, wherein the computer program further makes the computer execute identifying the subject based on a distance pattern corresponding to the calculated distance.

4. The computer-readable recording medium according to claim 3, wherein the computer program further makes the computer execute:

inputting a route of a mobile object on which a camera to obtain the series of the picture frames is mounted; and

correcting the input route based on a result of identification at the identifying.

5. The computer-readable recording medium according to claim 1, wherein the computer program further makes the computer execute creating three-dimensional shape data of the subject based on the panorama image and the optical flows.

6. The computer-readable recording medium according to claim 1, where in the computer program further makes the computer execute rotating map data that corresponds to the panorama image in a direction of a line of sight on the panorama image.

7. The computer-readable recording medium according to claim 6, wherein the rotating includes rotating the map data such that data of a character string appearing on the map data is not rotated.

8. The computer-readable recording medium according to claim 1, wherein the computer program further makes the computer execute:

comparing the optical flows with optical flows of a second panorama image that has been obtained by taking a series of picture frames on a same route in a same direction as those of the panorama image; and

displaying information on a change between the panorama image and the second panorama image based on a result of comparison at the comparing.

9. The computer-readable recording medium according to claim 8, wherein a dynamic programming matching method is used at the comparing.

10. The computer-readable recording medium according to claim 1, wherein the computer program further makes the computer execute:

accepting a specified priority condition for distance,

judging whether the calculated distance satisfies the priority condition; and

displaying the panorama image based on a result of judgment at the judging.

11. An apparatus for analyzing a panorama image that is created by processing a series of picture frames, the apparatus comprising:

an extracting unit configured to extract a partial image to constitute a part of the panorama image, from one picture frame among the picture frames;

an optical-flow calculating unit configured to calculate optical flows of the one picture frame;

an associating unit configured to associate each of the optical flows with each pixel in the partial image; and

a distance calculating unit configured to calculate a distance to a subject appearing in the partial image based on the associated optical flows.

12. A method of analyzing a panorama image that is created by processing a series of picture frames, the method comprising:

extracting a partial image to constitute a part of the panorama image, from one picture frame among the picture frames;

calculating optical flows of the one picture frame;

associating each of the optical flows with each pixel in the partial image; and

calculating a distance to a subject appearing in the partial image based on the associated optical flows.