Using image content to facilitate navigation in panoramic image data
First Claim
Patent Images
1. A computer implemented method for navigating in panoramic image data, comprising:
- (1) creating a three-dimensional virtual model, by one or more computer systems, from contents of a plurality of two-dimensional images, the three-dimensional virtual model including a plurality of faç
ade planes, the creating comprising;
(a) determining a plurality of pairs of matching features, including a first feature in a first image and a second feature in a second image, such that the first feature matches the second feature, wherein the first and second images are selected from the plurality of two-dimensional images, and(b) using the plurality of pairs of matching features to create at least a portion of the three-dimensional model;
(2) determining an intersection of a ray, extended from a position on a camera viewport of the first image, and the three-dimensional virtual model created in step (1), wherein the position is selected by a user;
(3) retrieving a panoramic image located according to a location of the intersection determined in step (2);
(4) orienting the panoramic image retrieved in step (3) to face the intersection; and
(5) displaying the oriented panoramic image oriented in step (4) to the user.
3 Assignments
0 Petitions
Accused Products
Abstract
The present invention relates to using image content to facilitate navigation in panoramic image data. In an embodiment, a computer-implemented method for navigating in panoramic image data includes: (1) determining an intersection of a ray and a virtual model, wherein the ray extends from a camera viewport of an image and the virtual model comprises a plurality of facade planes; (2) retrieving a panoramic image; (3) orienting the panoramic image to the intersection; and (4) displaying the oriented panoramic image.
-
Citations
16 Claims
-
1. A computer implemented method for navigating in panoramic image data, comprising:
-
(1) creating a three-dimensional virtual model, by one or more computer systems, from contents of a plurality of two-dimensional images, the three-dimensional virtual model including a plurality of faç
ade planes, the creating comprising;(a) determining a plurality of pairs of matching features, including a first feature in a first image and a second feature in a second image, such that the first feature matches the second feature, wherein the first and second images are selected from the plurality of two-dimensional images, and (b) using the plurality of pairs of matching features to create at least a portion of the three-dimensional model; (2) determining an intersection of a ray, extended from a position on a camera viewport of the first image, and the three-dimensional virtual model created in step (1), wherein the position is selected by a user; (3) retrieving a panoramic image located according to a location of the intersection determined in step (2); (4) orienting the panoramic image retrieved in step (3) to face the intersection; and (5) displaying the oriented panoramic image oriented in step (4) to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for navigating in panoramic image data using a three-dimensional virtual model, wherein the three-dimensional virtual model was created from a plurality of two-dimensional images, comprising:
-
a computing device; a processing pipeline server that creates a three-dimensional virtual model from a plurality of two-dimensional images, wherein the processing pipeline server comprises; a feature matcher that determines a plurality of pairs of matching features, including a first feature in a first image and a second feature in a second image, such that the first feature matches the second feature, wherein the first and second images are selected from the plurality of two-dimensional images, and a surface estimator that uses the plurality of pairs of matching features to create at least a portion of the three-dimensional model; a server, implemented on the computing device, that includes a navigation controller that determines an intersection of a ray, extended from a position on a camera viewport of the first image, and the three-dimensional virtual model created by the processing pipeline server, wherein the three-dimensional virtual model comprises a plurality of facade planes and the position is selected by a user, retrieves a panoramic image located according to a position of the determined intersection and orients the retrieved panoramic image to face the intersection. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16)
-
Specification