System and method for creating and broadcasting interactive panoramic walk-through applications

• US 8,893,026 B2
• Filed: 11/05/2009
• Issued: 11/18/2014
• Est. Priority Date: 11/05/2008
• Status: Expired due to Fees

• Current Assignee: David Lindemann, Gerard Crittin, Pierre-Alain Lindemann
• Original Assignee: Gerard Crittin
• Inventors: Lindemann, Pierre-Alain, Lindemann, David, Crittin, Grard
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Williams, Jeffery
• Application Number:
  US13/127,479
• Publication Number:
  US 20110214072A1
• Time in Patent Office: 1,839 Days
• Field of Search: 348/36, 715/757, 709/219
• US Class Current: 715/757
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01S 19/14 specially adapted for specific applications
• CPC Class Codes: G03B 37/06 involving anamorphosis G03B37/02, G03B37/04 take precedence
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations

Abstract

The system and method provides for creating, storing and broadcasting interactive panoramic walk-through applications. The combination of images is determined by the array of possibilities for the user to choose the direction of displacement at each intersection point and from each point or geographical coordinate, to have a complete view from a first person'"'"'s point of view. The system uses geo-streaming methods to optimize broadcast and real-time construction of panoramic applications. The system provides a visual perspective which approaches that of human vision.

Claims

1. A system for processing interactive panoramic walk-through content, the system comprising:

a computer having instructions for executing image modification steps;

a database for storing data, organized on the principle that each object can be parent or child of any other object;

one object may or not be a parent of other objects, and may or not be a child of other objects, wherein image sequences are organised in Route objects and Point objects, and wherein Point objects and Route objects are parents of any image object associated with corresponding geographic coordinates; and

a server with logical device for geostreaming, using a pyramidal structure of classification for the images that allows the progressive download of images from the server for assembly and broadcast.

2. The system of claim 1, further including an image capture apparatus comprising:

(a) a camera;

(b) an optic system connected to the camera, the optic system providing a substantially 360°

field of view,

(c) a communication device for transferring data from the memory device to a computer;

(d) a fixation and stabilisation system connecting the camera to a vehicle adapted to align the camera perpendicular to the horizontal plane.

3. The system of claim 2, wherein the image capture apparatus further comprises a memory device to store data including images, geographic coordinates information related to said images and distance information.

4. The system of claim 2, wherein the image capture system comprises a location measurement device and distance measurement device.

5. The system of claim 4, wherein the image capture system comprises an inertial measurement unit for measuring rate of acceleration and changes in rotational attributes of the vehicle, fixation device or camera.

6. The system of claim 3, wherein the data includes the image, date and time of image capture, geographical coordinate information, project related identifier, group identifier, so as to identify a particular district or street, and camera settings.

7. The system of claim 1, wherein a processor executes instructions for performing image modification steps, and processes images in two resolutions;

low resolution for interactive walkthrough panoramic motion, and high resolution for interactive panoramic motion.

8. The system of claim 1, wherein the data base classifies each image relative to its geographic proximity to a cross section Point, defined as an image representing a location where several Routes are available.

9. The system of claim 1 having a processor encoded with instructions for geostreaming, wherein the system is adapted for downloading of images on the server having different resolutions, the system further adapted for loading low resolution images first;

loading higher resolution images conditional to the user stopping his motion for a minimum time; and

substituting higher resolution image for low resolution images as soon as the high resolution image is fully loaded on the user computer'"'"'s software player.

10. The system of claim 1 for processing interactive panoramic walk-through content, wherein the database classifies each image relative to its geographic coordinates of its location of capture, and to its logical proximity to a point, wherein logical proximity is defined, with reference to an image, by the existence of a reference to routes connected to the point, or by a reference to routes connected to at least one point connected to routes connected to the point and wherein logical proximity decreases in direct relationship to the increase in the number of routes and point objects that are connected between the image and the point, and wherein, whenever an image is connected to point through more than one path, only the shorter path is used to determine logical proximity.

11. The system of claim 1 using a processor having instructions encoded thereon for geostreaming, wherein geostreaming is adapted to be performed in a manner dependent upon relationships between images and route objects, point objects and cross sections, and is organized according to the following rules:

each panoramic image is classified relative to its geographic proximity to at least one cross section point or point object;

the structure of the pyramidal classification prioritizes images for download that are representative of pathways possibly accessible to the user, wherein the selection of images to be broadcasted in sequence is determined as follows;

selection of next image to be broadcasted is dependant upon the last image broadcasted and displayed to the user;

images are sorted from the different pathways that are available to the user, from the location of the last displayed image or from any point located next to the location of the last displayed image.