CONNECTING AND USING BUILDING INTERIOR DATA ACQUIRED FROM MOBILE DEVICES
First Claim
1. A computer-implemented method comprising:
- obtaining, by at least one device, linking information for a sequence of viewing locations within an interior of a building, including video information and acceleration data generated by a mobile device as a user carries the mobile device between each successive pair of viewing locations in the sequence;
determining, by the at least one device, and for each successive pair of viewing locations in the sequence, relative positional information that includes at least a direction from a starting viewing location of the successive pair to an ending viewing location of the successive pair, including analyzing the acceleration data of the linking information to model a travel path of the user from the starting viewing location to the ending viewing location of the successive pair and using the modeled travel path as part of determining the direction;
generating, by the at least one device, and using the determined direction for each successive pair of viewing locations in the sequence, information to link panorama images for the viewing locations, wherein each of the panorama images is associated with one of the viewing locations and has views from the one viewing location in each of multiple directions, and wherein the generating includes, for each of the viewing locations other than a last viewing location in the sequence, generating an inter-panorama link for the panorama image associated with the viewing location that points toward a next viewing location in the sequence; and
providing, by the at least one device and for display on a client device, information about the interior of the building that includes the panorama images and that includes the generated inter-panorama links for the panorama images.
5 Assignments
0 Petitions
Accused Products
Abstract
Techniques are described for automated operations involving acquiring and analyzing information from an interior of a house, building or other structure, for use in generating and providing a representation of that interior. Such techniques may include using a user'"'"'s mobile device to capture video data from multiple viewing locations (e.g., 360° video at each viewing location) within multiple rooms, and capturing data linking the multiple viewing locations (e.g., by recording video, acceleration and/or other data from the mobile device as the user moves between the two viewing locations), creating a panorama image for each viewing location, analyzing the linking information to model the user'"'"'s travel path and determine relative positions/directions between at least some viewing locations, creating inter-panorama links in the panoramas to each of one or more other panoramas based on such determined positions/directions, and providing information to display multiple linked panorama images to represent the interior.
-
Citations
30 Claims
-
1. A computer-implemented method comprising:
-
obtaining, by at least one device, linking information for a sequence of viewing locations within an interior of a building, including video information and acceleration data generated by a mobile device as a user carries the mobile device between each successive pair of viewing locations in the sequence; determining, by the at least one device, and for each successive pair of viewing locations in the sequence, relative positional information that includes at least a direction from a starting viewing location of the successive pair to an ending viewing location of the successive pair, including analyzing the acceleration data of the linking information to model a travel path of the user from the starting viewing location to the ending viewing location of the successive pair and using the modeled travel path as part of determining the direction; generating, by the at least one device, and using the determined direction for each successive pair of viewing locations in the sequence, information to link panorama images for the viewing locations, wherein each of the panorama images is associated with one of the viewing locations and has views from the one viewing location in each of multiple directions, and wherein the generating includes, for each of the viewing locations other than a last viewing location in the sequence, generating an inter-panorama link for the panorama image associated with the viewing location that points toward a next viewing location in the sequence; and providing, by the at least one device and for display on a client device, information about the interior of the building that includes the panorama images and that includes the generated inter-panorama links for the panorama images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer-readable medium having stored contents that cause one or more devices to perform automated operations, the automated operations including:
-
obtaining linking information for a sequence of viewing locations within an interior of a structure, including acceleration data generated by a device as the device moves between each successive pair of viewing locations in the sequence; determining, by the one or more devices, and for one or more pairs of successive viewing locations in the sequence, relative positional information that includes at least a direction from a starting viewing location of the pair to an ending viewing location of the pair, including analyzing the acceleration data of the linking information to model a travel path of the device from the starting viewing location to the ending viewing location and using the modeled travel path as part of determining the direction; generating, by the one or more devices, and using the determined direction for each of the one or more pairs of successive viewing locations, information to link visual information associated with the starting viewing location for the pair to visual information associated with the ending viewing location for the pair, including generating a link for the visual information associated with the starting viewing location for the pair that points toward the ending viewing location for the pair; and providing, by the one or more devices, information for display about the interior of the structure that includes the visual information associated with the starting viewing location of each pair, the visual information associated with the ending viewing location of each pair, and the generated inter-panorama link for each pair. - View Dependent Claims (21)
-
-
22. A system, comprising:
-
one or more hardware processors of one or more computing devices; and one or more memories with stored instructions that, when executed by at least one of the one or more hardware processors, cause the one or more computing devices to provide data representing a building, including; obtaining data for a sequence of recording locations associated with the building that include at least one recording location within an interior of the building, including data that is recorded at each of the recording locations, and linking information that includes acceleration data associated with movement between successive recording locations in the sequence; determining, based at least in part on analyzing the acceleration data, and for one or more pairs of successive recording locations in the sequence, a direction from a starting recording location of the pair to an ending recording location of the pair; generating, using the determined direction for each of the one or more pairs of successive recording locations, information to link the data recorded at the starting recording location for the pair to the data recorded for the ending recording location for the pair, including generating a link that points from the starting recording location for the pair toward the ending recording location for the pair; and providing information for presentation about the interior of the building that includes the data recorded at one or more of the recording locations and that includes at least one of the generated links. - View Dependent Claims (23, 24, 25, 26)
-
-
27. A computer-implemented method comprising:
-
generating, by a mobile device carried by a user, visual data representing multiple locations within an interior of a house, including recording first visual information from a first viewing location within the house for a first panorama image having a 360-degree view around a vertical axis at the first viewing location, capturing, as the user carries the mobile device along a travel path from the first viewing location to a second viewing location within the house, linking information between the first and second viewing locations that includes acceleration data associated with movement of the mobile device along the travel path and that includes multiple images along the travel path, and recording second visual information from the second viewing location for a second panorama image having a 360-degree view around a vertical axis at the second viewing location; automatically determining, based at least in part on analyzing the acceleration data and the multiple images included in the captured linking information to model the travel path of the user, relative positional information that includes direction information between the first and second viewing locations and that includes a distance between the first and second viewing locations; automatically generating, using at least the determined direction information, information to link the first and second panorama images, including generating a first inter-panorama link for the first panorama image to be displayed in a direction of the second viewing location and a second inter-panorama link for the second panorama image to be displayed in a direction of the first viewing location; and presenting, using the first and second panorama images and the generated first and second inter-panorama links, a display of the interior of the house on a client device that includes the first and second panorama images, including displaying the generated first inter-panorama link in the first panorama image in a direction of the second panorama image that is selectable by the user to display the second panorama image, and displaying the generated second inter-panorama link in the second panorama image in a direction of the first panorama image that is selectable by the user to display the first panorama image. - View Dependent Claims (28, 29, 30)
-
Specification