INDOOR SCENE CAPTURE SYSTEM
First Claim
1. A method in a handheld device with a camera for collecting a video of rooms, the method comprising:
- for each room,collecting a video of the room as a user holding the handheld device rotates around a point within the room and assigning directions to frames of the video as the frames are collected; and
marking doorways within the frames of the videos; and
for each doorway between a first room and a second room,collecting a video of the doorway as the user moves from the point within the first room through the doorway to a point within the second room.
3 Assignments
0 Petitions
Accused Products
Abstract
An indoor scene capture system is provided that, with a handheld device with a camera, collects videos of rooms, spatially indexes the frames of the videos, marks doorways between rooms, and collects videos of transitions from room to room via doorways. The indoor scene capture system may assign a direction to at least some of the frames based on the angle of rotation as determined by an inertial sensor (e.g., gyroscope) of the handheld device. The indoor scene capture system marks doorways within the frames of the videos. For each doorway between rooms, the indoor scene capture system collects a video of transitioning through the doorway as the camera moves from the point within a room through the doorway to a point within the adjoining room.
-
Citations
20 Claims
-
1. A method in a handheld device with a camera for collecting a video of rooms, the method comprising:
-
for each room, collecting a video of the room as a user holding the handheld device rotates around a point within the room and assigning directions to frames of the video as the frames are collected; and marking doorways within the frames of the videos; and for each doorway between a first room and a second room, collecting a video of the doorway as the user moves from the point within the first room through the doorway to a point within the second room. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer-readable storage medium storing computer-executable instructions for controlling a handheld device with a camera to collect videos of rooms, the computer-executable instructions comprising instructions that:
-
collect a video of a room as a user holding the handheld device rotates around a point within the room; assign directions to frames of the video as the frames are collected based on readings from an inertial sensor of the handheld device and as later adjusted based on readings of a magnetometer of the handheld device; mark corners of the room as the frames are collected based on user input; and generate a layout of the room based on the marked corners and directions of frames containing the marked corners. - View Dependent Claims (10, 11, 12, 13)
-
-
14. A method in a handheld device with a camera and an inertial sensor for collecting video of a room, the method comprising:
-
collecting frames of the video as a user holding the handheld device rotates around a point within the room; for at least some of the frames of the video, determining an angle of rotation of the handheld device at the time of the collecting of the frames based on a reading from the inertial sensor; receiving an indication of an ending frame that corresponds to a full rotation; determining a difference between the angle of rotation for the ending frame and a full rotation; and adjusting the angles of rotation for the frames to compensate for the difference. - View Dependent Claims (15, 16)
-
-
17. A method performed by a handheld device for determining a layout of a room with walls and corners from mappings of corners of the room to directions of the corners from a point within the room, each corner having a ray from the point in the direction of the corner, the method comprising:
-
selecting a starting position along the ray of an initial corner; selecting an initial adjacent corner that is adjacent to the initial corner; for each of a plurality of directions, determining a position along the ray of the initial adjacent corner, assuming the wall between the initial corner and the initial adjacent corner is in that direction; for each of the remaining corners in order of adjacency until a calculated position is calculated along the ray of the initial corner, calculating a position along the ray of the next adjacent corner, assuming the walls are at right angles; and calculating a difference between the starting position and the calculated position along the ray of the initial corner; and selecting the positions of the corners associated with the direction with the smallest difference as the layout of the room. - View Dependent Claims (18)
-
-
19. A method performed by a handheld device with a camera for determining dimensions of a layout of a room having walls, the method comprising:
-
providing frames of a video as a user holding the camera rotates around a point in the room, the frames having directions; for each corner of the room, providing mappings of locations of that corner within multiple frames; and determining a triangulated distance from the point in the room to that corner using triangulation based on the mappings and the directions of the frames; selecting a scale for the room by minimizing the differences between the triangulated distances and calculated distances assuming that scale; and calculating the dimensions of the walls of the room assuming the selected scale.
-
-
20. A method performed by a handheld device for presenting a video of rooms and transitions between rooms, the video of a room collected as a user holding a camera rotates around a point in the room, each frame of a video of a room having a direction, the video of a transition being collected by the user holding the camera moving between rooms, the method comprising:
-
presenting the video of a room by displaying the frame associated with an initial direction and displaying subsequent frames associated with subsequent directions; and when a user selects a doorway that is currently being displayed, the doorway connecting an adjoining room, presenting the video of the transition through that doorway; and presenting the video of an adjoining room by displaying a frame associated with an initial direction and displaying subsequent frames associated with subsequent directions.
-
Specification