User device augmented reality virtual item modeling
First Claim
Patent Images
1. A method comprising:
- displaying, on a display device of a client device, an image sequence depicting a real-world environment, the image sequence generated using an image sensor of the client device;
generating, on the client device, a virtual frame in a three-dimensional (3D) model of a room, the virtual frame created by receiving placements, via inputs to the display device, of multiple virtual points in the image sequence as the image sequence is displayed on the display device, the multiple virtual points being endpoints of one or more virtual dimensions of the virtual frame, the virtual frame being a two-dimensional parallelogram having a defined first dimension, a defined second dimension, and an undefined third dimension;
transmitting, to a networked server, a request specifying 3D models of items that have first dimension values that fit the defined first dimension and that have second dimension values that fit the defined second dimension of the virtual frame generated on the client device;
displaying, on a user interface of the display device, a plurality of items matching the defined first dimension and the defined second dimension and have various third dimension values due to the undefined third dimension of the virtual frame; and
in response to a selection of an item of the plurality of items, displaying, on the display device, a modified image sequence that shows the image sequence and one or more renders of the selected item, the one or more renders being renders of a 3D model of the selected item as arranged at the virtual frame in the 3D model of the room.
3 Assignments
0 Petitions
Accused Products
Abstract
Disclosed are various embodiments for simulating one or more virtual objects (e.g., renders) in specified spatial areas of a real-world environment. Options of item models for modeling in a given spatial area can be filtered based on specified dimensions and identified features of an image of a given spatial area. A selected item model can be rendered and continuously updated on a display device as the client device is physical moved.
-
Citations
17 Claims
-
1. A method comprising:
-
displaying, on a display device of a client device, an image sequence depicting a real-world environment, the image sequence generated using an image sensor of the client device; generating, on the client device, a virtual frame in a three-dimensional (3D) model of a room, the virtual frame created by receiving placements, via inputs to the display device, of multiple virtual points in the image sequence as the image sequence is displayed on the display device, the multiple virtual points being endpoints of one or more virtual dimensions of the virtual frame, the virtual frame being a two-dimensional parallelogram having a defined first dimension, a defined second dimension, and an undefined third dimension; transmitting, to a networked server, a request specifying 3D models of items that have first dimension values that fit the defined first dimension and that have second dimension values that fit the defined second dimension of the virtual frame generated on the client device; displaying, on a user interface of the display device, a plurality of items matching the defined first dimension and the defined second dimension and have various third dimension values due to the undefined third dimension of the virtual frame; and in response to a selection of an item of the plurality of items, displaying, on the display device, a modified image sequence that shows the image sequence and one or more renders of the selected item, the one or more renders being renders of a 3D model of the selected item as arranged at the virtual frame in the 3D model of the room. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system comprising:
-
one or more processors of a machine; an image sensor; a display device; and a memory storing instructions that, when executed by the one or more processors, cause the machine to perform operations comprising; displaying, on the display device, an image sequence depicting a real-world environment, the image sequence generated using the image sensor; generating a virtual frame in a three-dimensional (3D) model of a room, the virtual frame created by receiving placements, via inputs to the display device, of multiple virtual points in the image sequence as the image sequence is displayed on the display device, the multiple virtual points being endpoints of one or more virtual dimensions of the virtual frame, the virtual frame being a two-dimensional parallelogram having a defined first dimension, a defined second dimension, and an undefined third dimension; transmitting, to a networked server, a request specifying 3D models of items that have first dimension values that fit the defined first dimension and that have second dimension values that fit the defined second dimension of the virtual frame; displaying, on a user interface in the display device, a plurality of items matching the defined first dimension and the defined second dimension and have various third dimension values due to the undefined third dimension of the virtual frame; in response to a selection of an item of the plurality of items, displaying, on the display device, a modified image sequence that shows the image sequence and one or more renders of the selected item, the one or more renders being renders of a 3D model of the selected item as arranged at the virtual frame in the 3D model of the room. - View Dependent Claims (13, 14, 15)
-
-
16. A non-transitory machine-readable storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
-
displaying, on a display device, an image sequence depicting a real-world environment, the image sequence generated using an image sensor; generating a virtual frame in a three-dimensional (3D) model of a room, the virtual frame created by receiving placements, via inputs to the display device, of multiple virtual points in the image sequence as the image sequence is displayed on the display device, the multiple virtual points being endpoints of one or more virtual dimensions of the virtual frame, the virtual frame being a two-dimensional parallelogram having a defined first dimension, a defined second dimension, and an undefined third dimension; transmitting, to a networked server, a request specifying 3D models of items that have first dimension values that fit the defined first dimension and that have second dimension values that fit the defined second dimension of the virtual frame; displaying, on a user interface in the display device, a plurality of items matching the defined first dimension and the defined second dimension and have various third dimension values due to the undefined third dimension of the virtual frame; in response to a selection of an item of the plurality of items, displaying, on the display device, a modified image sequence that shows the image sequence and one or more renders of the selected item, the one or more renders being renders of a 3D model of the selected item as arranged at the virtual frame in the 3D model of the room. - View Dependent Claims (17)
-
Specification