Devices, methods, and graphical user interfaces for system-wide behavior for 3D models
First Claim
1. A method, comprising:
- at a device having a display generation component, one or more input devices, and one or more cameras;
receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras;
in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes;
in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and
in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras;
detecting first movement of the one or more cameras while the representation of the virtual object is displayed with the first set of visual properties and the first orientation over a first portion of the physical environment captured in the field of view of the one or more cameras; and
in response to detecting the first movement of the one or more cameras, displaying the representation of the virtual object with the first set of visual properties and the first orientation over a second portion of the physical environment captured in the field of view of the one or more cameras, wherein the second portion of the physical environment is distinct from the first portion of the physical environment.
1 Assignment
0 Petitions
Accused Products
Abstract
A computer system having a display generation component, one or more input devices, and one or more cameras receives a request to display a virtual object in a first user interface region that includes a field of view of the one or more cameras. In response to the request, in accordance with a determination that object-placement criteria are not met, the representation of the virtual object is displayed with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras. In accordance with a determination that the object-placement criteria are met, the representation of the virtual object is displayed with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane.
124 Citations
57 Claims
-
1. A method, comprising:
at a device having a display generation component, one or more input devices, and one or more cameras; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; detecting first movement of the one or more cameras while the representation of the virtual object is displayed with the first set of visual properties and the first orientation over a first portion of the physical environment captured in the field of view of the one or more cameras; and in response to detecting the first movement of the one or more cameras, displaying the representation of the virtual object with the first set of visual properties and the first orientation over a second portion of the physical environment captured in the field of view of the one or more cameras, wherein the second portion of the physical environment is distinct from the first portion of the physical environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
17. A computer system, comprising:
-
a display generation component; one or more input devices; one or more cameras; one or more processors; and memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; detecting first movement of the one or more cameras while the representation of the virtual object is displayed with the first set of visual properties and the first orientation over a first portion of the physical environment captured in the field of view of the one or more cameras; and in response to detecting the first movement of the one or more cameras, displaying the representation of the virtual object with the first set of visual properties and the first orientation over a second portion of the physical environment captured in the field of view of the one or more cameras, wherein the second portion of the physical environment is distinct from the first portion of the physical environment. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32)
-
-
33. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with a display generation component, one or more input devices, and one or more cameras, cause the computer system to:
-
receive a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, display, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; detect first movement of the one or more cameras while the representation of the virtual object is displayed with the first set of visual properties and the first orientation over a first portion of the physical environment captured in the field of view of the one or more cameras; and in response to detecting the first movement of the one or more cameras, display the representation of the virtual object with the first set of visual properties and the first orientation over a second portion of the physical environment captured in the field of view of the one or more cameras, wherein the second portion of the physical environment is distinct from the first portion of the physical environment. - View Dependent Claims (34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48)
-
-
49. A method, comprising:
at a device having a display generation component, one or more input devices, and one or more cameras; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; and in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein selecting the plane includes; in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a first portion of the physical environment captured in the field of view of the one or more cameras, selecting a first plane of multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties; and in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a second portion of the physical environment captured in the field of view of the one or more cameras, selecting a second plane of the multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties, wherein the first portion of the physical environment is distinct from the second portion of the physical environment, and the first plane is distinct from the second plane.
-
50. A computer system, comprising:
-
a display generation component; one or more input devices; one or more cameras; one or more processors; and memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; and in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein selecting the plane includes; in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a first portion of the physical environment captured in the field of view of the one or more cameras, selecting a first plane of multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties; and in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a second portion of the physical environment captured in the field of view of the one or more cameras, selecting a second plane of the multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties, wherein the first portion of the physical environment is distinct from the second portion of the physical environment, and the first plane is distinct from the second plane.
-
-
51. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with a display generation component, one or more input devices, and one or more cameras, cause the computer system to:
-
receive a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; and in response to the request to display the virtual object in the first user interface region, display, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein selecting the plane includes; in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a first portion of the physical environment captured in the field of view of the one or more cameras, selecting a first plane of multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties; and in accordance with a determination that the object-placement criteria were met when the representation of the virtual object was displayed over a second portion of the physical environment captured in the field of view of the one or more cameras, selecting a second plane of the multiple planes detected in the physical environment in the field of view of the one or more cameras as the plane for setting the second orientation of the representation of the virtual object with the second set of visual properties, wherein the first portion of the physical environment is distinct from the second portion of the physical environment, and the first plane is distinct from the second plane.
-
-
52. A method, comprising:
at a device having a display generation component, one or more input devices, and one or more cameras; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; displaying one or more control affordances with the representation of the virtual object while displaying the representation of the virtual object with the second set of visual properties and the second orientation; while displaying the one or more control affordances with the representation of the virtual object having the second set of visual properties, detecting that control-fading criteria are met; and
,in response to detecting that the control-fading criteria are met, ceasing to display the one or more control affordances while continuing to display the representation of the virtual object having the second set of visual properties in the first user interface region including the field of view of the one or more cameras.
-
53. A computer system, comprising:
-
a display generation component; one or more input devices; one or more cameras; one or more processors; and memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; displaying one or more control affordances with the representation of the virtual object while displaying the representation of the virtual object with the second set of visual properties and the second orientation; while displaying the one or more control affordances with the representation of the virtual object having the second set of visual properties, detecting that control-fading criteria are met; and
,in response to detecting that the control-fading criteria are met, ceasing to display the one or more control affordances while continuing to display the representation of the virtual object having the second set of visual properties in the first user interface region including the field of view of the one or more cameras.
-
-
54. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with a display generation component, one or more input devices, and one or more cameras, cause the computer system to:
-
receive a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, display, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras; display one or more control affordances with the representation of the virtual object while displaying the representation of the virtual object with the second set of visual properties and the second orientation; while displaying the one or more control affordances with the representation of the virtual object having the second set of visual properties, detect that control-fading criteria are met; and
,in response to detecting that the control-fading criteria are met, cease to display the one or more control affordances while continuing to display the representation of the virtual object having the second set of visual properties in the first user interface region including the field of view of the one or more cameras.
-
-
55. A method, comprising:
at a device having a display generation component, one or more input devices, and one or more cameras; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein the method further includes; in response to the request to display the virtual object in the first user interface region;
prior to displaying the representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, in accordance with a determination that calibration criteria are not met, displaying a prompt for the user to move the device relative to the physical environment.
-
56. A computer system, comprising:
-
a display generation component; one or more input devices; one or more cameras; one or more processors; and memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, displaying, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein the one or more programs further include instructions for; in response to the request to display the virtual object in the first user interface region;
prior to displaying the representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, in accordance with a determination that calibration criteria are not met, displaying a prompt for the user to move the device relative to the physical environment.
-
-
57. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with a display generation component, one or more input devices, and one or more cameras, cause the computer system to:
-
receive a request to display a virtual object in a first user interface region that includes at least a portion of a field of view of the one or more cameras; in response to the request to display the virtual object in the first user interface region, display, via the display generation component, a representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, wherein the field of view of the one or more cameras is a view of a physical environment in which the one or more cameras are located, and wherein displaying the representation of the virtual object includes; in accordance with a determination that object-placement criteria are not met, wherein the object-placement criteria require that a placement location for the virtual object be identified in the field of view of the one or more cameras in order for the object-placement criteria to be met, displaying the representation of the virtual object with a first set of visual properties and with a first orientation that is independent of which portion of the physical environment is displayed in the field of view of the one or more cameras; and in accordance with a determination that the object-placement criteria are met, displaying the representation of the virtual object with a second set of visual properties that are distinct from the first set of visual properties and with a second orientation that corresponds to a plane in the physical environment detected in the field of view of the one or more cameras, wherein the one or more programs further include instructions, which when executed by the computer system, cause the computer system to; in response to the request to display the virtual object in the first user interface region;
prior to displaying the representation of the virtual object over at least a portion of the field of view of the one or more cameras that is included the first user interface region, in accordance with a determination that calibration criteria are not met, display a prompt for the user to move the device relative to the physical environment.
-
Specification