Conditional modification of augmented reality object

• US 10,679,393 B2
• Filed: 07/24/2018
• Issued: 06/09/2020
• Est. Priority Date: 07/24/2018
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Canberk, Ilteris, Monroy-Hernandez, Andres, Vaish, Rajan
• Primary Examiner(s): Chu, David H
• Application Number:
  US16/043,995
• Publication Number:
  US 20200035003A1
• Time in Patent Office: 686 Days
• Field of Search: None
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling
• CPC Class Codes: G06T 2219/2021 Shape modification

Abstract

A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.

Claims

1. A method comprising:

providing, to a user device and by one or more processors of a machine, object data that defines an augmented reality (AR) object, the object data of the AR object specifying a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program of the AR object, and a trigger condition for execution of the conditional modification program, the provided object data causing the user device to present the AR object with a first appearance and located at the physical geolocation;

receiving, by one or more processors of the machine, a user submission that includes the conditional modification program, the trigger condition for execution of the conditional modification program, and a corresponding value accorded to the conditional modification program;

based on the value accorded to the conditional modification program and by one or more processors of the machine, determining a period of time during which the conditional modification program is to be specified by the object data that defines the AR object;

detecting, within the determined period of time and by one or more processors of the machine, fulfillment of the trigger condition specified by the object data for execution of the conditional modification program of the AR object;

based on the detected fulfillment of the trigger condition and by one or more processors of the machine, executing the conditional modification program of the AR object, the executing of the conditional modification program modifying the object data of the AR object by modifying the presentation attribute of the AR object; and

providing, to the user device and by one or more processors of the machine, the modified object data of the AR object, the modified object data causing the user device to present the AR object with a second appearance based on the modified presentation attribute of the AR object.

2. The method of claim 1, wherein:

the presentation attribute of the AR object specifies a physical dimension of the AR object; and

the executing of the conditional modification program modifies the physical dimension of the AR object, the second appearance of the AR object differing in size from the first appearance of the AR object.

3. The method of claim 1, wherein:

the presentation attribute of the AR object specifies a color of at least a portion of the AR object; and

the executing of the conditional modification program modifies a color of the portion of the AR object, the second appearance of the AR object at least partially differing in color from the first appearance of the AR object.

4. The method of claim 1, wherein:

the presentation attribute of the AR object specifies the physical geolocation of the AR object; and

the executing of the conditional modification program modifies the physical geolocation of the AR object, the second appearance of the AR object differing in physical geolocation from the first appearance of the AR object.

5. The method of claim 1, further comprising:

receiving an indication that the user device submitted an edit to the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the incremented interaction count to a threshold interaction count.

6. The method of claim 1, further comprising:

receiving an indication that the user device edited the AR object for a period of time; and

in response to the received indication, updating a total interaction time that corresponds to the AR object based on the period of time; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the updated total interaction time to a threshold total interaction time.

7. The method of claim 1, further comprising:

receiving an indication that a device geolocation of the user device intersected the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the incremented interaction count to a threshold interaction count.

8. The method of claim 1, further comprising:

receiving an indication that the user device edited the AR object and corresponds to a user profile that specifies a demographic descriptor of a user of the user device; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object and corresponds to the demographic descriptor; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the incremented interaction count to a threshold interaction count.

9. The method of claim 1, further comprising:

receiving an indication that the user device edited the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

generating a geographical map that includes a depiction of the edited AR object, the depiction having a color that indicates a frequency at which the AR object is edited.

10. The method of claim 9, wherein:

the user device is a first user device; and

the method further comprises;

providing the generated geographical map to a second user device, the provided geographical map including the depiction whose color indicates the frequency at which the AR object is edited.

11. The method of claim 1, wherein:

the trigger condition for executing the conditional modification program specifies a threshold level of ambient audio loudness; and

the detecting of the fulfillment of the trigger condition includes receiving an indication that a microphone of the user device detected an actual level of ambient audio loudness that transgresses the threshold level of ambient audio loudness.

12. The method of claim 1, wherein:

the trigger condition for executing the conditional modification program specifies a reference pattern of sounds; and

the detecting of the fulfillment of the trigger condition includes receiving an indication that a microphone of the user device captured the reference pattern of sounds.

13. The method of claim 1, further comprising:

receiving an indication that the user device is editing the AR object; and

wherein;

the detecting of the fulfillment of the trigger condition is based on the received indication that the user device is editing the AR object; and

the executing of the conditional modification program adds an AR cursor to the second appearance of AR object, the added AR cursor indicating a location of a non-committed edit to the AR object.

14. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

providing, to a user device, object data that defines an augmented reality (AR) object, the object data of the AR object specifying a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program of the AR object, and a trigger condition for execution of the conditional modification program, the provided object data causing the user device to present the AR object with a first appearance and located at the physical geolocation;

receiving a user submission that includes the conditional modification program, the trigger condition for execution of the conditional modification program, and a corresponding value accorded to the conditional modification program;

based on the value accorded to the conditional modification program, determining a period of time during which the conditional modification program is to be specified by the object data that defines the AR object;

detecting fulfillment of the trigger condition specified by the object data for execution of the conditional modification program of the AR object;

based on the detected fulfillment of the trigger condition, executing the conditional modification program of the AR object, the executing of the conditional modification program modifying the object data of the AR object by modifying the presentation attribute of the AR object; and

providing, to the user device, the modified object data of the AR object, the modified object data causing the user device to present the AR object with a second appearance based on the modified presentation attribute of the AR object.

15. The non-transitory machine-readable storage medium of claim 14, wherein the operations further comprise:

receiving an indication that the user device submitted an edit to the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the incremented interaction count to a threshold interaction count.

16. The non-transitory machine-readable storage medium of claim 14, wherein the operations further comprise:

receiving an indication that a device geolocation of the user device intersected the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the incremented interaction count to a threshold interaction count.

17. A system comprising:

one or more processors; and

a memory storing instructions that, when executed by at least one processor among the one or more processors, cause the system to perform operations comprising;

providing, to a user device, object data that defines an augmented reality (AR) object, the object data of the AR object specifying a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program of the AR object, and a trigger condition for execution of the conditional modification program, the provided object data causing the user device to present the AR object with a first appearance and located at the physical geolocation;

receiving a user submission that includes the conditional modification program, the trigger condition for execution of the conditional modification program, and a corresponding value accorded to the conditional modification program;

based on the value accorded to the conditional modification program, determining a period of time during which the conditional modification program is to be specified by the object data that defines the AR object;

detecting fulfillment of the trigger condition specified by the object data for execution of the conditional modification program of the AR object;

based on the detected fulfillment of the trigger condition, executing the conditional modification program of the AR object, the executing of the conditional modification program modifying the object data of the AR object by modifying the presentation attribute of the AR object; and

providing, to the user device, the modified object data of the AR object, the modified object data causing the user device to present the AR object with a second appearance based on the modified presentation attribute of the AR object.

18. The system of claim 17, wherein the operations further comprise:

receiving an indication that the user device edited the AR object for a period of time; and

in response to the received indication, updating a total interaction time that corresponds to the AR object based on the period of time; and

wherein;

the detecting of the fulfillment of the trigger condition is based on a comparison of the updated total interaction time to a threshold total interaction time.

19. The system of claim 17, wherein the operations further comprise:

receiving an indication that the user device edited the AR object; and

in response to the received indication, incrementing an interaction count that corresponds to the AR object; and

generating a geographical map that includes a depiction of the edited AR object, the depiction having a color that indicates a frequency at which the AR object is edited.