Media overlay selection system
First Claim
1. A method comprising:
- receiving, from a client device, image data describing an image captured by an optical sensor of the client device;
comparing, based on the image data, the image captured by the optical sensor of the client device to a set of reference images, yielding a comparison, each reference image from the set of reference images including associated metadata describing a real-world feature depicted by the respective reference image;
determining, based on the comparison, a subset of reference images that are similar to the image captured by the optical sensor of the client device;
determining, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature;
receiving, from the client device, motion data representing movement of the client device;
selecting, from a set of media overlays, a subset of media overlays related to the first real-world feature, the subset of media overlays selected based on metadata associated with each media overlay that describes the respective media overlay and based on the motion data representing movement of the client device, wherein each media overlay is a digital image that can be annotated over the image captured by the optical sensor of the client device; and
transmitting the subset of media overlays to the client device.
1 Assignment
0 Petitions
Accused Products
Abstract
A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving, from a client device, image data describing an image captured by an optical sensor of the client device; comparing, based on the image data, the image captured by the optical sensor of the client device to a set of reference images, yielding a comparison, each reference image from the set of reference images including associated metadata describing a real-world feature depicted by the respective reference image; determining, based on the comparison, a subset of reference images that are similar to the image captured by the optical sensor of the client device; determining, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature; receiving, from the client device, motion data representing movement of the client device; selecting, from a set of media overlays, a subset of media overlays related to the first real-world feature, the subset of media overlays selected based on metadata associated with each media overlay that describes the respective media overlay and based on the motion data representing movement of the client device, wherein each media overlay is a digital image that can be annotated over the image captured by the optical sensor of the client device; and transmitting the subset of media overlays to the client device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A system comprising:
-
one or more computer processors; and one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising; receiving, from a client device, image data describing an image captured by an optical sensor of the client device; comparing, based on the image data, the image captured by the optical sensor of the client device to a set of reference images, yielding a comparison, each reference image from the set of reference images including associated metadata describing a real-world feature depicted by the respective reference image; determining, based on the comparison, a subset of reference images that are similar to the image captured by the optical sensor of the client device; determining, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature; receiving, from the client device, motion data representing movement of the client device; selecting, from a set of media overlays, a subset of media overlays related to the first real-world feature, the subset of media overlays selected based on metadata associated with each media overlay that describes the respective media overlay and based on the motion data representing movement of the client device, wherein each media overlay is a digital image that can be annotated over the image captured by the optical sensor of the client device; and transmitting the subset of media overlays to the client device. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a computing device, cause the computing device to perform operations comprising:
-
receiving, from a client device, image data describing an image captured by an optical sensor of the client device; comparing, based on the image data, the image captured by the optical sensor of the client device to a set of reference images, yielding a comparison, each reference image from the set of reference images including associated metadata describing a real-world feature depicted by the respective reference image; determining, based on the comparison, a subset of reference images that are similar to the image captured by the optical sensor of the client device; determining, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature; receiving, from the client device, motion data representing movement of the client device; selecting, from a set of media overlays, a subset of media overlays related to the first real-world feature, the subset of media overlays selected based on metadata associated with each media overlay that describes the respective media overlay and based on the motion data representing movement of the client device, wherein each media overlay is a digital image that can be annotated over the image captured by the optical sensor of the client device; and transmitting the subset of media overlays to the client device.
-
Specification