Intelligent method of determining trigger items in augmented reality environments
First Claim
1. A computer-aided method for enabling an augmented reality application resident on a computing device to identify a real world trigger item, the method comprising:
- capturing, by a processor, an image of a real world trigger item from a series of frames of a video based on geographical information associated, with a location where the video was captured;
identifying indexed feature points of a known candidate trigger item stored in a database that match feature points of the real world trigger item;
performing a geometric consistency evaluation of the feature points of the real world trigger item, including comparing an overall shape of a composite of individual tiles of the real world trigger item to an overall shape of each of the matching feature points of the known candidate trigger item;
performing a weighted factor evaluation of the feature points of the real world trigger item, including identifying a required set of feature points for the real world trigger item and determining that the matching feature points of the known candidate trigger item include the required set of feature points;
determining, by the processor, a percentage of the matching feature points of the known candidate trigger item relative to a total number of indexed feature points of the known candidate trigger item;
determining whether the determined percentage is equal to or greater than a percentage threshold;
in response to a determination that the determined percentage is equal to or greater than the percentage threshold, selecting an augmented reality scenario associated with the real world trigger; and
presenting, by the processor, the augmented reality scenario onto a display of the computing device by overlaying augmented reality content onto the series of frames of the video.
3 Assignments
0 Petitions
Accused Products
Abstract
The systems and methods may allow mobile computing devices to identify real world trigger items and to cause augmented reality scenarios associated with a real world trigger item to be presented on a display of the mobile computing device. A lookup scheme may identify indexed feature points of known candidate trigger items stored in a database. A number of evaluations occur between the indexed feature points to the feature points found in the real world trigger item. A determination that the feature points of a candidate trigger item matches the feature points of the real world trigger item is made when a confidence threshold is met or exceeded based on at least the look up scheme, weighted factor evaluation, variable threshold evaluation and potentially a geometric consistency evaluation to declare a positive match.
55 Citations
8 Claims
-
1. A computer-aided method for enabling an augmented reality application resident on a computing device to identify a real world trigger item, the method comprising:
-
capturing, by a processor, an image of a real world trigger item from a series of frames of a video based on geographical information associated, with a location where the video was captured; identifying indexed feature points of a known candidate trigger item stored in a database that match feature points of the real world trigger item; performing a geometric consistency evaluation of the feature points of the real world trigger item, including comparing an overall shape of a composite of individual tiles of the real world trigger item to an overall shape of each of the matching feature points of the known candidate trigger item; performing a weighted factor evaluation of the feature points of the real world trigger item, including identifying a required set of feature points for the real world trigger item and determining that the matching feature points of the known candidate trigger item include the required set of feature points; determining, by the processor, a percentage of the matching feature points of the known candidate trigger item relative to a total number of indexed feature points of the known candidate trigger item; determining whether the determined percentage is equal to or greater than a percentage threshold; in response to a determination that the determined percentage is equal to or greater than the percentage threshold, selecting an augmented reality scenario associated with the real world trigger; and presenting, by the processor, the augmented reality scenario onto a display of the computing device by overlaying augmented reality content onto the series of frames of the video. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A non-transitory computer readable medium, which stores instructions executable by a processor to cause a computing device to:
-
capture an image of a real world trigger item from a series of frames of a video based on geographical metadata associated with a location where the video was captured; identify indexed feature points of a known candidate trigger item to d in a database that match feature points of the real world trigger item; perform a geometric consistency evaluation of the feature points of the real world trigger item, including compare an overall shape of a composite of individual tiles of the real world trigger item to an overall shape of each of the matching feature points of the known candidate trigger item; identify a required set of feature points for the real world trigger item, determine that the matching feature points of the known candidate trigger item include the required set of feature points; determine a percentage based on a number of the matching feature points of the known candidate trigger item relative to a total number of indexed feature points of the known candidate trigger item; determine whether the determined percentage is equal to or greater than a percentage threshold; in response to a determination that the determined percentage is equal to or greater than the percentage threshold, select an augmented reality scenario associated with the real world trigger; and overlay augmented reality content from the augmented reality scenario on a display of the computing device.
-
-
7. A computing device comprising
at least one processor; - and
a memory storing machine readable instructions to be executed by the at least one processor to cause the computing device to; index and store feature points associated with known candidate trigger items in one or more databases; capture an image of a real world trigger item from a series of frames of a video based on global positioning system information associated with a location where the video was captured; identify indexed feature points of a first known candidate trigger item stored in the one or more databases that match feature points of the real world trigger item; perform a geometric consistency evaluation, including compare an overall shape of a composite of individual tiles of the real world trigger item to an overall shape of each of the matching feature points of the known candidate trigger item; identify a required set of feature points for the real world trigger item; determine that the matching feature points of the first known candidate trigger item include the required set of feature points; determine a percentage based on a number of the matching feature points of the first known candidate trigger item relative to a total number of indexed feature points of the first known candidate trigger item; determine whether the determined percentage is equal to or greater than a percentage threshold; and in response to a determination that the determined percentage is equal to or greater than the percentage threshold, provide augmented reality content overlaid onto the series of frames of the video in the computing device. - View Dependent Claims (8)
- and
Specification