Intelligent method of determining trigger items in augmented reality environments
First Claim
1. A computer-implemented method comprising:
- processing a stream of frames of a scene captured using a camera of a mobile computing device when operated by a user;
performing image recognition to recognize, from one or more frames of the stream of frames, a trigger item corresponding to any one of a symbol, person, or object depicted in the scene; and
in response to performing image recognition, (i) determining an augmented reality scenario that includes an augmented reality content item generated by a second user of another computing device using an image of a symbol, person or object that is deemed to sufficiently match the trigger item based on a predetermined confidence factor, and (ii) presenting, on a display, the augmented reality scenario with the trigger item, as the trigger item is depicted in the stream of frames of the scene.
3 Assignments
0 Petitions
Accused Products
Abstract
The systems and methods may allow mobile computing devices to identify real world trigger items and to cause augmented reality scenarios associated with a real world trigger item to be presented on a display of the mobile computing device. A lookup scheme may identify indexed feature points of known candidate trigger items stored in a database. A number of evaluations occur between the indexed feature points to the feature points found in the real world trigger item. A determination that the feature points of a candidate trigger item matches the feature points of the real world trigger item is made when a confidence threshold is met or exceeded based on at least the look up scheme, weighted factor evaluation, variable threshold evaluation and potentially a geometric consistency evaluation to declare a positive match.
49 Citations
20 Claims
-
1. A computer-implemented method comprising:
-
processing a stream of frames of a scene captured using a camera of a mobile computing device when operated by a user; performing image recognition to recognize, from one or more frames of the stream of frames, a trigger item corresponding to any one of a symbol, person, or object depicted in the scene; and in response to performing image recognition, (i) determining an augmented reality scenario that includes an augmented reality content item generated by a second user of another computing device using an image of a symbol, person or object that is deemed to sufficiently match the trigger item based on a predetermined confidence factor, and (ii) presenting, on a display, the augmented reality scenario with the trigger item, as the trigger item is depicted in the stream of frames of the scene. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to:
-
process a stream of frames of a scene detected by a camera of a mobile computing device in real-time, the mobile computing device being operated by a user; perform image recognition to recognize, from one or more frames of the stream of frames, a trigger item corresponding to any one of a symbol, person, or object depicted in the scene; and in response to performing image recognition, (i) determine an augmented reality scenario that includes an augmented reality content item generated by a second user of another computing device using an image of a symbol, person or object that is deemed to sufficiently match the trigger item based on a predetermined confidence factor, and (ii) provide for display, the augmented reality scenario with the trigger item as the trigger item is depicted in the stream of frames of the scene. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A mobile computing device, comprising:
-
a camera; a display; one or more memory resources storing instructions; and a processor, coupled to the camera, the display, and the one or more memory resources, to execute the instructions, wherein the instructions, when executed by the processor, cause the mobile computing device to; process a stream of frames of a scene captured using the camera in real-time, the mobile computing device being operated by a user; initiate performance of image recognition to recognize, from analysis of one or more frames of the stream of frames, a trigger item in at symbol, person, or object depicted in the scene; and in response to the image recognition being performed, (i) determine an augmented reality scenario that includes an augmented reality content item generated by a second user of another computing device using an image of a symbol, person or object that is deemed to sufficiently match the trigger item based on a predetermined confidence factor, and (ii) present, on the display, the augmented reality scenario with the trigger item as the trigger item is depicted in the stream of frames of the scene in real-time. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification