System and method for providing augmented reality challenges

• US 10,614,626 B2
• Filed: 09/14/2016
• Issued: 04/07/2020
• Est. Priority Date: 10/26/2005
• Status: Active Grant

• Current Assignee: Cortica Ltd.
• Original Assignee: Cortica Ltd.
• Inventors: Raichelgauz, Igal, Odinaev, Karina, Zeevi, Yehoshua Y
• Primary Examiner(s): Channavajjala, Srirama
• Application Number:
  US15/265,117
• Publication Number:
  US 20170004656A1
• Time in Patent Office: 1,301 Days
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A system and method for providing augmented reality challenges. The method includes obtaining at least one multimedia content element; causing generation of at least one signature for each obtained multimedia content element; determining, based on the generated signatures, at least one augmented reality challenge; identifying, based on the determined at least one augmented reality challenge, at least one augmented reality object; creating at least one challenge multimedia content element by causing addition of the at least one augmented reality object to the obtained at least one multimedia content element; and causing a display of the created at least one challenge multimedia content element.

Claims

1. A method for automatically providing augmented reality challenges, comprising:

capturing by a camera at least one multimedia content element;

generating at least one signature for each obtained multimedia content element;

determining, based on the at least one signature generated for each obtained multimedia content element, at least one augmented reality challenge;

identifying, based on the determined at least one augmented reality challenge, at least one augmented reality object;

creating at least one challenge multimedia content element by causing addition of the at least one augmented reality object to the obtained at least one multimedia content element;

causing a display, on a display of the user device, of the created at least one challenge multimedia content element;

sensing, by at least one sensor of the user device, a user response to the at least one augmented reality challenge; and

determining, based on at least the user response, whether the user completed the at least one challenge.

2. The method of claim 1, further comprising:

identifying metadata associated with at least one of;

a user of a user device, the user device and the obtained at least one multimedia content element, wherein the at least one augmented reality challenge is determined further based on the identified metadata.

3. The method of claim 2, further comprising:

determining, based on the identified metadata, whether the augmented reality challenge should be provided.

4. The method of claim 1, further comprising:

determining, based on the determined at least one augmented reality challenge, at least one challenge threshold;

wherein the determining whether the user completed the at least one challenge is responsive to the at least one challenge threshold; and

generating a notification indicating that the at least one augmented reality challenge was completed, when it is determined that the user completed the at least one challenge.

5. The method of claim 4, further comprising:

determining, based on the sensed user response, a user performance score.

6. The method of claim 1, further comprising:

generating at least one customized augmented reality challenge, wherein the determined at least one augmented reality challenge includes the at least one customized augmented reality challenge.

7. The method of claim 6, wherein generating the at least one customized augmented reality challenge further comprises:

analyzing metadata associated with at least one of;

a user of a user device, the user device, and the obtained at least one multimedia content element; and

determining, based on the analysis, at least one augmented reality challenge threshold, wherein the at least one customized augmented reality challenge is generated based on the at least one augmented reality challenge threshold.

8. The method of claim 6, wherein the at least one augmented reality challenge is determined further based on at least one threshold selection criterion.

9. The method according to claim 1 wherein the at least one augmented reality challenge requires a user of the user device to perform a physical activity to be completed;

wherein the physical activity to be completed is a physical task selected out of running, jumping, walking and climbing.

10. The method according to claim 1 wherein the determining of the at least one augmented reality challenge comprises:

storing in the memory only a limited set of concepts relative to a larger set of known concepts;

matching the at least one signature generated signatures that were generated for each obtained multimedia content element to the limited set of concepts to find at least one matching concept; and

utilizing metadata of the at least one matching concept to determine the at least one augmented reality challange.

11. The method according to claim 1 wherein the gerenating of the at least one signature for each obtained multimedia content element is executed by a plurality of computational cores of a signature generator;

wherein each computational core of the plurality of computational cores having properties that are at least partly statistically independent of other of the plurality of computational cores.

12. A non-transitory computer readable medium having stored thereon instructions for causing one or more processing units to execute a method, the method comprising:

capturing by a camera at least one multimedia content element;

generating at least one signature for each obtained multimedia content element;

determining, based on the at least one signature generated for each obtained multimedia content element, at least one augmented reality challenge;

identifying, based on the determined at least one augmented reality challenge, at least one augmented reality object;

creating at least one challenge multimedia content element by causing addition of the at least one augmented reality object to the obtained at least one multimedia content element;

causing a display, on a display of the user device, of the created at least one challenge multimedia content element;

sensing, by at least one sensor of the user device, a user response to the at least one augmented reality challenge; and

determining, based on at least the user response, whether the user completed the at least one challenge.

13. A system for automatically providing augmented reality challenges, comprising:

a camera, at least one sensor, a display, a processing circuitry, and a memory,

the memory containing instructions that, when executed by the processing circuitry, configure the system to;

capture, by the camera, at least one multimedia content element;

generate, at least one signature for each obtained multimedia content element;

determine, based on the at least one signature generated for each obtained multimedia content element, at least one augmented reality challenge;

identify, based on the determined at least one augmented reality challenge, at least one augmented reality object;

create at least one challenge multimedia content element by causing addition of the at least one augmented reality object to the obtained at least one multimedia content element;

cause a display, on the display, of the created at least one challenge multimedia content element;

sense, by the at least one sensor, a user response to the at least one augmented reality challenge; and

determine, based on at least the user response, whether the user completed the at least one challenge.

14. The system of claim 13, wherein the system is further configured to:

identify metadata associated with at least one of;

a user of a user device, the user device and the obtained at least one multimedia content element, wherein the at least one augmented reality challenge is determined further based on the identified metadata.

15. The system of claim 14, wherein the system is further configured to:

determine, based on the identified metadata, whether the augmented reality challenge should be provided.

16. The system of claim 13, wherein the system is further configured to:

determine, based on the determined at least one augmented reality challenge, at least one challenge threshold;

wherein a determining of whether the user completed the at least one challenge is responsive to the at least one challenge threshold; and

generate a notification indicating that the at least one augmented reality challenge was completed, when it is determined that the user completed the at least one challenge.

17. The system of claim 16, wherein the system is further configured to:

determine, based on the sensed user response, a user performance score.

18. The system of claim 13, wherein the system is further configured to:

generate at least one customized augmented reality challenge, wherein the determined at least one augmented reality challenge includes the at least one customized augmented reality challenge.

19. The system of claim 18, wherein the system is further configured to:

analyze metadata associated with at least one of;

a user of a user device, the user device, and the obtained at least one multimedia content element; and

determine, based on the analysis, at least one augmented reality challenge threshold, wherein the at least one customized augmented reality challenge is generated based on the at least one augmented reality challenge threshold.

20. The system of claim 18, wherein the at least one augmented reality challenge is determined further based on at least one threshold selection criterion.