AUGMENTED REALITY MESSAGING SYSTEM AND METHOD BASED ON MULTI-FACTOR RECOGNITION

• US 20140076965A1
• Filed: 09/14/2012
• Published: 03/20/2014
• Est. Priority Date: 09/14/2012
• Status: Active Grant

• Current Assignee: William Becorest, Yongkeng Xiao
• Original Assignee: William Becorest, Yongkeng Xiao
• Inventors: BECOREST, William, Xiao, Yongkeng
• Granted Patent: US 9,092,774 B2
• Time in Patent Office: Days
• US Class Current: 235/380
• CPC Class Codes: G06Q 20/342 Cards defining paid or billed services or quantities
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor

Abstract

Enables creating, displaying, and managing augmented reality (AR) messages linked to objects that display or contain identifiable information such as codes, including card products/prepaid card products, etc. Applies multi-factor recognition technology to process an object/card having a unique code. May utilize an application on a mobile device/computer, to capture an image of the object, recognize the signature of the object, convert the code into alphanumeric digits and generate a Unique Identification Token (UIT). The application can create a personalized AR message, e.g., text, 2D/3D image, freehand drawing, animation, video, audio, avatar character, or any combination, optionally enhanced with pre-made templates. The completed message is stored in a remote database with the UIT. The recipient of the object/card uses the application and captures an image of the object or card image with code, triggering the message experience that may display account balance information and targeted advertising.

Claims

1. An augmented reality messaging system based on multi-factor recognition comprising:

a remote server configured to store an augmented reality-based personalized message;

an application configured to execute on a computer configured to communicate with said remote server wherein said computer is associated with a recipient of an object having an identifier and wherein said application that executes on said computer is configured to

identify the identifier and visual characteristics associated with said object and produce an originator signature for an originator of said object after said recipient receives said object from a giver of said object;

generate a unique identification token for said object based on said identifier and said originator signature;

retrieve said augmented reality-based personalized message from said remote server based on said unique identification token; and

,

display said augmented reality-based personalized message on said computer associated with said recipient.

2. The system according to claim 1, wherein said identifier is an account code associated with said object.

3. The system according to claim 1, wherein said object is a prepaid card product, identification card or credit card or debit card and said identifier is an account code associated with said object.

4. The system according to claim 1, wherein said computer is further configured to:

capture an image of said object and said identifier;

apply image recognition to identify visual elements within said image, and map location coordinates of said elements;

extract said identifier from said image and determine relative location coordinates of said identifier on said object;

apply character recognition on said identifier of said object;

extract any background elements from said image, wherein said background element comprise any combination of one or more logo, graphical or text elements on said object, into a collection of background objects with relative location coordinates respectively;

extract said visual characteristics from said collection of background objects and said relative location coordinates to produce said originator signature of said object.

5. The system according to claim 1, wherein said computer is further configured to:

create said augmented reality-based personalized message and associate said augmented reality-based personalized message with said unique identification token.

6. The system according to claim 1, wherein said computer is further configured to:

access an available balance or account information that is linked to said object from said originator;

create said augmented reality-based personalized message that includes said available balance or account information and associate said augmented reality-based personalized message with said unique identification token.

7. The system according to claim 6, wherein said computer is further configured to:

map said originator signature to a computer associated with said originator;

send an available balance or account information request to said computer associated with said originator based on said identifier of said object;

retrieve said available balance or account information that is linked to said object.

8. The system according to claim 1, wherein said computer is further configured to:

create a viewing receipt request and link said viewing receipt request to said unique identification token in said remote server;

change said viewing receipt request to a viewed state in said remote server after said personalized message is viewed by said recipient;

send notification to said giver to indicate said recipient viewed said personalized message.

9. The system according to claim 1, wherein said computer is further configured to:

receive a thank you message from said recipient and link said thank you message to said unique identification token in said remote server;

send said thank you message to said giver.

10. The system according to claim 1, wherein said computer is further configured to:

differentiate any object issued by a first originator from any object issued by a second originator that differs from said first originator;

differentiate any object from any other objects issued by one of either said first originator or said second originator.

11. The system according to claim 1, further comprising:

an application configured to execute on a second computer configured to communicate with said remote server wherein said second computer is associated with said giver of said object and wherein said application that executes on said second computer is configured to

accept input to create said augmented reality-based personalized message that includes any combination of one or more text message, freehand picture, voice clip, 2D image, 3D image, prerecorded audio or video, live audio or video, 2D or 3D animated character and animated character voice;

combine said object identifier and said originator signature to uniquely identify said object; and

,

store said unique identification token in said remote server along with said input to create said augmented reality-based personalized message.

12. An augmented reality messaging method based on multi-factor recognition comprising:

identifying an identifier and visual characteristics associated with a object and producing an originator signature for an originator of said object using an applications that executes on a computer associated with a recipient of said object after receiving said object from a giver of said object;

generating a unique identification token for said object using said identifier and said originator signature;

retrieving an augmented reality-based personalized message from a remote server based on said unique identification token; and

,

displaying said augmented reality-based personalized message on said computer associated with said recipient.

13. The method according to claim 12, wherein said identifier is an account code associated with said object.

14. The method according to claim 12, wherein said object is a prepaid card product, identification card or credit card or debit card and said identifier is an account code associated with said object.

15. The method according to claim 12, wherein said identifying comprises:

capturing an image of said object and said identifier;

applying image recognition to identify visual elements within said image, and mapping location coordinates of said elements;

extracting said identifier from said image with and determining relative location coordinates of said identifier on said object;

applying character recognition on said identifier of said object;

extracting any background elements from said image, wherein said background element comprise any combination of one or more logo, graphical or text elements on said object, into a collection of background objects with relative location coordinates respectively;

extracting said visual characteristics from said collection of background objects and said relative location coordinates to produce said originator signature of said object.

16. The method according to claim 12, further comprising:

creating said augmented reality-based personalized message and associating said augmented reality-based personalized message with said unique identification token.

17. The method according to claim 12, further comprising:

accessing an available balance or account information that is linked to said object from said originator;

creating said augmented reality-based personalized message that includes said available balance or account information and associating said augmented reality-based personalized message with said unique identification token.

18. The method according to claim 17, wherein said accessing the available balance comprises:

mapping said originator signature to a computer associated with said originator;

sending an available balance or account information request to said computer associated with said originator using said identifier of said object;

retrieving said available balance or account information that is linked to said object.

19. The method according to claim 12, further comprising:

creating a viewing receipt request and linking said viewing receipt request to said unique identification token in said remote server;

changing said viewing receipt request to a viewed state in said remote server after said personalized message is viewed by said recipient;

sending notification to said giver to indicate said recipient viewed said personalized message.

20. The method according to claim 12, further comprising:

receiving a thank you message from said recipient and linking said thank you message to said unique identification token in said remote server;

sending said thank you message to said giver.

21. The method according to claim 12 further comprising:

differentiating any object issued by a first originator from any object issued by a second originator that differs from said first originator;

differentiating any object from any other objects issued by one of either said first originator or said second originator.

22. The method according to claim 12, wherein said generating said unique identification token comprises:

accepting input to create said augmented reality-based personalized message that includes any combination of one or more text message, freehand picture, voice clip, 2D image, 3D image, prerecorded audio or video, live audio or video, 2D or 3D animated character and animated character voice;

combining said identifier and said originator signature to uniquely identify said object; and

,

storing said unique identification token in said remote server along with said input to create said augmented reality-based personalized message.