Systems and methods for mobile application, wearable application, transactional messaging, calling, digital multimedia capture and payment transactions

• US 9,342,829 B2
• Filed: 08/01/2015
• Issued: 05/17/2016
• Est. Priority Date: 10/01/2002
• Status: Expired due to Fees

• Current Assignee: Andrew H.B. Zhou, Dylan T.X. Zhou, Tiger T.G. Zhou, Wesley Cheng
• Original Assignee: Andrew H.B. Zhou, Dylan T.X. Zhou, Tiger T.G. Zhou, Wesley Cheng
• Inventors: Zhou, Andrew H B, Cheng, Wesley, Zhou, Dylan T X, Zhou, Tiger T G
• Primary Examiner(s): WALSH, DANIEL I
• Application Number:
  US14/815,988
• Publication Number:
  US 20150371215A1
• Time in Patent Office: 290 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06Q 20/321 using wearable devices
• CPC Class Codes: G06Q 20/3274 using a pictured code, e.g. barcode or QR-code, being displayed on the M-device
• CPC Class Codes: G06Q 20/3276 using a pictured code, e.g. barcode or QR-code, being read by the M-device
• CPC Class Codes: G06Q 20/3829 involving key management
• CPC Class Codes: G06Q 20/384 using social networks
• CPC Class Codes: G06Q 20/386 using messaging services or messaging apps using mobile network messaging services for payment, e.g. SMS G06Q20/3255
• CPC Class Codes: G06Q 20/4015 using location information
• CPC Class Codes: G06Q 2220/00 Business processing using cryptography postage metering system using cryptography G06Q2250/05
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0209 Incentive being awarded or redeemed in connection with the playing of a video game
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: G10L 13/02 Methods for producing synthetic speech; Speech synthesisers
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: H04L 65/1104 Session initiation protocol [SIP]

Abstract

Systems and method are disclosed for multimedia capture and encrypting using an ephemeral messaging and multimedia application associated with a digital device for secured payment by selecting as a first user input a haptic control for a particular type of multimedia content to be captured; interacting as a second user input with a touch display of the digital device by touching a touch display and holding a touch contact of a user finger or stylus for a predetermined time; capturing multimedia content based on the contact and sending a command to a sensor, of the digital device to capture video and starting a timer to determine a duration of the touch contact of the user with the touch display; and making a secured payment with the digital device.

Claims

1. A method for multimedia capture and encrypting using an ephemeral messaging and multimedia application associated with a mobile and wearable digital device, the method comprising:

selecting as a first user input a haptic control for a particular type of multimedia content to be captured;

interacting as a second user input with a touch display of the digital device by touching a touch display and holding a touch contact of a user finger or stylus for a predetermined time, wherein the touching comprises a first user input and a release after the predetermined time comprises a second user input;

analyzing data associated with the first user input and the second user input, the analyzing including calculating time between the first user input and the second user input;

based on the analysis, selecting one or more multimedia types for recording from the captured multimedia based on predetermined rules associated with the predetermined time;

sending a command to a sensor of the digital device to capture video to memory of the selected multimedia type based on the predetermined rules;

modify the one or more recorded multimedia types, by a cloud-based voice changing unit, to obtain one or more modified multimedia types;

encrypting, via an encryption unit one or more of the recorded multimedia types and the modified multimedia types to prepare the one or more multimedia types for sending; and

storing the one or more multimedia types in a memory operable, wherein the cloud-based voice changing unit is coupled to a payment processor coupled;

providing an integrated interface for selection of an activity mode, wherein the activity mode includes a messaging mode, a calling mode, and a one-touch payment mode;

receiving the selection of the activity mode via the integrated interface from a user;

if the messaging mode is selected, receiving a message from the user, the message being sent to a recipient via a data network; and

if the calling mode is selected, initiating a data network call on a call request of the user; and

if the one-touch payment mode is selected, transmitting a payment request to a financial organization, wherein the payment request is generated using data of an actual page on the mobile and wearable device; and

encrypting the payment request associated with the one-touch payment mode to obtain an encrypted payment request, wherein the encrypted payment request is decryptable by an ephemeral messaging, one-touch payment, and multimedia application of a mobile and wearable device of the recipient, wherein the encrypted payment request is removed from the mobile and wearable device of the recipient after the encrypted payment request is optically read;

wherein the ephemeral messaging, one-touch payment, and multimedia application is associated with an application protocol, the application protocol being integrated into a communication platform; and

receiving, from the user, a registration request to register the user in a mobile payment service, wherein the user sends the registration request via a mobile payment application associated with the mobile and wearable device, the mobile payment application providing at least a free VoIP service and a free Over-the-Top (OTT) service;

securing the mobile and wearable device comprises via a band to a part of a human body, the part of the human body including a wrist, an arm, a neck, a bead, a leg., a waist, an ear, and a finger, securing, via the band, the mobile and wearable device under, within or on clothing, including a within the band, a rechargeable battery configured to power the mobile and wearable device;

operably connecting a database to the digital device; and

wherein database stores financial information of the user providing during user registration with the system;

wherein the receiving of the selection of the activity mode includes a voice command, a haptic interaction with a touchscreen of the mobile and wearable device, and a move command, wherein the mobile and wearable device comprises one or more haptic control elements to control operation or functions of the mobile and wearable device, and controlling access to the mobile and wearable device by one or more of the following;

a password, a Personal Identification Number code, and biometric authorization, the biometric authorization including fingerprint scanning, palm scanning, face scanning, and retina scanning, wherein the scanning is performed using the one or more biometric sensors, wherein the one or more biometric sensors include sensors for sensing a command for the one-touch payment mode, the sensing shown on the display, the mobile and wearable device further comprising a fingerprint reader configured to scan a fingerprint, the scanned fingerprint being matched to one or more approved fingerprints, wherein access to the mobile and wearable personal digital is granted based on the matching;

wherein the mobile and wearable device further comprises a camera configured to capture one or more codes, the one or more codes including electronic key data, a link to a web-resource, a payment request, and advertising information, wherein the one or more codes include barcode, a linear dimensional code, a two-dimensional code, a snap tag code, and a QR code;

wherein the mobile and wearable device obtains information about a payment system of the user, wherein the mobile and wearable device generates and displays a barcode that encodes user payment information, scanning and processing the barcode at a checkout counter to retrieve the user payment information from a database of a payment processing system, the user payment information being used to transfer funds between the user and the recipient, wherein the recipient is a merchant;

associating the mobile and wearable device is associated with an electronic payment card configured to act as one or more of a smart card, a proximity card, an integrated circuit card, a magnetic strip card, and an electronic payment card, the electronic payment card storing card data of one or more debit cards, credit cards, gift cards, loyalty cards, prepaid cards, bank cards, identity cards, and membership cards, wherein the electronic payment card is configured to attach to the mobile and wearable device;

wherein the method further comprises scanning the code, the code being present on a one-touch QR code invoice, the one-touch QR code invoice storing one or more of invoice data, monetary amount summary, product data, service data, merchant data, invoice number, and amount to be paid, the one-touch QR code invoice being associated with one or more of an invoice, a credit note, a debit note, a pro forma invoice, and an advance invoice; and

storing one-touch payment information in the mobile card wearable device associated with the user, wherein the user activates the one-touch payment mode by holding the mobile and wearable device near a contactless reader card activating a one-touch payment icon on the mobile and wearable device and makes a secure payment, authorized in part when the location of the payment matches with a determined location of the device.

2. The method of claim 1, wherein the first user input includes touch engagement of the user with a display of the digital device;

and wherein the second user input includes touch release of the user from a display of the digital device.

3. The method of claim 1, further comprising:

based on the first user input, starting the timer; and

based on the second user input, stopping the timer; and

calculating time between the first user input and the second user input.

4. The method of claim 3, comprising analyzing is based on the time between the first user input and the second user input.

5. The method of claim 1, wherein the multimedia type includes text, video, image, audio, and animation.

6. The method of claim 1, wherein the predetermined rules associate the multimedia type with time between the first user input and the second user input.

7. The method of claim 1, wherein the captured multimedia includes video.

8. The method of claim 7, wherein the text is recorded from the captured multimedia based on one or more of text recognition and speech recognition.

9. The method of claim 7, wherein the image is recorded from the captured multimedia by selecting a frame in the captured multimedia.

10. The method of claim 7, wherein the audio is recorded from the captured multimedia by selecting audio content in the captured multimedia.

11. The method of claim 7, wherein the animation is recorded from the captured multimedia by selecting two or more frames in the captured multimedia and cycling the selected two or more frames.

12. The method of claim 1, comprising encrypting data by assigning a unique key to each of the recorded multimedia types and the modified multimedia types.

13. The method of claim 12, further comprising sending the unique key to an encryption verification unit, wherein the encryption verification unit includes a key storage.

14. The method of claim 12, wherein the encrypting includes converting the recorded multimedia types and the modified multimedia types into Encrypted Trusted Data Format (ETDF) files.

15. The method of claim 1, further comprising verifying user identity with an existing user account, wherein the existing user account includes one or more of an e-mail account, a social network account, and a filesharing account.

16. The method of claim 1, comprising:

receiving, by one or more processors, the first user input for initiating one or more sensors to capture multimedia to obtain captured multimedia;

receiving, by the one or more processors, the second user input;

analyzing, by the one or more processors, data associated with the first user input and the second user input;

based on the analysis, selecting, by the one or more processors, one or more multimedia types for recording from the captured multimedia based on predetermined rules;

recording, by the one or more processors, the selected one or more multimedia types to a memory to obtain one or more recorded multimedia types;

modifying, by a cloud-based voice changing unit, the one or more recorded multimedia types to obtain one or more modified multimedia types;

encrypting, by an encryption unit, one or more of the recorded more multimedia types and the modified multimedia types to obtain one or more encrypted multimedia types, wherein the one or more encrypted multimedia types are decryptable by an ephemeral messaging and multimedia application associated with a mobile and wearable device of a recipient, the one or more encrypted multimedia types being removed from the mobile and wearable device of the recipient after being read; and

receiving, by the one or more processors, from a user, a registration request to register the user in a mobile payment service, wherein the user sends the registration request via a mobile payment application associated with the digital device associated with the user, the mobile payment application providing at least a free Voice over Internet Protocol (VoIP) service and a free Over-the-Top (OTT) service;

wherein the ephemeral messaging and multimedia application is associated with an application protocol, the application protocol being integrated into a communication platform.

17. The method of claim 1, wherein the modifying includes one or more of the following:

creating voices for online video games and avatars, voice disguising for anonymity over the radio or internet, changing voices for voiceovers and audio projects, modify user voice based on user preferences.

18. The method of claim 1, further comprising applying audio effects to the multimedia during the capture of multimedia.

19. The method of claim 1, comprising requesting payment with a payment recipient, a payment amount, and user financial information associated with the user, wherein the payment recipient and the payment amount are received from the at least one mobile application, and the user financial information is stored on the mobile and wearable device.

20. A system for multimedia capture and encrypting using an ephemeral messaging and multimedia application associated with a mobile and wearable digital device, the system comprising:

one or more sensors operable to capture multimedia to obtain captured multimedia;

one or more processors operable to;

receive a first user input;

initiate, based on the first user input, the one or more sensors to capture multimedia;

based on the first user input, start a timer;

receive a second user input;

based on the second user input, stop the timer;

analyze data associated with the first user input and the second user input, the analyzing including calculating time between the first user input and the second user input, wherein the first user input is a user touch of the device and the second user input is a user release of the device after the first user input;

based on the analysis, select one or more multimedia types for recording from the captured multimedia based on predetermined rules; and

record the selected one or more multimedia types to a memory to obtain one or more recorded multimedia types; and

a cloud-based voice changing unit operable to;

modify the one or more recorded multimedia types to obtain one or more modified multimedia types;

an encryption unit operable to;

encrypt one or more of the recorded multimedia types and the modified multimedia types to prepare the one or more multimedia types for sending; and

a memory operable to store the one or more multimedia types; and

a payment processor coupled to the cloud-based voice changing unit;

the one or more processors configured to;

provide an integrated interface for selection of an activity mode, wherein the activity mode includes a messaging mode, a calling mode, and a one-touch payment mode;

receive the selection of the activity mode via the integrated interface from a user;

if the messaging mode is selected, receive a message from the user, the message being sent to a recipient via a data network; and

if the calling mode is selected, initiate a data network call on a call request of the user; and

if the one-touch payment mode is selected, transmit a payment request to a financial organization, wherein the payment request is generated using data of an actual page on the mobile and wearable device; and

encrypt the payment request associated with the one-touch payment mode to obtain an encrypted payment request, wherein the encrypted payment request is decryptable by an ephemeral messaging, one-touch payment, and multimedia application of a mobile and wearable device of the recipient, wherein the encrypted payment request is removed from the mobile and wearable device of the recipient after the encrypted payment request is optically read;

wherein the ephemeral messaging, one-touch payment, and multimedia application is associated with an application protocol, the application protocol being integrated into a communication platform; and

receive, from the user, a registration request to register the user in a mobile payment service, wherein the user sends the registration request via a mobile payment application associated with the mobile and wearable device, the mobile payment application providing at least a free VoIP service and a free Over-the-Top (OTT) service;

wherein the mobile and wearable device comprises a band adapted to secure the mobile and wearable device on a human body, the human body including a wrist, an arm, a neck, a bead, a leg., a waist, an ear, and a finger, wherein the band is adapted to secure the mobile and wearable device under, within or on clothing, wherein the band includes a rechargeable battery configured to power the mobile and wearable device; and

wherein the system further comprises a database in communication with the processor, the database storing user financial information provided by the user during registration with the application;

wherein the receiving of the selection of the activity mode includes a voice command, a haptic interaction with a touchscreen of the mobile and wearable device, and a move command, wherein the mobile and wearable device comprises one or more haptic control elements to control operation or functions of the mobile and wearable device, and wherein access to the mobile and wearable device is controlled by one or more of the following;

a password, a Personal Identification Number code, and biometric authorization, the biometric authorization including fingerprint scanning, palm scanning, face scanning, and retina scanning, wherein the scanning is performed using the one or more biometric sensors, wherein the one or more biometric sensors include sensors for sensing a command for the one-touch payment mode, the sensing shown on the display, the mobile and wearable device further comprising a fingerprint reader configured to scan a fingerprint, the scanned fingerprint being matched to one or more approved fingerprints, wherein access to the mobile and wearable personal digital is granted based on the matching;

wherein the mobile and wearable device further comprises a camera configured to capture one or more codes, the one or more codes including electronic key data, a link to a web-resource, a payment request, and advertising information, wherein the one or more codes include barcode, a linear dimensional code, a two-dimensional code, a snap tag code, and a QR code;

wherein the mobile and wearable device is operable to obtain information about a payment system of the user, wherein the mobile and wearable device is operable to generate and display a barcode that encodes user payment information, the barcode being scanned at a checkout counter and processed to retrieve the user payment information from a database of a payment processing system, the user payment information being used to transfer funds between the user and the recipient, wherein the recipient is a merchant;

wherein the mobile and wearable device is associated with an electronic payment card configured to act as one or more of a smart card, a proximity card, an integrated circuit card, a magnetic strip card, and an electronic payment card, the electronic payment card storing card data of one or more debit cards, credit cards, gift cards, loyalty cards, prepaid cards, bank cards, identity cards, and membership cards, wherein the electronic payment card is configured to attach to the mobile and wearable device;

wherein the system further comprises scanning the code, the code being present on a one-touch QR code invoice, the one-touch QR code invoice storing one or more of invoice data, monetary amount summary, product data, service data, merchant data, invoice number, and amount to be paid, the one-touch QR code invoice being associated with one or more of an invoice, a credit note, a debit note, a pro forma invoice, and an advance invoice; and

wherein one-touch payment information is stored in the mobile card wearable device associated with the user, wherein the user activates the one-touch payment mode by holding the mobile and wearable device near a contactless reader card activating a one-touch payment icon on the mobile and wearable device and makes a secure payment, authorized in part when the location of the payment matches with a determined location of the device.

21. The method of claim 20, wherein the user financial information includes one or more of the following:

bank account information, credit card information, debit card information, gift card information, prepaid card information, insurance account information, merchant account information, mobile currency information, and digital money.

22. The method of claim 20, wherein the one-touch payment mode is used for internet payments, wherein the one-touch payment mode is integrated with one or more of text messaging, hold-to-talk voice messaging, broadcast messaging, sharing of photographs and videos, and location sharing, wherein the one-touch payment mode is associated with exchanging contacts and payments with users nearby via Bluetooth, providing contacting the users at random one-touch payments, and wherein the one-touch payment mode is associated with social networking services, wherein the one-touch payment mode has a common interface with a proprietary, cross-platform instant messaging subscription service for mobile and wearable devices;

wherein the one-touch payment mode is integrated with a telecommunications application software, the telecommunications application software specializing in providing a video chat, a voice call, and a conference call from mobile and wearable devices;

wherein the one-touch payment mode is compatible with one or more operating systems, wherein the one or more operating systems include Microsoft Windows, Mac, Linux, Android, Blackberry, iOS, and Windows Phone;

wherein a one-touch payment service associated with the one-touch payment mode is free, wherein the one-touch payment mode includes a freemium mode.

23. The method of claim 20, wherein the mobile and wearable device is configured to act as one or more of the following:

a mechanical hybrid smart watch, a smart watch, a digital computing glasses, a digital bracelet, a mobile interact device, a mobile web device, a smartphone, a tablet computer, a wearable computer, a calculator watch, a smartwatch, a head-mounted display, a personal digital assistant, a enterprise digital assistant, a calculator, a handheld game console, a portable media player, an ultra-mobile personal computer, a digital still camera, a digital video camera, a mobile phone, a feature phone, a pager, and a personal navigation device.

24. The system of claim 20, wherein the first user input includes touch engagement of the user with a display of the digital device;

and

wherein the second user input includes touch release of the user with a display of the digital device.

25. The system of claim 20, wherein the analyzing is based on the time between the first user input and the second user input.

26. The system of claim 20, wherein the cloud-based voice changing unit is operable to create a play list from the multimedia types on the digital device and broadcast the created play list.

27. The system of claim 20, wherein the cloud-based voice changing unit is operable to slow down the recorded multimedia type without changing pitch of the recorded multimedia type.

28. The system of claim 20, wherein the cloud-based voice changing unit is operable to enable one or more of the following:

making a voice chat with PC-to-phone applications, making a voice calls with PC-to-phone applications, making a song remix, and speaking over the Internet and soft-phone using customizable text-to-speech voices.

29. The system of claim 20, wherein the cloud-based voice changing unit is operable to work in real time while using voice chat.

30. The system of claim 20, wherein the cloud-based voice changing unit is operable to modify the recorded multimedia types by performing one or more of the following:

correcting pitch of a vocal track, aligning vocal tracks together, fixing rhythm of a particular vocal line, applying a robotic effect to the vocal track, transposing a vocal track, adding backup vocals to the vocal track, reversing the effects of pitch correction, adding distortion to the vocal track, changing pitch-sensitive fundamental waves of voice in the recorded multimedia type, and morphing voice and suppressing background voice to obtain voice optimized for online games.

31. The system of claim 20, wherein the modifying includes modifying pitch, format, noise threshold, and applying echo.

32. The system of claim 20, wherein the cloud-based voice changing unit is operable to use electronic circuits to change or buffer unnatural sounds.

33. The system of claim 20, wherein the system is associated with one or more of a transactional payment based on Unstructured Supplementary Service Data, Short Message Service, direct operator billing, a credit card mobile payment, an online wallet, a QR code payment, contactless near field communication payment, a cloud-based mobile payment, an audio signal-based payment, a Bluetooth Low Energy signal beacon payment, an in-application payment, a software development kit (SDK) payment, an application programming interface (API) payment, a social networking payment, and a direct carrier and bank co-operation, wherein the system is compatible with a third party application, wherein the system is associated with one or more of an API and an SDK, wherein the system is further associated with a fingerprint touch recognition payment, a fingerprint press recognition payment, a gesture mark payment, a voice command payment, and a eye blink payment, a fingerprint swipe recognition payment, and a nod payment.

34. The system of claim 20, wherein the message includes a text, an audio, a video, and geographical data, wherein the message is sent to a controlled list of recipients, wherein the user sets a time limit for the recipient to view the message, wherein after the time limit the message is deleted from a mobile and wearable device associated with the recipient.

35. The system of claim 20, wherein the data network call is performed via a VoIP service.

36. The system of claim 20, wherein the VoIP service is provided via Wi-Fi, 3G network, 4G network, 5G network, 6G network or upper.

37. The system of claim 20, wherein the call includes an audio call, a video call, and a holographic video call.

38. The system of claim 20, wherein the receiving of the selection of the activity mode includes a voice command, a haptic interaction with a touchscreen, and a move command.

39. The system of claim 20, wherein the payment request includes a payment recipient, a payment amount, and user financial information associated with the user, wherein the payment recipient and the payment amount are received from the at least one mobile application, and the user financial information is stored on the mobile and wearable device.