Systems and methods for digital multimedia capture using haptic control, cloud voice changer, and protecting digital multimedia privacy

• US 8,968,103 B2
• Filed: 03/06/2014
• Issued: 03/03/2015
• Est. Priority Date: 11/02/2011
• Status: Expired due to Fees

• Current Assignee: Andrew H.B. Zhou, Dylan T.X. Zhou, Tiger T.G. Zhou
• Original Assignee: Andrew H.B. Zhou, Dylan T.X. Zhou, Tiger T.G. Zhou
• Inventors: Zhou, Andrew H B, Zhou, Tiger T G, Zhou, Dylan T X
• Primary Examiner(s): Rowland, Steve
• Application Number:
  US14/198,683
• Publication Number:
  US 20140189354A1
• Time in Patent Office: 362 Days
• Field of Search: 463/35, 463/42
• US Class Current: 463/42
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/87 Communicating with other players during game play, e.g. by e-mail or chat
• CPC Class Codes: G06F 21/00 Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
• CPC Class Codes: G06F 21/42 using separate channels for security data
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0209 Incentive being awarded or redeemed in connection with the playing of a video game
• CPC Class Codes: G06Q 30/0273 Determination of fees for advertising
• CPC Class Codes: G10L 2021/0135 Voice conversion or morphing
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/2347 involving video stream encryption
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/2747 Remote storage of video programs received via the downstream path, e.g. from the server
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

Provided are computer implemented methods and systems for multimedia capture and encrypting. According to the method, a first user input is received. Based on the first user input, one or more sensors are initiated to capture multimedia to obtain captured multimedia. The method further comprises receiving a second user input. Upon receiving the second user input, data associated with the first user input and the second user input are analyzed. Based on the analysis, one or more multimedia types are selected for recording from the captured multimedia based on predetermined rules. The selected one or more multimedia types are recorded to a memory. The recorded multimedia types are modified by a cloud-based voice changing unit. Furthermore, the recorded multimedia types and the modified multimedia types are encrypted to prepare the one or more multimedia types for sending to an intended recipient.

Claims

1. A method for multimedia capture and encrypting using an ephemeral messaging and multimedia application associated with a digital device, the method comprising:

receiving, by one or more processors, a first user input;

based on the first user input, initiating one or more sensors to capture multimedia to obtain captured multimedia;

receiving, by the one or more processors, a second user input;

analyzing, by the one or more processors, data associated with the first user input and the second user input;

based on the analysis, selecting, by the one or more processors, one or more multimedia types for recording from the captured multimedia based on predetermined rules;

recording, by the one or more processors, the selected one or more multimedia types to a memory to obtain one or more recorded multimedia types;

modifying, by a cloud-based voice changing unit, the one or more recorded multimedia types to obtain one or more modified multimedia types;

encrypting, by an encryption unit, one or more of the recorded more multimedia types and the modified multimedia types to obtain one or more encrypted multimedia types, wherein the one or more encrypted multimedia types are decryptable by an ephemeral messaging and multimedia application associated with a mobile and wearable device of a recipient, the one or more encrypted multimedia types being removed from the mobile and wearable device of the recipient after being read; and

receiving, by the one or more processors, from a user, a registration request to register the user in a mobile payment service, wherein the user sends the registration request via a mobile payment application associated with the digital device associated with the user, the mobile payment application providing at least a free Voice over Internet Protocol (VoIP) service and a free Over-the-Top (OTT) service;

wherein the ephemeral messaging and multimedia application is associated with an application protocol, the application protocol being integrated into a communication platform.

2. The method of claim 1, wherein the first user input includes touch engagement of the user with a display of the digital device;

and

wherein the second user input includes touch release of the user from a display of the digital device.

3. The method of claim 1, further comprising:

based on the first user input, starting a timer; and

based on the second user input, stopping the timer; and

calculating time between the first user input and the second user input.

4. The method of claim 3, wherein the analyzing is based on the time between the first user input and the second user input.

5. The method of claim 1, wherein the multimedia type includes text, video, image, audio, and animation.

6. The method of claim 1, wherein the predetermined rules associate the multimedia type with time between the first user input and the second user input.

7. The method of claim 1, wherein the captured multimedia includes video.

8. The method of claim 7, wherein the text is recorded from the captured multimedia based on one or more of text recognition and speech recognition.

9. The method of claim 7, wherein the image is recorded from the captured multimedia by selecting a frame in the captured multimedia.

10. The method of claim 7, wherein the audio is recorded from the captured multimedia by selecting audio content in the captured multimedia.

11. The method of claim 7, wherein the animation is recorded from the captured multimedia by selecting two or more frames in the captured multimedia and cycling the selected two or more frames.

12. The method of claim 1, wherein the encrypting includes assigning a unique key to each of the recorded multimedia types and the modified multimedia types.

13. The method of claim 12, further comprising sending the unique key to an encryption verification unit, wherein the encryption verification unit includes a key storage.

14. The method of claim 1, wherein the encrypting includes converting the recorded multimedia types and the modified multimedia types into Encrypted Trusted Data Format (ETDF) files.

15. The method of claim 1, further comprising verifying user identity with an existing user account.

16. The method of claim 15, wherein the existing user account includes one or more of an e-mail account, a social network account, and a filesharing account.

17. The method of claim 1, wherein the modifying includes one or more of the following:

creating voices for online video games and avatars, voice disguising for anonymity over the radio or internet, changing voices for voiceovers and audio projects, modify user voice based on user preferences.

18. The method of claim 1, further comprising applying audio effects to the multimedia during the capture of multimedia.

19. A system for multimedia capture and encrypting using an ephemeral messaging and multimedia application associated with a digital device, the system comprising:

one or more sensors operable to capture multimedia to obtain captured multimedia;

one or more processors operable to;

receive a first user input;

initiate, based on the first user input, the one or more sensors to capture multimedia;

based on the first user input, start a timer;

receive a second user input;

based on the second user input, stop the timer;

analyze data associated with the first user input and the second user input, the analyzing including calculating time between the first user input and the second user input;

based on the analysis, select one or more multimedia types for recording from the captured multimedia based on predetermined rules; and

record the selected one or more multimedia types to a memory to obtain one or more recorded multimedia types; and

a cloud-based voice changing unit operable to;

modify the one or more recorded multimedia types to obtain one or more modified multimedia types;

an encryption unit operable to;

encrypt one or more of the recorded multimedia types and the modified multimedia types to prepare the one or more multimedia types for sending; and

a memory operable to store the one or more multimedia types.

20. The system of claim 19, wherein the first user input includes touch engagement of the user with a display of the digital device;

and

wherein the second user input includes touch release of the user with a display of the digital device.

21. The system of claim 19, wherein the analyzing is based on the time between the first user input and the second user input.

22. The system of claim 19, wherein the cloud-based voice changing unit is operable to create a play list from the multimedia types on the digital device and broadcast the created play list.

23. The system of claim 19, wherein the cloud-based voice changing unit is operable to slow down the recorded multimedia type without changing pitch of the recorded multimedia type.

24. The system of claim 19, wherein the cloud-based voice changing unit is operable to enable one or more of the following:

making a voice chat with PC-to-phone applications, making a voice calls with PC-to-phone applications, making a song remix, and speaking over the Internet and soft-phone using customizable text-to-speech voices.

25. The system of claim 19, wherein the cloud-based voice changing unit is operable to work in real time while using voice chat.

26. The system of claim 19, wherein the cloud-based voice changing unit is operable to modify the recorded multimedia types by performing one or more of the following:

correcting pitch of a vocal track, aligning vocal tracks together, fixing rhythm of a particular vocal line, applying a robotic effect to the vocal track, transposing a vocal track, adding backup vocals to the vocal track, reversing the effects of pitch correction, adding distortion to the vocal track, changing pitch-sensitive fundamental waves of voice in the recorded multimedia type, and morphing voice and suppressing background voice to obtain voice optimized for online games.

27. The system of claim 19, wherein the modifying includes modifying pitch, format, noise threshold, and applying echo.

28. The system of claim 19, wherein the cloud-based voice changing unit is operable to use electronic circuits to change or buffer unnatural sounds.