System and method for interactive animations for enhanced and personalized video communications

• US 9,866,795 B2
• Filed: 09/26/2016
• Issued: 01/09/2018
• Est. Priority Date: 12/13/2013
• Status: Active Grant

• Current Assignee: Blake Caldwell
• Original Assignee: Blake Caldwell
• Inventors: Caldwell, Blake
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US15/275,751
• Publication Number:
  US 20170013236A1
• Time in Patent Office: 470 Days
• Field of Search: 345473, 345158, 345419, 345474, 348 1403, 348 1407, 352101, 715757, 715839, 715706, 715836, 382154, 382285, 463 36, 706 45
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

A videoconferencing system and method using personalized, 3D interactive animations across screen barriers. Via auditory, behavior, visual, or computer-inputted cues, preloaded images, sounds, and gestures as well as customized images, sounds, and gestures can be manipulated and sent into and across one or more videoconference feeds in the form of animated sequences. These images, sounds, and gestures can be mapped onto the images of users'"'"' faces or other features within the video feed frame.

Claims

1. A method for providing automatic communications based on computer detected visual cues to generate preselected automatic personalized animation communications during a videoconference on a computer system and network comprising at least one computer processor and non-transitory media and computer memory, the method comprising:

(a) electronically activating at least one audiovisual device for providing the video conference over the computer system and network;

(b) recording and transmitting audio data and visual data of users participating in the video conference as audiovisual data sets recorded on non-transitory computer readable media operably connected to the activated audiovisual device;

(c) storing on non-transitory computer readable media said audiovisual data;

(d) transmitting at least a portion of said audiovisual data sets, said portion comprising speech and visual images of the users participating in the videoconference over a computer network, wherein said audiovisual device is electronically communicating with at least one computer interface comprising at least one video camera and display screen and at least one audio recording input and audio output for each of said users participating in said video conference;

(e) electronically detecting and recording, using said computer system and network, cue data corresponding to at least one preselected audio cue in said audio data or at least one preselected video cue in said video data of said audiovisual data sets, said audio or video cue detected from at least a first user of said users due to an activation event comprising one or more of said preselected audio or video cues initiating the electronic detection and recording of said cue data;

(f) electronically recognizing said cue data by software on non-transitory computer readable media in the computer system and network that activates processing and transmission on said computer system and network of at least one preselected personalized visual object correlated with said visual cue;

(g) electronically and automatically generating using software on non-transitory computer readable media in said computer system and network at least one personalized visual animation communication sequence using said at least one preselected personalized visual object, said generated at least one personalized visual animation communication sequence selected by said first user by selecting a corresponding at least one selection icon on said first user'"'"'s display screen for display of said at least one personalized visual animation communication sequence to at least one second user of said users; and

(h) displaying the selected at least one personalized visual animation communication sequence to at least one of said at least one second user of said users on said at least one of said at least one second users'"'"' second display screen or audio output;

wherein said at least one personalized visual animation communication sequence is provided by electronically generating on said computer system animation data sets comprising a 2D or 3D representation of said at least one personalized visual object to generate, select, and display said at least one personalized visual animation communication sequence.

2. The method of claim 1, wherein said selection icon is associated with at least one preloaded visual image.

3. The method of claim 1, wherein said selection icon is associated with at least one visual image captured by the audiovisual device during the videoconference.

4. The method of claim 1, wherein said selection icon is associated with at least one gesture capture sequence data set, wherein said gesture is captured by said audiovisual device resulting in captured gesture data set rendered into at least one visual image available for integration into said at least one personalized animation communication sequence.

5. The method of claim 1, wherein said selection icon is associated with a text generation sequence wherein said user enters one or more text items and said text item appears in a video feed either in isolation or in combination with an image or a gesture.

6. The method of claim 1, wherein said screen displays an arrangement comprising one or more video feeds, one selection area, and one audiovisual playback area and wherein previously created audio and/or video recordings can be displayed and/or played back during said videoconference.

7. The method of claim 1, wherein said screen displays an arrangement comprising one or more video feeds, one selection area, one audiovisual playback area, and one live content creation area wherein one or more users to said videoconference can create content during said videoconference.

8. The method of claim 1, wherein one or more users in said videoconference sends one or more of said personalized animation communication sequences to another one or more other users in said videoconference wherein said personalized animation communication sequence comprises an animation sequence that appears to begin and end in one video feed.

9. The method of claim 1, wherein said screen contains two or more video feeds and said personalized animation communication sequence comprises an audio, video, text, or animation sequence that begins in or is activated by one initiating audio, text, gesture, animation, or video feed from one or more of said user or said other user and results in one or more generated audio, text, animation, gesture, or video feeds in a continuous manner to another of said user of other users.

10. An electronic computer system and network comprising a computer program storage device readable by a computing machine, the computer program storage device comprising:

non-transitory computer readable media comprising program code including instructions executable by the computing machine for using the method of claim 1 for providing said at least one first user selected said at least one personalized animation communication sequence and providing said at least one first user selected at least one personalized animation communication sequence to said at least one second user.

11. A method according to claim 9, wherein said activation event is selected from one or more of a gesture of the user , a recorded gesture, an animated version of a gesture, an expression, a noise, an utterance of the user or other user, a text, a drawing, an animation, video clip, a chat entry, a light pen drawing, writing, or animation, or computer enhanced version thereof.

12. A method according to claim 11, wherein at least a portion of the activation event is detected and recorded and associated with the cue data and transferred and displayed as at least a portion of said at least one personalized visual animation communication sequence.