Real time video special effects system and method

• US 10,404,923 B1
• Filed: 10/29/2018
• Issued: 09/03/2019
• Est. Priority Date: 10/29/2018
• Status: Active Grant

• Current Assignee: Henry M. Pena, Thomas F. Bryant III
• Original Assignee: Henry M. Pena, Thomas F. Bryant III
• Inventors: Pena, Henry M., Bryant, III, Thomas F.
• Primary Examiner(s): Fosselman, Joel W
• Application Number:
  US16/173,066
• Time in Patent Office: 309 Days
• Field of Search: 348239
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/633 for displaying additional information relating to control or operation of the camera
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate

Abstract

The present technology is a graphical user interface for a video recording system and method of recording a video while applying special effects in real time prior to and/or while recording. The interface is associated with an electronic device including a processor in communication with a camera and a memory unit. Inputs from the interface are utilized by the processing unit to determine if the native speed rate of the raw video data is to be changed, and if so then modifies at least one frame in the raw video data to create a modified video data at a modified speed rate that is different to the native speed rate. The system then generates an output video feed that is displayed in the graphical user interface. This allows for the continuous recording of video from the camera or video feed at different speed rates without altering camera operations or settings.

Claims

1. A video capture and display system for controlling a special effects operation of live video recording data in real time, the system comprising

one or more cameras configured to capture video of a real world scene;

an electronic device including at least one processing unit operably connected or connectable to the camera, and at least one memory; and

a graphical user interface operably implemented or implementable on the electronic device and executable by the processing unit, the graphical user interface being configured or configurable to;

provide one or more affordances to a user, the affordances each being configured or configurable to provide one or more inputs to at least one operation executed or executable by the processing unit of the electronic device;

display on the graphical user interface at normal speed the video being captured; and

change a video playing speed on the graphical interface of the video being captured from the normal playing speed to a modified playing speed in response to at least one of the inputs received by the graphical user interface.

2. The system of claim 1, wherein the graphical user interface is configured or configurable by the processing unit to revert from displaying at the modified playing speed on the graphical user interface the video being captured to displaying the video being captured at the normal speed.

3. The system of claim 2, wherein the graphical user interface is configured or configurable by the processing unit to revert from displaying at the modified speed on the graphical user interface the video being captured to displaying the video being captured at the normal playing speed in response to a user input received by the graphical user interface.

4. The system of claim 1, wherein the graphical user interface is configured or configurable by the processing unit to seamlessly change the playing speed on the graphical user interface of the video being recorded from the normal playing speed to a modified playing speed.

5. The system of claim 1, wherein the camera and the graphical user interface are incorporated in the same electronic device or the camera is remote from the electronic device.

6. The system of claim 5, wherein the electronic device comprises a smartphone, computer, personal digital assistant (pda) or tablet device.

7. The system of claim 1, wherein the graphical user interface is displayed on a display of the electronic device, and wherein the graphical user interface includes multiple regions with a first region being configured or configurable to display the video being captured at the normal playing speed, and a second region being configured or configurable to display the video being captured at the modified playing speed.

8. The system of claim 7, wherein the graphical user interface includes a third region being configured or configurable to display at least one still frame of the video that was previously captured within a current session.

9. A video recording interface system for controlling a special effects operation of live video recording data in real time, the system comprising:

an electronic device including at least one processing unit in operable communication with a camera and at least one memory, the camera being configured to capture raw video data in real time; and

a graphical user interface associated with the electronic device and displayable on the electronic device, the graphical user interface comprising a video display region, and at least one first affordance configured or configurable to provide at least one input receivable and usable by the processing unit in determining if the input is associated with changing the native speed rate of the raw video data and if so to modify at least one frame in the raw video data to create modified video data at the modified speed rate that are different to the native speed rate in real time with receiving the raw video data from the camera;

wherein the graphical user interface is configured to receive the modified video data from the processing unit and display the modified video data in the video display region.

10. The video recording interface system according to claim 9, wherein the first affordance of the graphical user interface includes at least one selectable value from a plurality of values.

11. The video recording interface system according to claim 10, wherein the selectable value is selected by a gesture on the display of the electronic device selected from the group consisting of a tap, a multiple tap, a touch holding, a sliding, a pinch, and a touch holding and sliding.

12. The video recording interface system according to claim 10, wherein the plurality of values of the first affordance includes varying speed rates associated with slow motion speed, fast motion speed and normal speed.

13. The video recording interface system according to claim 12, wherein the first affordance is a slide bar associated with the varying speed rates.

14. The video recording interface system according to claim 10, wherein the graphical user interface includes a second affordance configured or configurable to provide a second input to the processing unit to initiate or stop a recording operation of the video, and a third affordance usable in determining a change in zoom factor of the raw video data.

15. The video recording interface system according to claim 14, wherein at least one of the first affordance and the second affordance is in part arranged over the video display region.

16. The video recording interface system according to claim 9, further comprises a second video display region configured to display a second video feed being different to the modified video data displayed in the display region, the second video feed being any one or any combination of the following:

the raw video data at the native speed rate, and the modified video data at the modified speed rate.

17. The video recording interface system according to claim 9, wherein the graphical user interface further includes a record affordance configured or configurable to provide at least one record input receivable and usable by the processing unit in at least determining if a recording operation is to be started or stopped.

18. The video recording interface system according to claim 9, wherein the graphical user interface further includes one or more additional affordances configured or configurable to provide at least one additional input receivable and usable in initiating additional operations by the processing unit.

19. The video recording interface system according to claim 18, wherein the additional operations are selected from the group consisting of a flash, a hands free or hands on operation, a timer, a mute operation, a rear and selfie camera or remote feed operation, a setting operation associated with the electronic device, a setting operation associated with the camera, an editing operation, a filter operation, an augmented reality (AR) operation a writing operation, and a transmission operation.

20. A method for controlling a special effects operation of live video recording data in real time, the method comprising the steps of:

a) displaying a graphical user interface including at least one affordance on a display operably associated with an electronic device including at least one processing unit and at least one memory in operable communication with processing unit;

b) receiving, by the processing unit, video data at a native speed rate from a camera or a video feed, the video data at least in part corresponding to images being captured by the camera or from the video feed in real time;

c) receiving, by the processing unit, at least one input from the affordance upon activation of the affordance by a user;

d) determining, by the processing unit, if the input is associated with changing the native speed rate of the video data and if so modifying the video data to create modified video data at one or more modified speed rate that are different to the native speed rate in real time while receiving the video data; and

e) displaying at least a first region of the graphical user interface, by the processing unit, output video recording data to the display, wherein the output video recording data is any one or any combination of the following;

the video data at the native speed rate, and the modified video data at the modified speed rate.

21. The method according to claim 20, further comprises the step of precluding the video data from being written to the memory from the camera or the video feed.

22. The method according to claim 20, wherein if the input from the graphical user interface is not associated with changing the native speed rate, then process the command and writing the video data to the memory.

23. The method according to claim 20, further comprises the step of determining if the input from the graphical user interface is to change the native speed rate, then determining if the modified speed rate is less than the native speed rate, and if so wherein the modifying of the video data includes adding at least one new frame to the video data to create the modified video data.

24. The method according to claim 23, wherein the adding the new frame includes copying at least one frame to create the new frame or blending at least one frame with a next frame to create the new frame, and adding the new frame to the video data adjacent to the at least one frame.

25. The method according to claim 23, wherein the new frame is a plurality of new frames each being a copy of at least one frame from the video data.

26. The method according to claim 25, wherein each of the new frames is added to the video data adjacent to the at least one frame or adjacent to a second frame of the video data.

27. The method according to claim 20, further comprises the step of determining if the input from the graphical user interface is to change the native speed rate, then determining if the modified speed rate is greater than the native speed rate, and if so wherein the modifying of the video data includes removing at least one first frame from the video data to create the modified video data.

28. The method according to claim 27, wherein the removing the first frame includes selecting the first frame to be removed, and then removing the first frame from the video data to create the modified video data.

29. The method according to claim 20, wherein the first display region is configured or configurable to display the modified video data, and wherein the graphical user interface includes a second display region configured or configurable to display the video data stream or at least one still frame of the video that was previously captured within a current session.

30. The method according to claim 20, wherein the output video recording data displayed in the first region of the graphical user interface is a combination of the video data and the modified video data, the modified video data is configured or configurable to include multiple subsets each having a speed rate dependent on the input, with a transitioning between the video data and any one of the subsets or between any of the subsets being dependent on the input, and wherein the output video recording data is displayed in the graphical user interface in real time while receiving the video data from the camera or the video feed.

31. A non-transitory computer readable medium with an executable program stored thereon comprising instructions for execution by at least one processing unit for controlling a special effects operation of live video recording data in real time, such that the instructions when executed by the at least one processing unit cause the at least one processing unit to:

receive, by the at least one processing unit, video data from a camera or a real time video feed, the video data at least in part corresponding to images being captured by the camera in real time or from the real time video feed;

display on a graphical user interface at a native speed rate the video data being captured in real time or the real time video feed;

receive, by the processing unit, at least one input from an affordance of the graphical user interface upon activation of the affordance by a user, the graphical user interface being displayable on a display operably associated with an electronic device including at least one processing unit and at least one memory in operable communication with the processing unit;

modify, by the processing unit, the video data to create modified video data at one or more modified speed rate that are different to the native speed rate in real time while receiving the video data; and

change, by the at least one processing unit, the playing speed of the video data being displayed on the graphical user interface from the native speed rate to the modified speed rate in response to at least one of the inputs being received by the processing unit.

32. The non-transitory computer readable medium according to claim 31, wherein the processing unit is further caused to preclude the video data from being written to memory from the camera or from the video feed.

33. The non-transitory computer readable medium according to claim 31, wherein the processing unit is further caused to write the video data to memory if the input from the graphical user interface is not associated with changing the native speed rate.

34. The non-transitory computer readable medium according to claim 31, wherein the processing unit is further caused to determine if the input from the graphical user interface is to change the native speed rate, then determine if the modified speed rate is less than the native speed rate, and if so wherein the modifying of the video data includes adding at least one new frame to the video data to create the modified video data.

35. The non-transitory computer readable medium according to claim 34, wherein adding the new frame includes copying at least one frame to create the new frame or blending at least one frame with a next frame to create the new frame, and adding the new frame to the video data adjacent to the at least one frame.

36. The non-transitory computer readable medium according to claim 34, wherein the new frame is a plurality of new frames each being a copy of at least one frame from the video data.

37. The non-transitory computer readable medium according to claim 36, wherein each of the new frames is added to the video data adjacent to the at least one frame or adjacent to a second frame of the video data.

38. The non-transitory computer readable medium according to claim 31, wherein the processing unit is further caused to determine if the input from the graphical user interface is to change the native speed rate, then determine if the modified speed rate is greater than the native speed rate, and if so wherein the modifying of the video data includes removing at least one first frame from the video data to create the modified video data.

39. The non-transitory computer readable medium according to claim 38, wherein the removing the first frame includes selecting the first frame to be removed, and then removing the first frame from the video data to create the modified video data.

40. The non-transitory computer readable medium according to claim 31 is utilized for controlling a special effects operation of live video recording data in real time, wherein the images are captured by the camera in real time.