MULTIMEDIA PROCESSING AS A SERVICE

• US 20130201328A1
• Filed: 02/08/2012
• Published: 08/08/2013
• Est. Priority Date: 02/08/2012
• Status: Abandoned Application

• Current Assignee: Hing Ping Michael Chung
• Original Assignee: Hing Ping Michael Chung
• Inventors: CHUNG, Hing Ping Michael
• Application Number:
  US13/369,077
• Publication Number:
  US 20130201328A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Systems are provided for receiving the video data from the camera. In one embodiment, a system is provided to compare, for all frames of the video, one frame with another frame of the video data, to determine if there are dynamic objects between the two frames, wherein the determination is based on movements of corresponding pixels between the two frames; filtering out the dynamic objects in each frame; applying special effects to highlight the dynamic objects by coloring the dynamic objects in each frame; applying special effects to grey out static objects, or the non-dynamic objects, by coloring the static objects in each frame where the dynamic objects are found.

Claims

1. A real-time network-based video processing system for detecting and modifying particular objects of a video stream, comprising:

a camera configured to perform a series of steps, comprising;

receiving, from a user, a selection that indicates a mode of operations;

receiving video images, in form of frames;

receiving instructions with respect to the mode of operations selected; and

sending video data to video systems for image processing through a wireless network;

a mobile device including a video display, wherein the mobile device is configured to

receive streaming videos; and

display streaming videos;

a processor; and

a memory storing instructions to cause the processor to execute a method.

2. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

comparing a first frame with a second frame of the video data, to determine if there are moving objects between the two frames, wherein the determination is based on movements of corresponding pixels between the first and second frames;

filtering out the moving objects in the first and second frames;

applying a first special effect to the moving objects by coloring the moving objects in the first and second frames;

applying a second special effect to static objects, or the non-moving objects, by coloring the static objects in the first and second frames;

to compose new video data, re-combining, frame by frame, the moving objects with the static objects, after the first and second special effects being applied to the first and second frames; and

sending the new video data, as video stream, to the mobile device through the wireless network to display the new video data.

3. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

comparing a first frame with a second frame of the video data, to determine if there are moving objects between the two frames, wherein the determination is based on movements of corresponding pixels between the first and second frames;

filtering out the moving objects in the first and second frames;

allowing the user to select a moving object from the moving objects;

applying a first special effect to the selected moving object by coloring the selected moving object in the first and second frames;

applying a second special effect to unselected moving objects and static objects, or the non-moving objects, by coloring the unselected moving objects and the static objects in the first and second frames;

to compose new video data, re-combining, frame by frame, the selected moving objects, the unselected moving objects, and the static objects, after the first and second special effects being applied to the first and second frames; and

sending the new video data, as video stream, to the mobile device through the wireless network to display the new video data.

4. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

comparing a first frame with a second frame of the video data, to determine if there are moving objects between the two frames, wherein the determination is based on movements of corresponding pixels between the first and second frames;

filtering out the moving objects in the first and second frames;

allowing the user to select a moving object from the moving objects;

applying a first special effect to highlight the selected moving object by coloring the selected moving object in the first and second frames;

applying a second special effect to grey-out unselected moving objects and static objects, or the non-moving objects, by coloring the unselected moving objects and the static objects in the first and second frames;

to compose new video data, re-combining, frame by frame, the selected moving objects, the unselected moving objects, and the static objects, after the first and second special effects being applied to the first and second frames; and

sending the new video data, as video stream, to the mobile device through the wireless network to display the new video data.

6. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

receiving the photographic image from the camera;

comparing, for all frames of the video, one frame of the video with the image captured by the camera, to determine if user-defined dynamic objects are found in each frame, wherein the determination is based on both similarity of pixels and movements of corresponding pixels between the frame and the image;

filtering out the user-defined dynamic objects in each frame;

applying special effects to highlight the user-defined dynamic objects by coloring the user-defined dynamic objects in each frame;

applying special effects to grey out static objects and the non-user-defined dynamic objects, by coloring the static objects and the non-user-defined dynamic objects in each frame;

to compose new video data, re-combining, frame by frame, the user-defined dynamic objects, non-user-defined dynamic objects, and the static objects, after the special effects be applied;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data and received image, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

7. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

receiving the instructions from the camera;

comparing, for each frame of the video, one frame of the video data with a certain number of consecutive frames of the video data, to determine if user-defined dynamic objects are found in each frame, wherein the determination is based on the similarity of pixels and movements of corresponding pixels between the one frame and the consecutive frames of the video data, in view of the criteria, including;

a time period defined by the user allowing the user-defined dynamic objects to be found in a given frame;

space defined by user allowing the user-defined dynamic objects to be found in a certain area within a given frame;

color change allowing the user-defined dynamic objects to be found only if certain objects undergo certain color change;

background color change due to weather allowing certain user-defined dynamic objects to be ignored if those certain objects undergo certain color change merely due to background color change, including weather change of a background;

speed of movement defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move at a certain speed;

sound defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move with certain characteristics of sound that is found in an associated frame; and

frequency of movements defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move at a certain frequency;

filtering out the user-defined dynamic objects in each frame, in view of the criteria;

applying special effects to highlight the user-defined dynamic objects by coloring the user-defined dynamic objects in each frame;

applying special effects to grey out static objects and the non-user-defined dynamic objects, by coloring the static objects and the non-user-defined dynamic objects in each frame;

to compose new video data, re-combining, frame by frame, the user-defined dynamic objects, non-user-defined dynamic objects, and the static objects, after the special effects be applied;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data and received image, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

8. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

comparing, for all frames of the video, one frame with another frame of the video data, to determine if there are dynamic objects between the two frames, wherein the determination is based on movements of corresponding pixels between the two frames;

filtering out the dynamic objects in each frame;

applying special effects to highlight static objects, or the non-dynamic objects, by coloring the static objects in each frame;

to compose new video data, re-combining, frame by frame, only the static objects, after the special effects be applied;

sending the new video data only the static objects incorporating the special effects, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

9. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

receiving the instructions from the camera;

comparing, for each frame of the video, one frame of the video data with a certain number of consecutive frames of the video data, to determine if user-defined dynamic objects are found in each frame, wherein the determination is based on the similarity of pixels and movements of corresponding pixels between the one frame and the consecutive frames of the video data, in view of the criteria, including;

a time period defined by the user allowing the user-defined dynamic objects to be found in a given frame;

space defined by user allowing the user-defined dynamic objects to be found in a certain area within a given frame;

color change allowing the user-defined dynamic objects to be found only if certain objects undergo certain color change;

background color change due to weather allowing certain user-defined dynamic objects to be ignored if those certain objects undergo certain color change merely due to background color change, including weather change of a background;

speed of movement defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move at a certain speed;

sound defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move with certain characteristics of sound that is found in an associated frame; and

frequency of movements defined by the user allowing the user-defined dynamic objects to be found in a given frame only when the objects move at a certain frequency;

filtering out the user-defined dynamic objects in each frame, in view of the criteria;

applying special effects to highlight the user-defined dynamic objects by coloring the user-defined dynamic objects in each frame;

to safe bandwidth, composing new video data, only by re-combining, frame by frame, the user-defined dynamic objects while ignoring the non-user-defined dynamic objects and the static objects;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data and received image, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

10. The system of claim 1, wherein the method comprises:

receiving the video data from the camera, avoiding delay for waiting for entire video to be completed;

determining if there are faces of individuals in each of the frame of the video data, based on a set of matching criteria, including;

shape and size of nose;

shape, size, color, of Eye; and

shape and size of cheek bone;

for each determined face, associating each of the face as a dynamic object;

filtering out all of the dynamic objects in each frame;

applying special effects to highlight the dynamic objects by coloring the dynamic objects in each frame;

applying special effects to grey out static objects, or the non-dynamic objects, by coloring the static objects in each frame;

to compose new video data, re-combining, frame by frame, the dynamic objects with the static objects, after the special effects be applied;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

11. The system of claim 1, wherein the method comprises:

receiving the video data from the camera;

receiving the photographic image from the camera;

identifying, from each frame of the video, faces of individuals in each of the frame;

determining if a user-defined facial dynamic object is found by comparing, for each frame of the video, the faces of individual in each of the frame against the face represented as the image object captured by the camera, in view of a set of matching criteria, including;

1. Shape and size of nose;

2. Shape, size, color, of Eye; and

3. Shape and size of cheek bone;

filtering out the user-defined facial dynamic objects in each frame;

applying special effects to highlight the user-defined facial dynamic objects by coloring the user-defined facial dynamic objects in each frame;

applying special effects to grey out non-user-defined facial dynamic objects, by coloring the non-user-defined dynamic objects in each frame;

to compose new video data, re-combining, frame by frame, the user-defined facial dynamic objects, the non-user-defined facial dynamic objects, and the static objects, after the special effects be applied;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data and received image, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

12. The system of claim 1, wherein the method comprises:

receiving the video data from the camera, avoiding delay for waiting for entire video to be completed;

comparing, for all frames of the video, one frame with another frame of the video data, to determine if there are dynamic objects between the two frames, wherein the determination is based on movements of corresponding pixels between the two frames;

filtering out the dynamic object in each frame;

applying special effects by adding a new object to each of the frame, in addition to the dynamic object that is filtered out;

applying special effects to grey out static objects, or the non-dynamic objects, by coloring the static objects in each frame;

to compose new video data, re-combining, frame by frame, the dynamic objects, the new objects, and the static objects, after the special effects be applied;

sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data;

erasing the received video data, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

13. The system of claim 1, wherein the method comprises:

receiving the video data from the camera, avoiding delay for waiting for entire video to be completed;

comparing, for all frames of the video, one frame with another frame of the video data, to determine if there are dynamic objects between the two frames, wherein the determination is based on movements of corresponding pixels between the two frames;

filtering out the dynamic objects in each frame;

applying special effects to highlight the dynamic objects by coloring the dynamic objects in each frame;

applying special effects to grey out static objects, or the non-dynamic objects, by coloring the static objects in each frame where the dynamic objects are found, wherein the frames in which no dynamic objects are found no special effects will be applied to the frames;

to compose new video data, re-combining the dynamic objects with the static objects, after the special effects be applied, in frames in which dynamic objects are found, wherein the frames in which no dynamic objects are found no re-combining is required;

receiving a request from the mobile device, where in the request relates to demanding frames containing the dynamic objects only;

to respond to the request, sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data, wherein only the frames including the dynamic objects are sent to the mobile device;

receiving another request from the mobile device, where in the request relates to demanding frames containing the static objects only;

to respond to the another request, sending the new video data, as video stream, to the mobile device through the wireless network for displaying the new video data, wherein only the frames including the static objects are sent to the mobile device;

erasing the received video data, to avoid liability of copyright infringement; and

erasing the sent new video data, to avoid liability of copyright infringement.

5. A real-time network-based video processing system for detecting and modifying particular objects of a video stream without needing to store any uploaded content, comprising:

a camera configured to perform a series of steps, comprising;

receiving, from a user, a selection that indicates a mode of operations;

receiving video images, in form of frames;

receiving instructions with respect to the mode of operations selected; and

sending video data to video systems for image processing through wireless networks;

a mobile device including a video display, wherein the mobile device is configured to

receive streaming videos;

display streaming videos;

a wireless network; and

a video processing system including a processor and a memory storing instructions to cause the processor to execute a method.