ENHANCING VIDEO CHATTING

• US 20150365627A1
• Filed: 06/13/2014
• Published: 12/17/2015
• Est. Priority Date: 06/13/2014
• Status: Active Grant

• Current Assignee: ArcSoft, Inc.
• Original Assignee: ArcSoft, Inc.
• Inventors: Deng, Hui, Wang, Jin, Mao, Kaixuan
• Granted Patent: US 9,792,716 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method for a computing device to enhance video chatting Includes receiving a live video stream, processing a frame in the live video stream in real-time, and transmitting the frame to another computing device. Processing the frame in real-time includes detecting a face, an upper torso, or a gesture in the frame, and applying a visual effect to the frame. The method includes processing a next frame in the live video stream in real-time by repeating the enhancing, the detecting, and the applying.

Claims

1. :

A method for a computing device to enhance video chatting, comprising;

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising;

detecting a face in the frame; and

applying a visual effect to the frame, comprising adding an element to or about the face;

transmitting the frame to another computing device; and

processing additional frames in the live video stream in real-time by repeating said detecting and said applying, wherein the element in the frame and other elements in the additional frames form an animated effect.

2. :

The method of claim 1, further comprising, adjusting lighting in the frame, removing noise from the frame, or removing blur from the frame.

3. :

The method of claim 1, further comprising detecting facial features from the face.

4. :

The method of claim 3, further comprising processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprises retouching the face.

6. :

The method of claim 3, wherein the element is placed on the face based on a location of a facial feature.

8. :

The method of claim 1, further comprising detecting a gesture, wherein the gesture comprises a facial gesture, a hand gesture, or a movement of another body part, and the animated effect is applied in response to detecting the gesture.

9. :

The method of claim 3, further comprising processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprises applying a cosmetic to the face.

10. :

The method of claim 1, further comprising processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprises morphing the face.

5. (canceled)

7. (canceled)

11. :

A method for a computing device to enhance video chatting, comprising;

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising;

detecting a face in the frame; and

applying a visual effect to the frame wherein said applying a visual effect to the frame comprises (a) completely obscuring the face or a background in the frame or (b) removing or replacing the background in the frame;

transmitting the frame to another computing device; and

processing a next frame in the live video stream in real-time by repeating said detecting and said applying.

12. (canceled)

13. :

A non-transitory computer-readable medium comprising instructions for a processor to enhance video chatting, the instructions comprising;

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising;

detecting a face in the frame; and

applying a visual effect to the frame based on said detecting, comprising adding an element to or about the face;

transmitting the frame to another computing device; and

processing additional frames in the live video stream in real-time by repeating said detecting and said applying, wherein the element in the frame and other elements in the additional frames form an animated effect

14. :

The non-transitory computer-readable medium of claim 13, wherein the instructions further comprise adjusting lighting in the frame, removing noise from the frame, or removing blur from the frame.

15. :

The non-transitory computer-readable medium of claim 13, wherein

the instructions further comprise processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, wherein said applying another visual effect to the more frames comprises retouching the face.

16. :

The non-transitory computer-readable medium of claim 13, wherein the instructions further comprise detecting a gesture, the gesture comprises a facial gesture, a hand gesture, or a movement of another body part, and the animated effect is applied in response to said detecting the gesture.

17. :

The non-transitory computer-readable medium of claim 13, wherein the instructions further comprise processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, and said applying another visual effect to the more frames comprises applying a cosmetic to the face.

18. :

The non-transitory computer-readable medium of claim 13, wherein the instructions further comprise processing more frames in the live video stream in real-time by detecting the face in the more frames and applying another visual effect to the more frame, and said applying another visual effect to the more frame comprises morphing the face.

19. :

A non-transitory computer-readable medium comprising instructions for a processor to enhance video chatting, the instructions comprising;

receiving a live video stream;

processing a frame in the live video stream in real-time, comprising;

detecting a face in the frame; and

applying a visual effect to the frame based on said detecting, wherein said applying a visual effect to the frame comprises (a) completely obscuring the face or a background in the frame or (b) removing or replacing the background in the frame;

transmitting the frame to another computing device; and

processing a next frame in the live video stream in real-time by repeating said detecting and said applying.

20. (canceled)