APPARATUS AND METHOD FOR EDITING CONTENT

• US 20160211001A1
• Filed: 12/15/2015
• Published: 07/21/2016
• Est. Priority Date: 01/20/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SUN, Joon-gyu, BANG, Han-min, SHIN, Seong-kook
• Granted Patent: US 10,373,648 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/3081 used signal is a video-frame or a video-field (P.I.P)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A system and a method for editing moving image content are provided. The method includes acquiring moving image content, mapping an image of a person included in the moving image content and speech data of the person, selecting at least one frame among frames included in the moving image content, and creating edited content of the moving image content using the mapped image and speech data, and the selected at least one frame.

Claims

1. A method of a content editing apparatus for editing moving image content, the method comprising:

acquiring moving image content;

mapping an image of a person included in the moving image content and speech data of the person;

selecting at least one frame among frames included in the moving image content; and

creating edited content of the moving image content using the mapped image and speech data, and the selected at least one frame.

2. The method of claim 1, wherein the mapping of the image of the person included in the moving image content and speech data of the person comprises:

classifying face images of persons in the moving image content for each person; and

mapping the classified face images to speech data of the persons.

3. The method of claim 2, wherein the speech data includes at least one of voice data of the person and text data converted from the voice data.

4. The method of claim 1, wherein the selecting of the at least one frame among the frames included in the moving image content comprises:

determining at least one scene among scenes of the moving image content using voice data in the moving image content; and

selecting at least one frame among frames included in the determined scene.

5. The method of claim 4, wherein the determining of the at least one scene among scenes of the moving image content comprises determining at least one scene among the scenes based on a voice level variation and a voice frequency variation of the voice data in the moving image content.

6. The method of claim 4, wherein the determining of the at least one scene among scenes of the moving image content comprises:

detecting a predetermined voice in the moving image content; and

determining a scene corresponding to a position at which a predetermined condition is satisfied based on a position of the detected voice.

7. The method of claim 6,

wherein the predetermined voice includes a burst sound, and

wherein the scene corresponding to the position at which the predetermined condition is satisfied is a scene ranging between a portion of the moving image content in which the burst sound is output and another portion of the moving image content spaced apart a certain distance in a reverse direction.

8. The method of claim 4, wherein the selecting of the at least one frame comprises selecting the at least one frame according to a level of noise included in the frames included in the determined scene.

9. The method of claim 4, wherein the selecting of the at least one frame comprises selecting the at least one frame based on at least one of a line-of-sight direction, a face direction, and a facial expression of persons included in the frames included in the determined scene.

10. The method of claim 1, wherein the creating of the edited content further comprises:

determining a template used to create the edited content; and

inserting an image of the selected frame into the determined template.

11. The method of claim 10, wherein text converted from a voice uttered by a person included in the image of the frame is displayed in the image inserted into the template.

12. The method of claim 10,

wherein the determining of the template comprises determining a type of the edited content and selecting a template corresponding to the determined type, and

wherein the image inserted into the template is processed according to the type of the edited content.

13. A non-transitory computer readable recording medium storing a computer program for executing by a processor the method of claim 1.

14. A content editing apparatus for editing moving image content, the content editing apparatus comprising:

a storage unit configured to map and store an image of a person included in the moving image content and speech data of the person; and

a controller configured to;

select at least one frame among frames included in the moving image content, and

create edited content of the moving image content using the mapped image and speech data, and the selected at least one frame.

15. The content editing apparatus of claim 14, wherein the controller is further configured to:

classify face images of persons in the moving image content for each person and maps, and

store the classified face images and speech data of the persons in the storage unit.

16. The content editing apparatus of claim 15, wherein the speech data includes at least one of voice data of the person and text data converted from the voice data.

17. The content editing apparatus of claim 14, wherein the controller is further configured to:

determine at least one scene among scenes of the moving image content using voice data in the moving image content, and

select at least one frame among frames included in the determined scene.

18. The content editing apparatus of claim 17, wherein the controller is further configured to determine at least one scene among the scenes based on a voice level variation and a voice frequency variation of the voice data in the moving image content.

19. The content editing apparatus of claim 17, wherein the controller is further configured to:

detect a predetermined voice in the moving image content, and

determine a scene corresponding to a position at which a predetermined condition is satisfied based on a position of the detected voice.

20. The content editing apparatus of claim 19,

wherein the predetermined voice includes a burst sound, and

wherein the scene corresponding to the position at which the predetermined condition is satisfied is a scene ranging between a portion of the moving image content in which the burst sound is output and another portion of the moving image content spaced apart a certain distance in a reverse direction.

21. The content editing apparatus of claim 17, wherein the controller is further configured to select the at least one frame according to a level of noise included in the frames included in the determined scene.

22. The content editing apparatus of claim 17, wherein the controller is further configured to select the at least one frames based on at least one of a line-of-sight direction, a face direction, and a facial expression of persons included in the frames included in the determined scene.

23. The content editing apparatus of claim 14, wherein the controller is further configured to:

determine a template used to create the edited content, and

insert an image of the selected frame into the determined template.

24. The content editing apparatus of claim 23, wherein text converted from a voice uttered by a person included in the image of the frame is displayed in the image inserted into the template.

25. The content editing apparatus of claim 23,

wherein the controller determines a type of the edited content and selects a template corresponding to the determined type, and

wherein the image inserted into the template is processed according to the type of the edited content.