VIDEO EDITING USING CONTEXTUAL DATA AND CONTENT DISCOVERY USING CLUSTERS

• US 20160104508A1
• Filed: 07/28/2015
• Published: 04/14/2016
• Est. Priority Date: 10/10/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Dixon, Paul, Dusch, Florian, Calder, Bartley H., Chee, Meng, Kim, Hyung Keun, Pereira, Luyza Viana, Barrow, Scott, Misra, Sudhir Kumar, Nicolae, Gabriel
• Granted Patent: US 10,192,583 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/06 Cutting and rejoining; Notching, or perforating record carriers otherwise than by recording styli record carriers with provision for splicing G11B23/20
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/252 Processing of multiple end-users' preferences to derive collaborative data
• CPC Class Codes: H04N 21/25883 being end-user demographical data, e.g. age, family status or address arrangements for identifying locations of users in broadcast systems H04H60/52
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/783 : Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal

Abstract

Video editing using contextual data may include collecting metadata from a sensor concurrently with recording a video, wherein the metadata is synchronized in time with the video, detecting attributes within the metadata and attributes from the video, and correlating the attributes with a plurality of editors. An editor may be selected from the plurality of editors according to the correlating and a video editing workflow may be automatically initiated. Content discovery using clusters may include receiving a user request for video content from a device, determining a behavioral cluster for the user according to demographic data for the user, determining a video of interest associated with the behavioral cluster, and providing a video of interest to the device using the processor.

Claims

1. A method, comprising:

collecting, using a processor, metadata from a sensor concurrently with recording a video, wherein the metadata is synchronized in time with the video;

detecting, using the processor, at least one of attributes of the metadata or attributes of the video;

correlating, using the processor, the attributes with a plurality of editors;

selecting, using the processor, an editor from the plurality of editors according to the correlating; and

displaying, using the processor, the selected editor for the video.

2. The method of claim 1, further comprising:

marking clips in the video for trimming according to user activation of a trim control during playback of the video.

3. The method of claim 2, further comprising:

trimming the video according to the marked clips.

4. The method of claim 1, further comprising:

receiving a user gesture specifying frame rates of the video over time; and

storing the frame rates in association with times in the video.

5. The method of claim 1, further comprising:

aligning visual representations of a plurality of different videos in time;

receiving a user input drawing a line over different ones of the visual representations selecting clips of the plurality of different videos to be visible at different times; and

generating a mixed video comprising only the selected clips of each of the plurality of videos in chronological order.

6. The method of claim 5, further comprising:

adjusting a start time or an end time of at least one of the selected clips to coincide with a detected beat in a time synchronized audio file.

7. The method of claim 1, further comprising:

superimposing metadata on the video.

8. The method of claim 1, wherein the metadata is collected from a plurality of different sensors, the method further comprising:

determining which of the plurality of sensors exhibits at least a minimum level of activity during recording of the video;

selecting items of the metadata generated from the determined sensor; and

superimposing the items of metadata on the video in synchronization with the video.

9. The method of claim 1, further comprising:

from a first device, inviting a second device to perform distributed video processing;

responsive to determining that the second device has accepted the invitation, sending a selected video processing operation of a plurality of video processing operations to the second device;

receiving a result of the selected video processing operation from the second device; and

combining the result with a result of at least other of the plurality of video processing operations.

10. The method of claim 1, further comprising:

within a device, delaying implementation of a video processing operation until the processor determines that the device is idle and coupled to a power supply.

11. A system, comprising:

a processor programmed to initiate executable operations comprising;

collecting metadata from a sensor concurrently with recording a video, wherein the metadata is synchronized in time with the video;

detecting at least one of attributes of the metadata or attributes of the video;

correlating the attributes with a plurality of editors;

selecting an editor from the plurality of editors according to the correlating; and

displaying the selected editor for the video.

12. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

marking clips in the video for trimming according to user activation of a trim control during playback of the video.

13. The system of claim 12, wherein the processor is further programmed to initiate executable operations comprising:

trimming the video according to the marked clips.

14. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

receiving a user gesture specifying frame rates of the video over time; and

storing the frame rates in association with times in the video.

15. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

aligning visual representations of a plurality of different videos in time;

receiving a user input drawing a line over different ones of the visual representations selecting clips of the plurality of different videos to be visible at different times; and

generating an edited video comprising only the selected clips of each of the plurality of videos in chronological order.

16. The system of claim 15, wherein the processor is further programmed to initiate executable operations comprising:

adjusting a start time or an end time of at least one of the selected clips to coincide with a detected beat in a time synchronized audio file.

17. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

superimposing metadata on the video.

18. The system of claim 11, wherein the metadata is collected from a plurality of different sensors and the processor is further programmed to initiate executable operations comprising:

determining which of the plurality of sensors exhibits at least a minimum level of activity during recording of the video;

selecting items of the metadata generated from the determined sensor; and

superimposing the items of metadata on the video in synchronization with the video.

19. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

from a first device, inviting a second device to perform distributed video processing;

responsive to determining that the second device has accepted the invitation, sending a selected video processing operation of a plurality of video processing operations to the second device;

receiving a result of the selected video processing operation from the second device; and

combining the result with a result of at least other of the plurality of video processing operations.

20. The system of claim 11, wherein the processor is further programmed to initiate executable operations comprising:

within a device, delaying implementation of a video processing operation until the processor determines that the device is idle and coupled to a power supply.

21. A computer program product comprising a computer readable storage medium having program code stored thereon, the program code executable by a processor to perform a method comprising:

collecting metadata from a sensor concurrently with recording a video, wherein the metadata is synchronized in time with the video;

detecting at least one of attributes of the metadata or attributes of the video;

correlating the attributes with a plurality of editors;

selecting an editor from the plurality of editors according to the correlating; and

displaying the selected editor for the video.

22. The computer program product of claim 21, wherein the method further comprises:

marking clips in the video for trimming according to user activation of a trim control during playback of the video.

23. The computer program product of claim 22, wherein the method further comprises:

trimming the video according to the marked clips.

24. The computer program product of claim 21, wherein the method further comprises:

receiving a user gesture specifying frame rates of the video over time; and

storing the frame rates in association with times in the video.

25. The computer program product of claim 21, wherein the method further comprises:

aligning visual representations of a plurality of different videos in time;

receiving a user input drawing a line over different ones of the visual representations selecting clips of the plurality of different videos to be visible at different times; and

generating an edited video comprising only the selected clips of each of the plurality of videos in chronological order.

26. The computer program product of claim 25, wherein the method further comprises:

adjusting a start time or an end time of at least one of the selected clips to coincide with a detected beat in a time synchronized audio file.

27. The computer program product of claim 21, wherein the method further comprises:

superimposing metadata on the video.

28. The computer program product of claim 21, wherein the metadata is collected from a plurality of different sensors, the method further comprising:

determining which of the plurality of sensors exhibits at least a minimum level of activity during recording of the video;

selecting items of the metadata generated from the determined sensor; and

superimposing the items of metadata on the video in synchronization with the video.

29. The computer program product of claim 21, wherein the method further comprises:

from a first device, inviting a second device to perform distributed video processing;

responsive to determining that the second device has accepted the invitation, sending a selected video processing operation of a plurality of video processing operations to the second device;

receiving a result of the selected video processing operation from the second device; and

combining the result with a result of at least other of the plurality of video processing operations.

30. The computer program product of claim 21, wherein the method further comprises:

within a device, delaying implementation of a video processing operation until the processor determines that the device is idle and coupled to a power supply.

31. A method comprising:

receiving a request for video content from a device using a processor;

determining, using the processor, a behavioral cluster according to demographic data associated with the device;

determining a video of interest associated with the behavioral cluster; and

providing the video of interest to the device using the processor.

32. The method of claim 31, wherein determining a behavioral cluster comprises:

comparing the demographic data with a segmentation model that correlates items of demographic data with a plurality of behavioral clusters.

33. A system, comprising:

a processor programmed to initiate executable operations comprising;

receiving a request for video content from a device;

determining a behavioral cluster according to demographic data associated with the device;

determining a video of interest associated with the behavioral cluster; and

providing the video of interest to the device.

34. The system of claim 33, wherein determining a behavioral cluster comprises:

comparing the demographic data with a segmentation model that correlates items of demographic data with a plurality of behavioral clusters.

35. A computer program product comprising a computer readable storage medium having program code stored thereon, the program code executable by a processor to perform a method comprising:

receiving a request for video content from a device;

determining a behavioral cluster according to demographic data associated with the device;

determining a video of interest associated with the behavioral cluster; and

providing the video of interest to the device.

36. The computer program product of claim 35, wherein determining a behavioral cluster comprises:

comparing the demographic data with a segmentation model that correlates items of demographic data with a plurality of behavioral clusters.