Interactive video generation

• US 10,204,417 B2
• Filed: 05/10/2016
• Issued: 02/12/2019
• Est. Priority Date: 05/10/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jia, Hong Wei, Li, Qian, Li, Shuang, Song, Hai Lei, Wang, Yun Ting, Yang, Xin Ying, Yuan, Wenyan, Zhang, Guang Ming
• Primary Examiner(s): To, Jennifer N
• Assistant Examiner(s): Li, Liang Y
• Application Number:
  US15/150,477
• Publication Number:
  US 20170329493A1
• Time in Patent Office: 1,008 Days
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/47 Detecting features for summarising video content
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: G11B 27/102 Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816

Abstract

A method includes receiving an input from a user, the input including a selection of an object, where the object is contained in a video, identifying, in response to the input, the object in the video, determining an attribute of the object associated with a profile of the user, where the profile contains a preference of the user regarding at least one object to be viewed, and determining, in response to the attribute of the object associated with the profile, a target segment in the video, where the target segment includes the object.

Claims

1. A computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising;

receiving, by a device, an input from a user, the input comprising a selection of an object contained in a video played on the device, the selection is made via a touch gesture performed by a user'"'"'s finger on a touchscreen of the device;

determining a frame of the video comprising an image displayed at a time the input from the user is received;

determining a position of the input of the user on the frame;

identifying the object in the determined frame by applying image recognition techniques, the identifying of the object from the frame is based on the determined position and an object position list, the object position list comprising information about positions of objects in the video;

comparing attributes of the object with user preferences defined in a user profile, the attributes comprising object characteristics, an object type, an object target customers, object price, and an object manufacturer, and the user preferences comprising one or more characteristics of the object previously selected by the user;

in response to at least one attribute of the object matching at least one user preference defined in the user profile, identifying segments from the video which display the object, each segment comprising a duration and one or more frames;

calculating a total sum of the duration of the identified segments;

comparing the total sum to a predetermined time interval; and

based on the calculated sum being equal to the predetermined time interval, combining the identified segments to provide a video tailored to the user preferences specified in the user profile.

2. The computer system of claim 1, wherein the image recognition techniques comprise edge matching, divide-and-conquer search, greyscale matching, and gradient matching.

3. The computer system of claim 1, further comprising:

generating the attributes for the object based on the user profile.

4. The computer system of claim 1, further comprising:

selecting, in response to the calculated sum exceeding the predetermined time, a portion of each identified segment based on the user profile; and

combining the portion of each identified segment.

5. The computer system of claim 1, further comprising:

determining, in response to the calculated sum being less than the predetermined time interval, weights for the identified segments based on attributes of the identified segments;

weighting the duration of the identified segments; and

combining the identified segments.

6. A computer program product comprising:

a computer readable non-transitory article of manufacture tangibly embodying computer readable instructions which, when executed, cause a computer to carry out a method comprising;

receiving, by a device, an input from a user, the input comprising a selection of an object contained in a video played on the device, the selection is made via a touch gesture performed by a user'"'"'s finger on a touchscreen of the device;

determining a frame of the video comprising an image displayed at a time the input from the user is received;

determining a position of the input of the user on the frame;

identifying the object in the determined frame by applying image recognition techniques, the identifying of the object from the frame is based on the determined position and an object position list, the object position list comprising information about positions of objects in the video;

comparing attributes of the object with user preferences defined in a user profile, the attributes comprising object characteristics, an object type, an object target customers, object price, and an object manufacturer, and the user preferences comprising one or more characteristics of the object previously selected by the user;

in response to at least one attribute of the object matching at least one user preference defined in the user profile, identifying segments from the video which display the object, each segment comprising a duration and one or more frames;

calculating a total sum of the duration of the identified segments;

comparing the total sum to a predetermined time interval; and

based on the calculated sum being equal to the predetermined time interval, combining the identified segments to provide a video tailored to the user preferences specified in the user profile.

7. The computer program product of claim 6, wherein the image recognition techniques comprise edge matching, divide-and-conquer search, greyscale matching, and gradient matching.

8. The computer program product of claim 6, further comprising:

generating the attributes for the object based on the user profile.

9. A computer system comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising;

receiving, by a device, a user input comprising a touch gesture performed by a user'"'"'s finger on a touchscreen of the device, wherein an object is selected among one or more objects contained in a video played by the device via the touch gesture, the object comprising a product, a person, or a facility of interest to a user of the device;

determining a frame of the video comprising an image displayed at a time the user'"'"'s finger contacts the touchscreen;

determining a first set of coordinates corresponding to a position of the user'"'"'s finger on the frame;

obtaining an object position list comprising a frame id associated with a second set of coordinates for each object in the one or more objects, wherein each second set of coordinates corresponds to a location range associated with each of the one or more objects in the video;

based on the first set of coordinates being located within the second set of coordinates of at least one object within the one or more objects, recognizing the at least one object as the object selected by the user'"'"'s finger;

comparing attributes of the object with user preferences defined by a user profile, the attributes comprising object characteristics, an object type, an object target customers, object price, and an object manufacturer, and the user preferences comprising one or more characteristics of the object previously selected by the user;

in response to at least one attribute of the object matching at least one user preference defined by the user profile, identifying segments from the video which display the object, each segment comprising a duration and one or more frames;

calculating a total sum of the duration of the identified segments;

comparing the total sum to a predetermined time interval; and

based on the calculated sum being equal to the predetermined time interval, combining the identified segments to provide a video tailored to the user preferences specified in the user profile.

10. The computer system of claim 9, further comprising:

generating the attributes for the object based on the user profile.

11. The computer system of claim 9, further comprising:

selecting, in response to the calculated sum exceeding the predetermined time interval, a portion of each identified segment based on the user profile; and

combining the portion of each identified segment.

12. The computer system of claim 9, further comprising:

determining, in response to the calculated sum being less than the predetermined time interval, weights for the identified segments based on attributes of the identified segments;

weighting the duration of the identified segments; and

combining the identified segments.