Live Comics Capturing Camera

• US 20170213576A1
• Filed: 01/20/2017
• Published: 07/27/2017
• Est. Priority Date: 01/22/2016
• Status: Abandoned Application

• Current Assignee: Lomics Inc.
• Original Assignee: Lomics Inc.
• Inventors: Nugumanov, Artur, Telezhnikov, Vasilii, Asadov, Vadim
• Application Number:
  US15/411,951
• Publication Number:
  US 20170213576A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/35 Categorising the entire scene, e.g. birthday party or wedding scene
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20

Abstract

A method of preprocessing a plurality of raw video files has the steps of a user selecting the plurality of raw video files, creating an exposure histogram for raw video files on a predetermined interval, creating a color histogram for at least one of the plurality of raw video files on a predetermined interval, determining a camera movement velocity, determining a camera trajectory, determining an image sharpness for at least one of the plurality of raw video files on a predetermined interval, and determining a raw video location based GPS information embedded into the plurality of raw video files. In an embodiment, determining a scene location comprises the steps of indexing the color histogram, indexing the raw video location based on geographic proximity, grouping the scene location based the color histogram, grouping the scene location based on the raw video location and determining a plurality of scene groupings.

Claims

1. A method for creating comic stories comprising the steps of:

a. preprocessing a plurality of raw video files;

b. determining a scene location;

c. indexing a plurality of scenes;

d. categorizing motions depicted in the plurality of scenes; and

e. building a comic story.

2. The method of claim 1, wherein preprocessing the plurality of raw video files comprises the steps of:

a. a user selecting the plurality of raw video files;

b. creating an exposure histogram for at least one of the plurality of raw video files on a predetermined interval;

c. creating a color histogram for at least one of the plurality of raw video files on a predetermined interval;

d. determining a camera movement velocity;

e. determining a camera trajectory;

f. determining an image sharpness for at least one of the plurality of raw video files on a predetermined interval; and

g. determining a raw video location based GPS information embedded into the plurality of raw video files.

3. The method of claim 2, wherein determining a scene location comprises the steps of:

a. indexing the color histogram;

b. indexing a location of the plurality of raw video files based on geographic proximity;

c. grouping the scene location based the color histogram;

d. grouping the scene location based on the raw video location; and

e. determining a plurality of scene groupings based on the color histogram and the geographic proximity using a predetermined schedule.

4. The method of claim 1, wherein indexing a plurality of scenes comprises the steps of:

a. detecting inanimate objects depicted in the plurality of scenes;

b. detecting animate objects depicted in the plurality of scenes;

c. scoring inanimate objects depicted in the plurality of scenes based on a predetermined schedule; and

d. scoring animate objects depicted in the plurality of scenes based on a predetermined schedule.

5. The method of claim 1, wherein categorizing motions depicted in the plurality of scenes comprises the steps of:

a. detecting motions depicted in the plurality of scenes based on a predetermined schedule;

b. categorizing motions depicted in the plurality of scenes based the object creating the motion; and

c. categorizing motions depicted in the plurality of scenes based on type of motion detected.

6. The method of claim 3, wherein building a comic story comprises the steps of:

a. selecting a plurality of final scenes;

b. applying a plurality of scene annotations; and

c. outputting the plurality of final scenes in a publishable format.

7. The method of claim 6, wherein selecting a plurality of final scenes comprises the steps of:

a. scoring the plurality of scene groupings based on a predetermined schedule;

b. scoring motions depicted in the plurality of scenes based on a predetermined schedule;

c. determining a scene score for the plurality of scene groupings based on a predetermined schedule; and

d. determining the plurality of final scenes based on scoring and a predetermined schedule.

8. The method of claim 7, wherein applying a plurality of scene annotations comprises the steps of:

a. detecting words within the plurality of scene groupings; and

b. adding graphic representations of words within the plurality of scene groupings based on a predetermined schedule to the plurality of final scenes.

9. The method of claim 8, wherein the step of outputting the plurality of scenes in a publishable format comprises

a. compiling the plurality of final scenes;

b. ordering the plurality of final scenes based on the temporal order of the plurality of raw video files; and

outputting the plurality of scenes in a user-defined format.