DETECTION OF PHOTOSENSITIVE TRIGGERS IN VIDEO CONTENT

• US 20200137347A1
• Filed: 10/25/2018
• Published: 04/30/2020
• Est. Priority Date: 10/25/2018
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Rechner, Istvan, Ponekker, Zoltan, Egyed, Patrik
• Granted Patent: US 10,742,923 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/4094 Diagnosing or monitoring seizure diseases, e.g. epilepsy
• CPC Class Codes: A61B 5/7275 Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06V 10/507 Summing image-intensity values; Histogram projection analysis
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: H04N 17/00 Diagnosis, testing or measuring for television systems or their details
• CPC Class Codes: H04N 5/57 Control of contrast or brightness

Abstract

Techniques for detecting epileptic triggers in video content by storing a first sequence of frames of a video stream in a first buffer. The technique can further comprise generating a second sequence of subframes and storing the second sequence of subframes in a second buffer. The technique can further comprise generating average intensity values for the second sequence of subframes in the second buffer and calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values. The technique can further comprise determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold and tagging the frames in the first buffer corresponding to the subframes in the second buffer as hazardous.

Claims

1. A computer-implemented method comprising:

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

2. The method according to claim 1, further comprising:

generating a third sequence of subframes corresponding to a second portion of respective frames in the first sequence of frames.

3. The method according to claim 2, wherein the second portion partially overlaps the first portion.

4. The method according to claim 2, wherein the second portion is equal in size to the first portion.

5. The method according to claim 1, wherein the first portion comprises between 25% and 50%, inclusive, of an area of a respective frame in the first sequence of frames.

6. The method according to claim 1, further comprising:

removing respective borders of respective frames in the first sequence of frames.

7. The method according to claim 1, wherein the average intensity values comprise average luma values for respective subframes in the second sequence of subframes.

8. The method according to claim 7, wherein a first average luma value is based on luma values of a majority of pixels in a first subframe of the second sequence of subframes.

9. The method according to claim 1, wherein the average intensity values comprise average hue values, average saturation values, and average luminance values for respective subframes in the second sequence of subframes.

10. The method according to claim 1, further comprising:

modifying respective frames in the first sequence of frames to mitigate the epileptic trigger; and

outputting a modified video stream in response to modifying respective frames in the first sequence of frames.

11. The method according to claim 10, wherein modifying respective frames in the first sequence of frames comprises overwriting luma values of pixels in the first portion of respective frames in the first sequence of frames.

12. The method according to claim 10, wherein modifying respective frames in the first sequence of frames comprises overwriting a characteristic of respective frames in the first sequence of frames, wherein the characteristic is selected from the group consisting of:

hue, saturation, and luminance.

13. The method according to claim 1, wherein an intensity change comprises a change in average brightness between consecutive subframes in the second sequence of subframes.

14. The method according to claim 1, wherein an intensity change comprises a change in average saturation between consecutive subframes in the second sequence of subframes.

15. The method according to claim 1, wherein the second sequence of subframes comprises between 3 seconds and 8 seconds of the video stream, inclusive.

16. The method according to claim 1, wherein the second sequence of subframes comprises between 100 subframes and 200 subframes, inclusive.

17. The method according to claim 1, wherein the oscillation threshold is between 5 and 20, inclusive, wherein average intensity values are between 0 and 1, inclusive, and wherein the amplitude threshold is between 0.65 and 0.95, inclusive.

18. A system comprising:

a processor; and

a computer-readable storage medium communicatively coupled to the processor and storing program instructions, which, when executed by the processor, are configured to cause the processor to perform a method comprising;

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

19. A computer program product comprising a computer-readable storage medium storing program instructions, wherein the computer-readable storage medium is not a transitory signal per se, wherein the program instructions are executable by a processor to cause the processor to perform a method comprising:

storing a first sequence of frames of a video stream in a first buffer;

generating a second sequence of subframes corresponding to a first portion of respective frames in the first sequence of frames;

storing the second sequence of subframes in a second buffer;

generating average intensity values for respective subframes in the second sequence of subframes;

calculating intensity changes between consecutive subframes in the second sequence of subframes based on the average intensity values;

determining that a number of intensity changes between consecutive subframes in the second sequence of subframes exceeds an oscillation threshold, wherein respective intensity changes in the number of intensity changes exceed an amplitude threshold; and

tagging frames in the first sequence of frames as containing an epileptic trigger in response to determining that the number of intensity changes between consecutive subframes in the second sequence of subframes exceeds the oscillation threshold.

20. The computer program product according to claim 19, wherein the instructions are stored in a computer-readable storage medium in a server data processing system, and wherein the instructions are downloaded over a network to a remote data processing system for use in a computer readable storage medium with the remote system.