×

Detecting foreground regions in panoramic video frames

  • US 9,842,402 B1
  • Filed: 12/21/2015
  • Issued: 12/12/2017
  • Est. Priority Date: 12/21/2015
  • Status: Expired due to Fees
First Claim
Patent Images

1. A method of detecting foreground regions in a panoramic frame, the method comprising:

  • receiving, by a computing device, panoramic video data comprising a plurality of panoramic frames and video frame sequence data indicating a video frame sequence for the plurality of panoramic frames, wherein a subject panoramic frame of the plurality of panoramic frames comprises a plurality of pixel values and spatial data describing a spatial arrangement of the plurality of pixel values on a two-dimensional grid described by an X-axis and a Y-axis;

    selecting, by the computing device and from the subject panoramic frame, a plurality of scene point locations positioned on the two-dimensional grid, wherein a first scene point location of the plurality of scene point locations depicts a first scene point from a scene shown by a panoramic video depicted by the panoramic video data, and wherein the first scene point location is positioned on the two-dimensional grid at a first location corresponding to a location of a first pixel value of the plurality of pixel values;

    identifying, by the computing device, a second scene point location depicting the first scene point at a second panoramic frame that is before the subject panoramic frame in the video frame sequence;

    determining, by the computing device, a Y-axis displacement for the first scene point by determining a distance on the Y-axis between the second scene point location and the first scene point location;

    determining, by the computing device, a plurality of columns from the subject panoramic frame, where each of the plurality of columns is characterized by a column position on the X-axis, and wherein the first scene point location is in a first column of the plurality of columns;

    determining, by the computing device, an average Y-axis displacement for scene point locations from the plurality of scene point locations in the first column;

    fitting, by the computing device, a sinusoidal function to a distribution of average Y-axis displacements of scene points by column position on the X-axis, wherein the sinusoidal function maps position on the X-axis to Y-axis displacement;

    determining, by the computing device, that the Y-axis displacement of the first scene point differs from an output of the sinusoidal function at an X-axis position of the first scene point by more than a threshold distance; and

    writing, by the computing device, an indication of the first pixel value to a listing of foreground pixel values.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×