×

ESTIMATION OF OBJECT PROPERTIES IN 3D WORLD

  • US 20120314030A1
  • Filed: 06/07/2011
  • Published: 12/13/2012
  • Est. Priority Date: 06/07/2011
  • Status: Active Grant
First Claim
Patent Images

1. A method for modeling objects within two-dimensional (2D) video data by three-dimensional (3D) models as a function of object type and motion, the method comprising:

  • calibrating a 2D image field of view of a video data input of a camera to three spatial dimensions of a 3D modeling cube via a user interface of an application executing on a processor, wherein each of the 3D modeling cube three spatial dimensions are at right angles with respect to each other of the three spatial dimensions;

    in response to observing an image of an object in motion in the 2D image field of view of a video data input, computing an initial 3D location of the observed 2D object image via the processor as an intersection between a ground plane of the calibrated camera field of view and a backward projected line passing through a center of the calibrated camera and a point on the object 2D image within a focal plane in the 2D image field of view of the video data input at an initial time;

    computing a second 3D location of the observed 2D object image via the processor as an intersection between the ground plane and another backward projected line passing through the center of the calibrated camera and the point on the object 2D image within the video data input 2D image field of view focal plane at a second time that is subsequent to the initial time;

    determining a heading direction of the object as a function of the calibrating of the camera and a movement of the 2D object image from the computed initial 3D location to the computed second subsequent 3D location;

    replacing the 2D object image in the video data input with a one of a plurality of object-type 3D polygonal models that has a projected bounding box that best matches a bounding box of an image blob of the 2D object image relative to others of the 3D polygonal models, the replacing further orienting the selected object-type 3D polygonal model in the determined heading direction, wherein each of the plurality of object-type 3D polygonal models are for an object type and have a projected bounding box ratio that are different from the object types and projected bounding box ratios of others of the 3D polygonal models;

    scaling the bounding box of the replacing polygonal 3D model to fit the object image blob bounding box; and

    rendering the scaled replacing polygonal 3D model with image features extracted from the 2D image data as a function of the calibrated dimensions of the 3D modeling cube.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×