×

Apparatuses, systems and methods for detecting various actions of a vehicle operator

  • US 10,445,604 B1
  • Filed: 04/30/2018
  • Issued: 10/15/2019
  • Est. Priority Date: 06/14/2016
  • Status: Active Grant
First Claim
Patent Images

1. A device for detecting various vehicle operator actions by tracking vehicle occupant postures using image recognition, the device comprising:

  • at least one vehicle interior sensor for acquiring at least one image sequence of a vehicle occupant; and

    a processor that is configured to determine a vehicle operation mode by;

    receiving previously classified image data from at least one previously classified image database in response to the processor executing a previously classified vehicle interior data receiving module;

    receiving current image data from the at least one vehicle interior sensor in response to the processor executing a current image data receiving module;

    creating a vehicle occupant posture record for the vehicle occupant comprising vehicle interior data of the vehicle occupant;

    extracting three-dimensional coordinate spatial locations of at least one joint location of the vehicle occupant from the vehicle interior data, the three-dimensional coordinate spatial locations of at least one joint location of the vehicle occupant are stored in the vehicle occupant posture record as vehicle occupant posture data relating to the vehicle interior data;

    recognizing and tracking postures of the vehicle occupant in the image sequence as vehicle occupant posture data by processing the three-dimensional coordinate spatial locations of at least one joint location of the vehicle occupant and the previously classified interior data using a stored skeletal pose data generation model, wherein each posture of the vehicle occupant includes a range of movement of the at least one joint location of the vehicle occupant;

    detecting a vehicle operator action based upon a comparison of the current image data with the previously classified image data in response to the processor executing a vehicle operator action detection module that includes a probability function; and

    automatically updating the vehicle occupant posture record with the vehicle posture data.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×