×

Method and system for recognizing the intentions of shoppers in retail aisles based on their trajectories

  • US 9,740,977 B1
  • Filed: 05/29/2009
  • Issued: 08/22/2017
  • Est. Priority Date: 05/29/2009
  • Status: Active Grant
First Claim
Patent Images

1. A method for determining a shopper'"'"'s intention in an aisle, based on the shopper'"'"'s trajectory, comprising the following steps of:

  • a) providing a hardware comprising at least a camera, a plurality of machine learning-based human body detectors or a multi-hypothesis tracker, a computer processor and a set of computer vision algorithms wherein the camera captures a plurality of images, and the plurality of machine learning-based human body detectors or a multi-hypothesis tracker detects a set of people across the plurality of images, and wherein the computer processor tracks the shopper trajectories of the set of people, extracts shopper trajectory features, and analyzes the shopper trajectory features for shopper behaviors, wherein the hardware determines the shopper'"'"'s intention in the aisle by the steps of;

    b) setting up a shopper behavior model,wherein the shopper behavior model consists of a relationship between shopper trajectory dynamics and atomic behaviors,wherein the shopper trajectory dynamics comprise position, speed, and orientation,c) detecting and tracking the shopper from input images captured by the camera to generate a trajectory of the shopper,d) converting the shopper trajectory into a lateral trajectory wherein the lateral trajectory into y and t coordinates, wherein y coordinates are in the direction perpendicular to an aisle and t coordinates are instances of time,e) extracting shopper trajectory features from the trajectory, wherein the shopper trajectory features include spatiotemporal dimensions, andf) analyzing the shopper trajectory features of the shopper'"'"'s trajectory based on the shopper behavior model to determine the shopper'"'"'s behavior state,wherein the lateral direction is a direction perpendicular to the aisle direction, andwherein the shopper trajectory features comprise lateral position, lateral position histogram, motion orientation, and motion speed.

View all claims
  • 17 Assignments
Timeline View
Assignment View
    ×
    ×