Methods, systems, and computer readable media for tracking human interactions with objects using modular sensor segments

• US 10,024,718 B2
• Filed: 12/30/2014
• Issued: 07/17/2018
• Est. Priority Date: 01/02/2014
• Status: Active Grant

• Current Assignee: Triangle Strategy Group, LLC
• Original Assignee: Triangle Strategy Group, LLC
• Inventors: Campbell, Patrick Joseph
• Primary Examiner(s): Porta, David
• Assistant Examiner(s): Faye, Mamadou
• Application Number:
  US14/586,389
• Publication Number:
  US 20150184997A1
• Time in Patent Office: 1,295 Days
• CPC Class Codes: G01J 3/50 using electric radiation detectors
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 17/87 Combinations of systems using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 7/4813 Housing arrangements
• CPC Class Codes: H01L 24/00 Arrangements for connecting or disconnecting semiconductor or solid-state bodies; Methods or apparatus related thereto
• CPC Class Codes: H01L 2924/00 Indexing scheme for arrangements or methods for connecting or disconnecting semiconductor or solid-state bodies as covered by H01L24/00
• CPC Class Codes: H01L 2924/13091 Metal-Oxide-Semiconductor Field-Effect Transistor [MOSFET]

Abstract

Methods, systems, and computer readable media for tracking signals from modular sensor segments are disclosed. One system includes modular sensor segments for tracking interactions with objects where each sensor segment includes an infrared transmitter and an infrared receiver for tracking human physical interaction with objects. Each modular sensor segment includes a circuit board on which the transmitter and receiver are mounted and a light shield mounted on the circuit board configured to separate, transmit and receive optical signal paths.

Claims

1. A modular system for sequential polling of networks of sensors comprising:

a sequence of modular sensor segments comprising a first sensor segment and at least a second sensor segment in series;

each sensor segment comprising;

a sensing device;

a circuit board on which the sensing device is mounted;

a bus, configured to;

communicate power and signals between the sensor segments; and

allow segments to be connected to each other in sequential order;

a signal processor/controller configured to;

execute a sequential polling cycle wherein each sensor segment is sequentially polled to measure readings from the segments;

communicate control signals to the segments comprising at least a clock signal and a poll signal;

identify signals received from the segments; and

transmit control signals;

segment circuitry on the segments, configured to cause each segment to respond to sequential polling, and allow the segment to at least receive an input poll signal, receive a clock signal, connect the sensing device to the signal processor/controller, and transmit an output poll signal; and

a sequential polling cycle wherein;

only one segment is polled at any one time;

the first segment to be polled is the first segment in a physical sequence of the segments by the signal processor/controller transmitting a high poll signal to the poll input of the first segment, and the signal processor/controller then transmitting a high clock signal to the segments, causing the poll output of the first segment to go high, and also causing the sensing device to be connected to a data line so that an analog output of the sensing device is read by the signal processor/controller; and

further control signals cause the polling to transition to the second segment in the physical sequence by the signal processor/controller transmitting a low poll signal to the first segment, and the signal processor/controller then transmitting first a low clock signal and then a high clock signal to the segments, causing the poll output of the first segment to go low and disconnect the first segment from the signal processor/controller, also causing the poll output of the second segment to go high, and also causing the sensing device on the second segment to be connected to the data line so that an analog output of the second segment is read by the signal processor/controller.

2. The system of claim 1 wherein the sensing devices each comprise one or more proximity sensors capable of detecting the presence and position of a human being within the monitored area.

3. The system of claim 1 wherein each modular sensor segment includes first and second lateral edges, a male connector located on the first lateral edge, and a female connector located on the second lateral edge wherein the modular sensor segments are removably connectable to each other via their respective male and female connectors to produce arrays of modular sensor segments of desired configuration.

4. The system of claim 1 comprising a plurality of jumper connectors for interconnecting adjacent modular sensor segments using jumper wires.

5. The system of claim 3 wherein the female connectors are keyed to prevent misconnection with a male connector.

6. The system of claim 1 wherein each sensor segment includes a self-identification circuit for individually identifying a type of each sensor segment wherein polling of the segment takes place over the course of a first and second clock cycle;

and wherein during the first clock cycle, the segment circuitry transmits a pre-defined voltage to the data line that indicates a type of sensor present on the sensor segment and during the second clock cycle the segment circuitry transmits the analog output of the sensor segment to the data line.

7. The system of claim 1 wherein the sensor segments are infrared reflection range finders and are arranged in a two dimensional array so as to form a user interface.

8. A method for tracking human interactions with objects using modular sensor segments, the method comprising:

providing a plurality of modular sensor segments in series, the plurality of modular sensor segments communicatively coupled to a bus and a processor, each having an infrared transmitter, an infrared receiver, and a light shield configured to separate transmit and receive signal paths and to reduce interference from ambient light;

positioning the sensor segments near objects and activating sensors of the segments to track human interaction with the objects;

communicating, by the processor, control signals to each segment;

causing each segment to be polled sequentially by circuitry on the plurality of modular sensor segments, wherein;

only one segment is polled at any one time;

a first segment to be polled is the first segment in a physical sequence of the plurality of modular sensor segments;

when a segment is polled, a corresponding analog output is connected to a data line so that the analog output is read by the processor; and

receipt of a clock signal pulse causes polling to transition to a next segment in the physical sequence;

and

processing, by the processor, analog output signals from the sensors to identify types of human interactions with objects.

9. A system for detecting pickup and putback of objects from a retail fixture comprising:

a plurality of sensing devices,

wherein the sensing devices each comprise one or more pickup sensors capable of detecting pickup and putback of objects from a monitored area,

wherein the pickup sensors each comprise a transmitter and receiver,

wherein the sensing devices are configured so the receiver receives a reflected portion of the energy emitted from the transmitter, and

wherein the pickup sensors are oriented to direct a beam upwards from a shelf; and

a signal processor/controller configured to;

receive the reflected signal from each sensing device over time;

log each reflected signal from start to finish of an event; and

analyze the logged signal for each event so as to distinguish whether a pickup or a putback took place during that event, wherein a pickup is identified by a peak in the logged signal toward the end of an event, and a putback is identified by a peak in the logged signal toward the beginning of an event.

10. The system of claim 9 where the pickup sensors each comprise a circuit board, an infrared transmitter, an infrared receiver for tracking human physical interactions with objects, and a physical shield mounted on the circuit board configured to separate transmit and receive optical signal paths and to shield the transmitter and receiver from interference from ambient light.

11. The system of claim 10 wherein the shield comprises a housing that covers the transmitter and the receiver in a direction orthogonal to a sensing direction and a separating member interposed between the transmit and receive light paths, wherein the housing forms openings in the sensing direction to allow light transmitted from the transmitter to exit the housing and light reflected from an object to enter the housing.

12. The system of claim 10 wherein the shield is removably connectable to the circuit board.

13. The system of claim 10 wherein the signal processor/controller is configured to detect size or proximity of an object by analyzing the strength of the reflected signals.

14. The system of claim 9 wherein the modular sensor segments are configured to generate a curtain of electromagnetic energy in a direction orthogonal to entry of a retail display unit.

15. The system of claim 10 wherein the transmitter comprises an infrared diode, the receiver comprises an infrared phototransistor and wherein each modular sensor segment further includes a second transistor for controlling an illuminate signal and at least one logic gate for allowing polling of each modular sensor segment.

16. The system of claim 10 wherein the signal processor/controller is configured to modulate an infrared signal transmitted by the transmitter and wherein the receiver is configured to detect the modulated signal reflected from objects in a sensing range.

17. The system of claim 9 wherein the sensing devices comprise a series of range finding devices connected in sequence on a close pitch so that the sensing fields of adjacent range finding devices partially overlap to create a continuous sensing field for pickup tracking that measures both the horizontal position and the height of a shopper'"'"'s hand at any location in the monitored area.