Method and apparatus for monitoring individuals while protecting their privacy

• US 9,817,017 B2
• Filed: 10/12/2012
• Issued: 11/14/2017
• Est. Priority Date: 10/17/2011
• Status: Active Grant

• Current Assignee: Atlas5D, Inc.
• Original Assignee: Atlas5D, Inc.
• Inventors: Kimmel, Zebadiah M.
• Primary Examiner(s): Lim, Steven
• Assistant Examiner(s): MA, KAM WAN
• Application Number:
  US14/352,303
• Publication Number:
  US 20140299775A1
• Time in Patent Office: 1,859 Days
• CPC Class Codes: G01P 13/00 Indicating or recording presence, absence, or direction, of movement electric switches H01H; counting moving objects G06M7/00
• CPC Class Codes: G01S 17/50 Systems of measurement based on relative movement of target
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19686 Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates

Abstract

A system for monitoring individuals while protecting their privacy includes at least one energy emitter configured to emit energy onto a field-of-view that may contain an individual, and at least one energy sensor configured to capture reflected energy from within the field-of-view. A spatial measurement module calculates spatial measurements of objects within the field-of-view based on data from the energy sensor. A schematic generation module creates schematic views of objects within the field-of-view, distinguishing human beings from each other and from inanimate objects or animals. Three-dimensional measurements of the individual and environs are transformed into a two-dimensional or other schematic view, allowing ongoing monitoring of the individual while preventing viewing of the individual'"'"'s face and appearance, and preventing observation of what the individual may be wearing or watching.

Claims

1. A method of monitoring the presence and movement of an individual while protecting the individual'"'"'s privacy, the method comprising:

capturing data corresponding to objects positioned within a field-of-view of at least one energy sensor, such that identifying the individual cannot be ascertained from the captured data, wherein the at least one energy sensor is configured to capture energy reflected from the individual and the objects within the field-of-view;

generating depth data for the field-of-view based on the captured data from the at least one energy sensor;

identifying elements of the depth data that correspond to the individual within the field-of-view;

identifying elements of the depth data that correspond to an inanimate object within the field-of-view;

calculating one or more spatial measurements based on the elements that correspond to the individual and the elements that correspond to the inanimate object, wherein each of the one or more spatial measurements corresponds to a physical dimension; and

generating a schematic output representative of the field-of-view, based on at least one or more spatial measurements, wherein at least the individual and the at least one inanimate object are labeled in the schematic output.

2. The method of claim 1, wherein the depth data and/or the one or more spatial measurements are used to generate a schematic output.

3. The method of claim 2, wherein the schematic output is at least one member selected from the group consisting of:

an overhead view, a side view, a trajectory, a heat map, and a cartoon.

4. The method of claim 1, wherein the depth data are analyzed for changes in presence or motion, and update-messages or warning-messages are supplied to users, operators, or caregivers.

5. The method of claim 1, wherein a plurality of individuals are simultaneously monitored.

6. The method of claim 5, wherein individuals are identified or distinguished from each other by facial recognition or by body biometrics.

7. The method of claim 1, wherein skeleton data and/or pixel label data are generated from the depth data.

8. The method of claim 7, wherein the skeleton data and/or pixel label data are used to identify the elements of the depth data that correspond to the at least one individual.

9. The method according to claim 1, wherein the at least one energy sensor acquires at least one of reflected infrared light, reflected laser light, reflected ultraviolet light, reflected visible light, reflected X-rays, reflected microwaves, reflected radio waves, reflected sound waves, reflected ultrasound energy, and reflected thermal energy.

10. The method according to claim 1, wherein the depth data are generated through LIDAR methods.

11. The method according to claim 1, wherein the depth data are generated through pattern deformation methods.

12. The method according to claim 1, wherein at least one additional energy sensor is positioned nearby such that the field-of-view of the at least one additional energy sensor at least partially coincides with the field-of-view of the at least one energy sensor, and wherein the at least one energy sensor acquires a first spectrum of energy that overlaps with a second spectrum of energy acquired by the at least one additional energy sensor.

13. The method according to claim 12, wherein the at least one additional energy sensor acquires visual light.

14. The method according to claim 12, wherein the at least one energy sensor and the at least one additional energy sensor are co-located in space.

15. The method of claim 1, wherein a rate of change over time of depth data corresponding to an object within the field-of-view is used to identify whether the object within the field-of-view corresponds to the at least one individual or the at least one inanimate object.

16. The method of claim 1, wherein morphology of depth data corresponding to an object within the field-of-view is used to identify whether the object within the field-of-view corresponds to the at least one individual or the at least one inanimate object.

17. A method of monitoring the presence and movement of an individual while protecting the individual'"'"'s privacy, comprising:

capturing data corresponding to objects positioned within a field-of view of at least one energy sensor, such that identifying characteristics of the individual cannot be ascertained from the captured data, wherein the at least one energy sensor is configured to capture energy reflected from the objects within the field of-view;

generating depth data for the field-of-view based on the captured data from the at least one energy sensor;

identifying elements of the depth data that correspond to the individual within the field-of-view;

identifying elements of the depth data that correspond to an inanimate object within the field-of-view;

calculating one or more spatial measurements based on the elements that correspond to the individual and the elements that correspond to the inanimate object, wherein each of the one or more spatial measurements corresponds to a physical dimension; and

generating a schematic output representative of the field-of-view, based on at least the one or more spatial measurements, wherein at least the individual and the at least one inanimate object are labeled in the schematic output.

18. The method of claim 17, wherein the schematic output of the field-of-view is supplied to an operator, a display device, or a storage device.

19. The method of claim 17, wherein at least the depth data or the spatial measurement corresponding to the at least one inanimate object is retained over time as legacy data.

20. The method of claim 19, wherein the retained legacy data is used to augment or fill-in the schematic output when an individual in the field-of-view obstructs a view of the at least one inanimate object.

21. The method of claim 17, wherein the depth data or the one or more spatial measurements are transformed into at least one of a two-dimensional schematic, a two-dimensional cartoon, a two-dimensional avatar, a three-dimensional cartoon, a three-dimensional avatar, a two-dimensional stick figure, and a three-dimensional stick figure.