Systems and methods for selecting an action based on a detected person

• US 10,375,266 B2
• Filed: 10/25/2017
• Issued: 08/06/2019
• Est. Priority Date: 10/26/2016
• Status: Active Grant

• Current Assignee: OrCam Technologies Ltd
• Original Assignee: OrCam Technologies Ltd
• Inventors: Wexler, Yonatan, Shashua, Amnon
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Rivera-Martinez, Guillermo M
• Application Number:
  US15/793,370
• Publication Number:
  US 20180114329A1
• Time in Patent Office: 650 Days
• CPC Class Codes: G01S 5/0027 of actual mobile position, i.e. position determined on mobile
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: G06V 2201/10 : Recognition assisted with metadata
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: H04L 51/52 : for supporting social networking services
• CPC Class Codes: H04L 67/306 : User profiles
• CPC Class Codes: H04L 67/535 : Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 1/32101 : Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 21/41407 : embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 23/51 : Housings
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

The present disclosure relates to systems and methods for selecting an action based on a detected person. In one implementation, a wearable apparatus may include a wearable image sensor configured to capture a plurality of images from the environment of the user of the wearable apparatus and at least one processing device. The at least one processing device may be programmed to analyze at least one of the plurality of images to detect the person; analyze at least one of the plurality of images to identify an attribute of the detected person; select at least one category for the detected person based on the identified attribute; select at least one action based on the at least one category; and cause the at least one selected action to be executed.

Claims

1. A wearable apparatus for causing an action to be executed based on a person being present in an environment of a user of the wearable apparatus, the wearable apparatus comprising:

a wearable image sensor configured to capture a plurality of images from the environment of the user of the wearable apparatus; and

at least one processing device programmed to;

analyze at least one of the plurality of images to detect the person;

analyze at least one of the plurality of images to identify an attribute of the detected person;

select at least one category for the detected person based on the identified attribute;

select at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and

cause the at least one selected action to be executed by the at least one processing device or the second processing device.

2. The wearable apparatus of claim 1, wherein the at least one category is selected from a plurality of attribute categories.

3. The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate an age of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated age of the detected person.

4. The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate a height of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated height of the detected person.

5. The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to estimate a weight of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the estimated weight of the detected person.

6. The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to identify a gender of the detected person, and selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the identified gender of the detected person.

7. The wearable apparatus of claim 1, wherein the analysis of the at least one of the plurality of images to identify the attribute of the detected person includes analyzing the at least one of the plurality of images to determine an identity of the detected person, and the at least one processing device is further programmed to, based on the identity of the detected person, determine a type of a relationship between the user and the detected person, and wherein selecting the at least one category for the detected person based on the identified attribute includes categorizing the detected person into the at least one category based on the type of the relationship between the user and the detected person.

8. The wearable apparatus of claim 1, wherein the at least one action includes at least one of transmitting information for an amber alert and transmitting information to update a database of missing persons.

9. The wearable apparatus of claim 1, wherein the at least one action includes identifying the person.

10. The wearable apparatus of claim 1, wherein the at least one action includes at least one of uploading an image and tagging an image.

11. The wearable apparatus of claim 1, wherein the at least one action includes at least one of updating a log and updating a timeline or a Gantt chart.

12. The wearable apparatus of claim 1, wherein the at least one action includes providing information related to a potential dating match.

13. The wearable apparatus of claim 1, wherein the at least one action includes updating at least one of a social graph and a social network profile.

14. The wearable apparatus of claim 1, wherein the at least one category includes a statistical category.

15. The wearable apparatus of claim 14, wherein the statistical category is associated with a geographical region.

16. The wearable apparatus of claim 14, wherein the statistical category is associated with a time period.

17. The wearable apparatus of claim 14, wherein the at least one action includes updating information related to the statistical category.

18. The wearable apparatus of claim 17, wherein updating the information related to the statistical category includes updating a count of unique persons associated with the statistical category.

19. The wearable apparatus of claim 1, wherein causing the at least one selected action to be executed includes sending information to the device paired with the wearable apparatus, and wherein the device paired with the wearable apparatus includes the at least one processing device or the second processing device.

20. The wearable apparatus of claim 1, wherein the at least one processing device is further programmed to:

analyze at least one of the plurality of images to detect a second person;

analyze at least one of the plurality of images to identify an attribute of the second person;

select at least one category for the second person based on the identified attribute of the second person; and

further base the selection of the at least one action on the at least one category selected for the second person.

21. A method for causing an action to be executed based on a person being present in an environment of a user of a wearable apparatus, the method comprising:

receiving a plurality of images captured by an image sensor of the wearable apparatus from the environment of the user of the wearable apparatus;

analyzing at least one of the plurality of images to detect the person;

analyzing at least one of the plurality of images to identify an attribute of the detected person;

selecting at least one category for the detected person based on the identified attribute;

selecting at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and

causing the at least one selected action to be executed by the at least one processing device or the second processing device.

22. The method of claim 21, wherein the at least one category is selected from a plurality of attribute categories.

23. A non-transitory computer readable medium storing computer-executable instructions that, when executed by the processor, cause the processor to perform a method comprising:

receiving a plurality of images captured by an image sensor of a wearable apparatus from an environment of a user of the wearable apparatus;

analyzing at least one of the plurality of images to detect the person;

analyzing at least one of the plurality of images to identify an attribute of the detected person;

selecting at least one category for the detected person based on the identified attribute;

selecting at least one action from a plurality of alternative actions associated with the at least one category, the action comprising software instructions for the at least one processing device or a second processing device paired with the wearable apparatus; and

causing the at least one selected action to be executed by the at least one processing device or the second processing device.