Target analysis and recommendation

• US 10,724,830 B2
• Filed: 06/24/2019
• Issued: 07/28/2020
• Est. Priority Date: 11/26/2014
• Status: Active Grant

• Current Assignee: Advanced AR Systems LLC
• Original Assignee: Philip Lyren
• Inventors: Lyren, Philip
• Primary Examiner(s): Brier, Jeffery A
• Application Number:
  US16/449,486
• Publication Number:
  US 20190331458A1
• Time in Patent Office: 400 Days
• CPC Class Codes: F41G 3/02 using an independent line of sight
• CPC Class Codes: F41G 3/04 for dispersing fire from a battery ; for controlling spread of shots; for coordinating fire from spaced weapons
• CPC Class Codes: F41G 3/06 with rangefinder rangefinders per se G01C
• CPC Class Codes: F41G 3/165 using a TV-monitor
• CPC Class Codes: F41H 13/00 Means of attack or defence not otherwise provided for details of radar or sonar systems G01S7/00
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0189 Sight systems
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 20/20 Ensemble learning
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment

Abstract

An electronic device determines target information about a target and recommends a target based on the target information.

Claims

1. A method executed by multiple electronic devices that include wearable electronic devices (WEDs), the method comprising:

collecting, with the WEDs worn by multiple users at a geographical location, target information about people with firearms that are dispersed at the geographical location;

determining, by one or more of the multiple electronic devices, a distance from each of the users to each of the people with firearms;

assigning, by one or more of the multiple electronic devices and based on the distance from each of the users to each of the people with the firearms, each of the users to a different one of the people with firearms; and

displaying, through the WEDs, a three dimensional (3D) image of a person that represents a person assigned to a user such that the 3D image of the person is displayed in a field of view of the user where the person assigned to the user is actually located in the geographical location, wherein the users are people.

2. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, whether or not the people with the firearms are holding the firearms; and

assigning, by one or more of the multiple electronic devices and based on whether or not the people with the firearms are holding the firearms, each of the users to the different one of the people with firearms.

3. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, a type of obstruction that exists between each of the users and each of the people with the firearms;

determining, by one or more of the multiple electronic devices, weapon penetration locations on the obstruction; and

assigning different scores to different obstructions based on the type of obstruction and the weapon penetrations locations on the obstruction.

4. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, that two of the users have a point of aim of a firearm on a same one of the people with firearms; and

instructing one of the two users to move a point of aim from the same one of the people with firearms to another one of the people with firearms so the two users do not have their points of aim on the same one of the people with firearms.

5. The method of claim 1 further comprising:

determining, from a facial image collected with one of the WEDs, an identity of one of the people with firearms;

drawing a 3D image of the one of the people with firearms to resemble the one of the identity of the one of the people with firearms; and

displaying, through the one of the WEDs, the 3D image of the one of the people with firearms over a location in a field of view of the one of the WEDs where the one of the people with firearms is located.

6. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, that one of the users is assigned to a first one of the people with firearms;

determining, by one or more of the multiple electronic devices, that a second one of the people with firearms is firing at the one of the users; and

changing, by one or more of the multiple electronic devices, an assignment of the one of the users from the first one of the people with firearms to the second one of the people with firearms based on determining that the second one of the people with firearms is firing at the one of the users.

7. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, that one of the users assigned a first one of the people with firearms selected to target a second one of the people with firearms in spite of being assigned the first one of the people with firearms;

comparing, by one or more of the multiple electronic devices, scores for factors of the first one of the people with firearms with scores for factors of the second one of the people with firearms; and

changing, by one or more of the multiple electronic devices, the scores for the factors based on machine learning.

8. The method of claim 1 further comprising:

determining, by one or more of the multiple electronic devices, a safety score for a location in which a safety score represents safety of the one of the users from harm by the people with firearms;

determining, by one or more of the multiple electronic devices, safety scores for alternate locations that are proximate to the location; and

recommending, by one or more of the multiple electronic devices, that the one of the users moves to one of the alternate locations that has an improved safety score over the safety score for the location.

9. An electronic system, comprising:

first and second wearable electronic device (WEDs) that each include a camera that captures images of people and weapons in a field of view of a first user wearing the first WED and a second user wearing the second WED; and

one or more electronic devices that communicates over a wireless network with the first and second WEDs and that executes code to receive the images of the people and of the weapons from the first and second WEDs, to determine distances from the first user and the second user to each of the people, to determine whether each of the people is holding a weapon, to determine assignments of the first user to one of the people and the second user to another one of the people based on the distances and the holding of the weapon, and to provide the assignments to the first and second WEDs, wherein the first and second users are people.

10. The electronic system of claim 9 further comprising:

a firearm with the first user that includes a compass to determine a direction of a point of aim of the firearm, a rangefinder to determine a distance from the firearm to the one of the people, and a transceiver to wirelessly communicate the direction and the distance to the first WED.

11. The electronic system of claim 9, wherein the one or more electronic devices further executes the code to build a three-dimensional (3D) map that depicts the people holding the weapons, obstructions where each of the people is located, the assignments, the first user, and the second user, and to provide the 3D map to the first and second WEDs.

12. The electronic system of claim 9, wherein the first WED includes a see-thru display that displays a three-dimensional (3D) image of the one of the people at a location that coincides with where the one of the people is located, and wherein the second WED includes a see-thru display that displays a 3D image of the another one of the people at a location that coincides with where the another one of the people is located.

13. The electronic system of claim 9 further comprising:

a machine-learning system that receives information that the first user fired a firearm at a person not assigned to the first user, executes an evaluation of a distance from the first user to the person, executes an evaluation of an obstruction proximate to the person, and changes priorities for how the people are assigned to the first user based on the evaluation of the distance and on the evaluation of the obstruction.

14. The electronic system of claim 9 further comprising:

a firearm with the first user that includes an electronic leveler to determine an angle with respect to ground at which the firearm is pointed when aimed at the one of the people, a rangefinder to determine a distance from the firearm to the one of the people, and a transmitter to transmit the angle and the distance to the computer; and

wherein the one or more electronic devices further executes the code to determine a height of the one of the people with respect to the first user and to map a location of the one of the people to a floor of a building based on the angle, the distance, and the height.

15. The electronic system of claim 9 further comprising:

a target recommender that evaluates the weapons of the people, locations of the weapons and the people, and a location of the first user, that determines alternate locations where the first user can move to reduce a probability of receiving fire from the weapons of the people, that selects one of the alternate locations, and that provides the alternate location to the first WED; and

wherein the display of the first WED displays a path from a current location of the first user to the alternate location.

16. A non-transitory computer readable storage medium storing instructions that cause one or more processors to execute a method, comprising:

obtain an image of a first person holding a first firearm and a second person holding a second firearm at a geographical location that includes a user wearing a wearable electronic device (WED);

evaluate distances from the user to the first person and from the user to the second person;

determine, based on the distances, a recommendation as to whether the user should target the first person with a weapon or target the second person with the weapon; and

display, with the WED, the recommendation such that the recommendation visually distinguishes the first person from the second person, wherein the user is a person.

17. The non-transitory computer readable storage medium storing instructions of claim 16 further to cause the one or more processors to execute the method comprising:

determine existence of an obstruction between the user and the first person;

determine a material from which the obstruction is fabricated; and

determine whether a projectile fired from the weapon can penetrate the obstruction and strike the first person.

18. The non-transitory computer readable storage medium storing instructions of claim 16 further to cause the one or more processors to execute the method comprising:

determine whether the first person is firing the first firearm at the user;

determine whether the second person is firing the second firearm at the user;

prioritize the recommendation for the user to target the first person when the first person is firing the first firearm at the user; and

prioritize the recommendation for the user to target the second person when the second person is firing the second firearm at the user.

19. The non-transitory computer readable storage medium storing instructions of claim 16 further to cause the one or more processors to execute the method comprising:

determine whether the first person is firing the first firearm not at the user but at another user;

determine whether the second person is firing the second firearm not at the user but at the another user;

prioritize the recommendation for the user to target the first person when the first person is firing the first firearm at the another user; and

prioritize the recommendation for the user to target the second person when the second person is firing the second firearm at the another user.

20. The non-transitory computer readable storage medium storing instructions of claim 16 further to cause the one or more processors to execute the method comprising:

display, with the WED, three dimensional (3D) weapon penetration locations that show locations at the geographical location where a projectile fired from the first person and the second person can strike the user.