Unmanned device interaction methods and systems

• US 9,713,675 B2
• Filed: 08/31/2012
• Issued: 07/25/2017
• Est. Priority Date: 07/17/2012
• Status: Expired due to Fees

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Rinaldo, Jr., John D., Wood, Jr., Lowell L., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A.
• Primary Examiner(s): PATEL, SHARDUL D
• Application Number:
  US13/601,195
• Publication Number:
  US 20140067167A1
• Time in Patent Office: 1,789 Days
• Field of Search: 701 2, 701 3, 701 11, 701 23, 701 24, 701124
• CPC Class Codes: A61M 5/002 Packages specially adapted therefor, e.g. for syringes or needles, kits for diabetics needle protection, e.g. caps, A61M5/3202; for sharps A61B50/3001
• CPC Class Codes: A61M 5/20 Automatic syringes, e.g. with automatically actuated piston rod, with automatic needle injection, filling automatically A61M5/142 , A61M5/46 take precedence; hypodermic projectiles F42B12/54
• CPC Class Codes: A63H 27/12 Helicopters A63H27/04 takes precedence; Flying tops
• CPC Class Codes: B64C 39/02 characterised by special use
• CPC Class Codes: B64U 80/25 for recharging batteries; for refuelling
• CPC Class Codes: G05B 19/00 Programme-control systems
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0027 involving a plurality of vehicles, e.g. fleet or convoy travelling fleet control of land vehicles from a control room G05D1/0297; traffic control systems for road vehicles G08G1/00; for marine craft G08G3/00; for aircraft G08G5/00
• CPC Class Codes: G05D 1/005 by providing the operator with signals other than visual, e.g. acoustic, haptic
• CPC Class Codes: G05D 1/0202 specially adapted to aircraft
• CPC Class Codes: G05D 1/102 specially adapted for vertical take-off of aircraft
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management

Abstract

Structures and protocols are presented for configuring an unmanned aerial device to participate in the performance of tasks, for using data resulting from such a configuration or performance, or for facilitating other interactions with such devices.

Claims

1. A system comprising:

electronic circuitry configured for capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

electronic circuitry configured for analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

electronic circuitry configured for determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors; and

electronic circuitry configured for triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

2. A system comprising:

at least one computing device; and

one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for;

capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors; and

triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

3. The system of claim 2 in which the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors comprises:

obtaining an indication that the at least one unmanned aerial device is performing a particular task; and

comparing the particular task against a task list of one or more permitted tasks for the at least one unmanned aerial device.

4. The system of claim 2 in which the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors comprises:

obtaining an indication that the first unmanned aerial device is in a specific zone; and

comparing an identifier of the at least one unmanned aerial device against an entity list identifying one or more entities that are permitted in the specific zone.

5. The system of claim 2 in which the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions comprises:

triggering transmission of the captured imaging data depicting the at least one unmanned aerial device when an indication that the at least one unmanned aerial device has not been identified is received.

6. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

at least one of;

configuring a second unmanned aerial device to perform a first observation of the at least one unmanned aerial device in a first zone and configuring a third unmanned aerial device to perform a second observation of the at least one unmanned aerial device in a second zone;

configuring the at least one unmanned aerial device to capture data relating to a human subject;

or

causing the at least one unmanned aerial device to undertake a performance observation task following a performance task.

7. The system of claim 2 further comprising:

a handheld device configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

8. The system of claim 2 further comprising:

a wearable device configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

9. The system of claim 2 further comprising:

a second unmanned aerial device configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

10. The system of claim 2 further comprising:

a second unmanned aerial device configured for the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

11. The system of claim 2 further comprising

a surveillance device configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

12. The system of claim 2 further comprising:

a network device configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

13. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

configuring the at least one unmanned aerial device to transmit a wireless signal indicative of having performed a particular task and not to store any indication of having performed the particular task.

14. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

transmitting a wireless signal indicative of a delivery of a package to a device associated with a recipient of the package, the wireless signal indicating at least one of the at least one unmanned aerial device or the package or a sender of the package.

15. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

signaling a decision whether to reserve a specific resource by associating the specific resource with a specific device or with a specific person.

16. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

responding to an indication of a second unmanned aerial device becoming within a proximity of the first unmanned aerial device.

17. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

transmitting navigation guidance via a speaker of the at least one unmanned aerial device.

18. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

identifying an operating mode of the at least one unmanned aerial device audibly or visibly.

19. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing an observation unit to be lifted by the at least one unmanned aerial device and activated within a threshold time period.

20. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

signaling a decision whether to configure the at least one unmanned aerial device to continue observing a first person responsive to a prior observation of the first person.

21. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing a second unmanned aerial device to capture delivery data relating to the at least one unmanned aerial device.

22. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing a data handling device aboard the at least one unmanned aerial device to contain a task schedule indicating a first future delivery of a first object to a first destination and a second future delivery of a second object to a second destination.

23. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing the at least one unmanned aerial device to execute a delivery of a dose of a therapeutic material to a human subject within a threshold time period following an image capture of at least a portion of the human subject.

24. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing the at least one unmanned aerial device to execute a delivery of a particular object contemporaneously with an image capture.

25. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

determining whether an operator of the at least one unmanned aerial device has indicated a tracking mode of the at least one unmanned aerial device.

26. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

overriding a first task being performed by the at least one unmanned aerial device by transmitting a wireless signal indicative of a second task to the at least one unmanned aerial device.

27. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

causing the at least one unmanned aerial device to fly toward a home station in response to an indication of a specific person moving at least a threshold distance away from the at least one unmanned aerial device.

28. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

responding to a determination of whether a received signal expresses a first name of the at least one unmanned aerial device and whether the received signal expresses a second name of the at least one unmanned aerial device.

29. The system of claim 2 further comprising:

a vehicle, having one or more wheels, configured for at least one of the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

the analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors;

or the triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

30. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

signaling a decision whether to reserve a space for a passenger vehicle.

31. The system of claim 2 further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

presenting navigation guidance via a display aboard the at least one unmanned aerial device.

32. The system of 2, wherein the determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors includes:

obtaining an indication that the at least one unmanned aerial device deviates from at least one of a proximity restriction definition, a location restriction definition, a temporal restriction definition, an identification restriction definition, or a purpose restriction definition.

33. The system of 2, wherein the capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device includes:

capturing, via the at least one imaging device, imaging data depicting the at least one unmanned aerial device at a first sampling rate; and

capturing, via the at least one imaging device, imaging data depicting the at least one unmanned aerial device at a second sampling rate responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.

34. A processing device-implemented method comprising:

capturing, via at least one imaging device, imaging data depicting the at least one unmanned aerial device;

analyzing the imaging data depicting the at least one unmanned aerial device via pattern recognition including at least determining at least one behavior of the at least one unmanned aerial device based at least partly on analysis of the imaging data depicting the at least one unmanned aerial device;

determining whether the at least one behavior of the at least one unmanned aerial device deviates from one or more use restrictions including at least determining a location of the at least one unmanned aerial device, obtaining a definition of at least one of permitted behaviors or restricted behaviors at the location of the at least one unmanned aerial device, and classifying the at least one behavior of the at least one unmanned aerial device based at least partly on the definition of at least one of permitted behaviors or restricted behaviors; and

triggering transmission of the captured imaging data depicting the at least one unmanned aerial device responsive to a determination that the at least one behavior of the at least one unmanned aerial device deviates from the one or more use restrictions.