Source location determination

• US 10,301,019 B1
• Filed: 12/17/2015
• Issued: 05/28/2019
• Est. Priority Date: 12/17/2015
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Canavor, Darren Ernest, McClintock, Jon Aaron
• Primary Examiner(s): To, Tuan C
• Application Number:
  US14/973,623
• Time in Patent Office: 1,258 Days
• Field of Search: 701 3
• CPC Class Codes: B64U 10/16 with five or more distinct rotor axes, e.g. octocopters
• CPC Class Codes: B64U 20/60 UAVs characterised by the material
• CPC Class Codes: B64U 2101/24 for use as flying displays, e.g. advertising or billboards
• CPC Class Codes: B64U 2101/32 for cartography or topography
• CPC Class Codes: B64U 2101/60 for transporting passengers; for transporting goods other than weapons
• CPC Class Codes: B64U 2101/64 for parcel delivery or retrieval
• CPC Class Codes: B64U 2201/00 UAVs characterised by their flight controls
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: H04W 4/02 Services making use of location information

Abstract

Described is system and method for determining a location of a client device. In one implementation, an unmanned aerial vehicle (UAV) receives an image of the UAV, obtained by the client device. The image is processed to determine a source area of the client device. As the UAV navigates toward the area, it scans the area for the client device and/or obtains additional information from the client device to aid in determining the location of the client device.

Claims

1. A method to determine a source location, the method comprising:

establishing a wireless connection between an unmanned aerial vehicle (“

UAV”

) positioned at a UAV position within an uncontrolled environment and a client device positioned at a source location within the uncontrolled environment;

receiving at the UAV via the wireless connection, an image that includes a representation of the UAV at the UAV position, wherein the image is obtained by the client device at the source location;

processing, with the UAV, the image to determine an area within the uncontrolled environment including the source location;

aerially navigating the UAV toward the area;

processing at the UAV additional information to determine the source location within the area; and

delivering with the UAV a payload to the source location.

2. The method of claim 1, wherein processing with the UAV the image to determine the area, includes:

determining a first position of the UAV represented in the image;

determining a second position of an object represented in the image, wherein the object is not the UAV;

scanning with a camera coupled to the UAV, a second area of the uncontrolled environment to detect the object within the uncontrolled environment;

determining a perspective of the client device based at least in part on the first position of the UAV and the second position of the object; and

determining the area based at least in part on the perspective.

3. The method of claim 2, wherein the object is at least one of a building, a cloud, a second UAV, an aerial vehicle, a landscape, a landmark, or a celestial object.

4. The method of claim 1, further comprising:

sending from the UAV via the wireless connection a request to the client device, requesting that the client device provide to the UAV the additional information, wherein the additional information includes at least one of;

the client device emitting a visual beacon,

the client device emitting an audible beacon,

the client device presenting information on a display requesting action from a user,

the client device sending via the wireless connection streaming video obtained by the client device that includes a representation of the UAV,

the client device sending via the wireless connection additional images of the UAV obtained by the client device, or

the client device sending via the wireless connection an image of a user of the client device, or

the client device sending via the wireless connection an image of a shadow of the user of the client device.

5. The method of claim 1, further comprising:

obtaining with a camera positioned on the UAV, a second image of the area containing the source location;

sending from the UAV via the wireless connection to the client device, the second image;

receiving at the UAV and from the client device via the wireless connection, an indication of the source location represented in the second image, wherein the indication of the source location is included in the additional information; and

wherein processing the additional information includes, determining from the indication the source location within the area.

6. A method to determine a source location, comprising:

detecting a request notification that is generated by a client device at the source location;

receiving, at an unmanned aerial vehicle (“

UAV”

) at a UAV position within an environment that includes the source location, an image of the UAV that includes a representation of the UAV at the UAV position;

determining, based at least in part on the image, position information corresponding to the source location; and

sending instructions to a remote source to perform an action at the source location.

7. The method of claim 6, wherein the position information includes a row and a seat identification.

8. The method of claim 6, wherein the source location is within a controlled environment.

9. The method of claim 6, wherein detecting the request notification includes:

receiving a wireless transmission from the client device.

10. A non-transitory computer readable storage medium storing instructions that when executed by one or more processors cause the one or more processors to perform acts comprising:

receive, at an unmanned aerial vehicle (“

UAV”

) at a UAV position within an environment that includes a source location, an image of the UAV that includes a representation of the UAV at the UAV position;

determine, based at least in part on the image, position information corresponding to the source location; and

cause instructions to be sent to perform an action at the source location.

11. The non-transitory computer readable storage medium of claim 10, wherein the instructions when executed by the one or more processors further cause the one or more processors to perform acts comprising:

detect a request notification generated by a client device positioned at the source location.

12. The non-transitory computer readable storage medium of claim 11, wherein the request notification is detected based on a wireless transmission from the client device being received.

13. The non-transitory computer readable storage medium of claim 10, wherein the instructions are sent to a remote source.

14. The non-transitory computer readable storage medium of claim 10, wherein the position information includes a row and a seat identification.

15. The non-transitory computer readable storage medium of claim 10, wherein the action includes at least one of the UAV or a second UAV navigating to a position proximate the source location and dispensing an item.

16. The non-transitory computer readable storage medium of claim 10, wherein the instructions that when executed by the one or more processors further cause the one or more processors to perform the acts comprising:

receive a beacon emitted by a client device positioned at the source location.

17. The non-transitory computer readable storage medium of claim 10, wherein the action includes an agent delivering an item to the source location.